From creating the GPU, RTX real-time ray tracing and neural rendering to now reinventing computing for AI, NVIDIA has for many years been on the forefront of laptop graphics — pushing the boundaries of what’s attainable in media and leisure.
NVIDIA Media2 is the newest AI-powered initiative remodeling content material creation, streaming and stay media experiences.
Constructed on applied sciences like NVIDIA NIM microservices and AI Blueprints — and breakthrough AI purposes from startups and software program companions — Media2 makes use of AI to drive the creation of smarter, extra tailor-made and extra impactful content material that may adapt to particular person viewer preferences.
Amid this speedy inventive transformation, firms embracing NVIDIA Media2 can keep on the $3 trillion media and leisure trade’s leading edge, reshaping how audiences devour and have interaction with content material.
NVIDIA Applied sciences on the Coronary heart of Media2
Because the media and leisure trade embraces generative AI and accelerated computing, NVIDIA applied sciences are remodeling how content material is created, delivered and skilled.
NVIDIA Holoscan for Media is a software-defined, AI-enabled platform that permits firms in broadcast, streaming and stay sports activities to run stay video pipelines on the identical infrastructure as AI. The platform delivers purposes from distributors throughout the trade on NVIDIA-accelerated infrastructure.
Delivering the facility wanted to drive the following wave of data-enhanced clever content material creation and hyper-personalized media is the NVIDIA Blackwell structure, constructed to deal with data-center-scale generative AI workflows with as much as 25x extra power effectivity over the NVIDIA Hopper era. Blackwell integrates six sorts of chips: GPUs, CPUs, DPUs, NVIDIA NVLink Swap chips, NVIDIA InfiniBand switches and Ethernet switches.
Blackwell is supported by NVIDIA AI Enterprise, an end-to-end software program platform for production-grade AI. NVIDIA AI Enterprise includes NVIDIA NIM microservices, AI frameworks, libraries and instruments that media firms can deploy on NVIDIA-accelerated clouds, information facilities and workstations. Of the increasing listing, these embody:
- The Mistral-NeMo-12B-Instruct NIM microservice, which permits multilingual data retrieval — the power to go looking, course of and retrieve information throughout languages. That is key in enhancing an AI mannequin’s outputs with higher accuracy and world relevancy.
- The NVIDIA Omniverse Blueprint for 3D conditioning for exact visible generative AI, which might help advertisers simply construct personalised, on-brand and product-accurate advertising and marketing content material at scale utilizing real-time rendering and generative AI with out affecting a hero product asset.
- The NVIDIA Cosmos Nemotron imaginative and prescient language mannequin NIM microservice, which is a multimodal VLM that may perceive the which means and context of textual content, photos and video. With the microservice, media firms can question photos and movies with pure language and obtain informative responses.
- The NVIDIA Edify multimodal generative AI structure, which may generate visible property — like photos, 3D fashions and HDRi environments — from textual content or picture prompts. It gives superior enhancing instruments and environment friendly coaching for builders. With NVIDIA AI Foundry, service suppliers can customise Edify fashions for business visible companies utilizing NVIDIA NIM microservices.
Companions within the Media2 Ecosystem
Companions throughout the trade are adopting NVIDIA expertise to reshape the following chapter of storytelling.
Getty Pictures and Shutterstock are clever content material creation companies constructed with NVIDIA Edify. The AI fashions have additionally been optimized and packaged for optimum efficiency with NVIDIA NIM microservices.
Bria is a commercial-first visible generative AI platform designed for builders. It’s skilled on 100% licensed information and constructed on accountable AI rules. The platform gives instruments for customized pipelines, seamless integration and versatile deployment, guaranteeing enterprise-grade compliance and scalable, predictable content material era. Optimized with NVIDIA NIM microservices, Bria delivers quicker, safer and scalable production-ready options.
Runway is an AI platform that gives superior inventive instruments for artists and filmmakers. The corporate’s Gen-3 Alpha Turbo mannequin excels in video era and features a new Digital camera Management characteristic that permits for exact digicam actions like pan, tilt and zoom. Runway’s integration of the NVIDIA CV-CUDA open-source library mixed with NVIDIA GPUs accelerates preprocessing for high-resolution movies in its segmentation mannequin.
Surprise Dynamics, an Autodesk firm, not too long ago launched the beta model of Surprise Animation, that includes highly effective new video-to-3D scene expertise that may flip any video sequence right into a 3D-animated scene for animated movie manufacturing. Accelerated by NVIDIA GPU expertise, Surprise Animation offers visible results artists and animators with an easy-to-use, versatile software that considerably reduces the time, complexity and efforts historically related to 3D animation and visible results workflows — whereas permitting the artist to take care of full inventive management.
Comcast’s Sky innovation group is collaborating with NVIDIA on lab testing NVIDIA NIM microservices and accomplice fashions for its world platforms. The mixing may result in higher interactivity and accessibility for purchasers world wide, equivalent to enabling using voice instructions to request summaries throughout stay sports activities and entry different contextual data.
Vū, a inventive expertise firm and residential to the biggest community of digital studios, is broadening entry to the creation of digital environments and immersive content material with NVIDIA-accelerated generative AI applied sciences.
Twelve Labs, a member of the NVIDIA Inception program for startups, is creating superior multimodal basis fashions that may perceive movies like people, enabling exact semantic search, content material evaluation and video-to-text era. Twelve Labs makes use of NVIDIA H100 GPUs to considerably enhance the fashions’ inference efficiency, attaining as much as a 7x enchancment in requests served per second.
S4 Capital’s Monks is utilizing cutting-edge AI applied sciences to boost stay broadcasts with real-time content material segmentation and personalised fan experiences. Powered by NVIDIA Holoscan for Media, the corporate’s answer is built-in with instruments like NVIDIA VILA to generate contextual metadata for injection inside a time-addressible media retailer framework — enabling exact, action-based looking out inside video content material.
Moreover, Monks makes use of NVIDIA NeMo Curator to assist course of information to construct tailor-made AI fashions for sports activities leagues and IP holders, unlocking new monetization alternatives by licensing. By combining these applied sciences, broadcasters can seamlessly ship hyper-relevant content material to followers as occasions unfold, whereas adapting to the evolving calls for of recent audiences.
Media firms handle huge quantities of video content material, which will be difficult and time-consuming to find, catalog and compile into completed property. Main media-focused advisor and system integrator Qvest has developed an AI video discovery engine, constructed on NIM microservices, that accelerates this course of by automating the info seize of video recordsdata. This streamlines a consumer’s means to each uncover and contextualize how movies can match of their supposed story.
Verizon is remodeling world enterprise operations, in addition to stay media and sports activities content material, by integrating its dependable, safe non-public 5G community with NVIDIA’s full-stack AI platform, together with NVIDIA AI Enterprise and NIM microservices, to ship the newest AI options on the edge.
Utilizing this answer, streamers, sports activities leagues and rights holders can improve fan experiences with higher interactivity and immersion by deploying high-performance 5G connectivity together with generative AI, agentic AI, prolonged actuality and streaming purposes that allow personalised content material supply. These applied sciences additionally assist elevate participant efficiency and viewer engagement by providing real-time information analytics to coaches, gamers, referees and followers. It will probably additionally allow non-public 5G-powered enterprise AI use circumstances to drive automation and productiveness.
Welcome to NVIDIA Media2
The NVIDIA Media2 initiative empowers firms to redefine the way forward for media and leisure by clever, data-driven and immersive applied sciences — giving them a aggressive edge whereas equipping them to drive innovation throughout the trade.
NIM microservices from NVIDIA and mannequin builders are actually obtainable to strive, with extra fashions added recurrently.
Get began with NVIDIA NIM and AI Blueprints, and watch the CES opening keynote delivered by NVIDIA founder and CEO Jensen Huang to listen to the newest developments in AI.
See discover relating to software program product data.