TotalMedia’s AI exploration for broadcasting
Huang Jin CTO, Arc-video,TotalMedia, Danghong
Introduction
The world of broadcasting has seen incredible change, from silent films to the high-definition digital content we enjoy today, accessible across various platforms. Now, the industry appears ready for another exciting evolution, driven by the potential of Artificial Intelligence. TotalMedia is actively involved in this exploration of AI’s possibilities for broadcasting. We focus on using AI to enhance various aspects, aiming to improve efficiency, audience engagement, and creative freedom. We believe our solutions can contribute to shaping how audiences experience media in the future.
TotalMedia’s software-defined video pipeline seamlessly adapts to a wide spectrum of broadcasting needs, empowering broadcasters with unparalleled flexibility and customization options. It seamlessly integrates with existing workflows, leveraging the power of widely used CPUs and GPUs to enable flexible deployment, whether on-premise or in the cloud. And GPU acceleration of demanding AI computations allows seamless integration of a wide range of video AI features, giving broadcasters a significant edge in efficiency and creativity.
Compression and workflow efficiency
Imagine enjoying your favorite shows in stunning quality without worrying about data usage. TotalMedia’s innovative content-adaptive encoding achieves this by reducing bitrate by over 20% while maintaining exceptional visual quality compared to traditional encoding methods. This translates to a smoother viewing experience for audiences who consume less data, and significant cost savings for broadcasters on bandwidth.
TotalMedia further streamlines workflows by automating tasks with video analytics. Processes like metadata tagging, content management, and moderation become automatic, transforming vast video libraries into easily searchable, well-organized resources. Creators benefit from this automation by focusing on storytelling instead of administrative duties. This increased efficiency not only boosts productivity but also fosters a more dynamic and creative broadcasting environment.
AI-driven enhanced viewer experiences
Today’s audiences crave exceptional broadcast experiences. TotalMedia delivers with innovative AI models that elevate viewing in several ways:
Richer Colors: Yearn for those vibrant hues? TotalMedia’s AI employs color cast correction, tone enhancement, exposure correction, contrast adjustment, and saturation enhancement to create a visually stunning and immersive experience.
Sharper Details: Low resolution content often lacks the crispness of modern broadcasts. TotalMedia’s AI-powered super-resolution technology upscales content to HD and 4K resolutions, breathing new life into classic favorites.
Smooth Action: Fast-paced scenes and sports demand seamless motion. TotalMedia utilizes Generative Adversarial Networks to enhance smoothness and stability, resulting in exceptional frame interpolation and a captivating viewing experience.
Movie Restoration: Film grain, scratches, and faded colors can ruin the enjoyment of older movies. TotalMedia’s AI intelligently identifies and removes these imperfections, restoring films to their former glory.
By ensuring smoother, clearer, and more vibrant video playback, TotalMedia’s AI advancements offer viewers an unparalleled level of engagement and immersion.
Creativity: AI generated content combined with traditional AI tools
TotalMedia explores more efficient and creative production workflows, by combining Artificial Intelligence Generated Content (AIGC) with traditional AI tools, to enhance video editing, Sports content production, NeRF 3D object creation, etc.
TotalMedia Video Matting supports background matting with AI background removal, and replaces it with AI generated image and video. This background removal, generation and replacement streamlines production processes and empowers businesses and individual users to craft videos effortlessly.
TotalMedia Slow Motion, Highlight Reel, and Smart Portrait Screen Streaming for Sports broadcasting, enhances viewing experience by delivering slow-motion and highlight reels for Sports programs, and generates portrait screen streams dedicated to mobile phone that focus on star athletes or ball-carrier movements.
Additionally, TotalMedia 3D support volumetric video and NeRF. It helps the capture, generation and interaction of spatial video content, and also supports 2D image to 3D object conversion, elevates the the viewing experience for XR. For example, the 3D volumetric videos could be exported to both 3D model and MV-HEVC video formats, and manipulate and playback in Apple Vision Pro.
Conclusion:
TotalMedia’s AI-powered broadcasting solutions are making a significant impact on media consumption. We’re constantly striving to improve efficiency, innovation, and user experience, pushing the boundaries of what’s possible in content creation and delivery. We believe AI has the potential to revolutionize the industry, and we’re excited to be at the forefront of this exploration, alongside other innovators in the field.
About TotalMedia
With over three decades of expertise in image and video core technologies, TotalMedia are proud to empower industries that heavily rely on video, including Broadcasters, TV Stations, Cable Networks, Telecom Operators, OTT, Content Providers, Education, and even emerging sectors like In-Vehicle Infotainment systems. To learn more, please visit www.totalmedia.ai
Huang Jin (graduated from Zhejiang University with a master’s degree), is responsible for hardware partners relationship and also led Smart City and IVI product development. His main experience is as follows: From 2003 to 2015, he served as R&D project director and technical architect of ArcSoft.
