TEN YEARS BEHIND

This use of AI has helped the music industry and IP-based video services like YouTube and Netflix to leapfrog 10 years ahead of broadcast， according to Shen， who believes that current production and distribution methods are bogged down by the human-driven assembly-like process that can be changed to an automated process by using AI and machine learning with the unlocked power of metadata. To overcome these hurdles， TVU introduced its MediaMind cloud platform at the 2018 NAB Show.

MediaMind puts the concept of Media 4.0 into practice by using AI，and object and speech recognition to maximize the use of media assets， particularly in live production. This “smart media factory” works within the existing video production workflow but enhances it by automating the ability to identify video content and push it to a variety of platforms.

Shen uses President Trump’s recent North Korean prisoner release ceremony as an example of how the MediaMind concept could be put into practice.

“There were a lot of cameras there that were recording for hours， waiting for the moment [prisoners debarked from the plane]， but they didn’t know exactly when，” Shen said. Using AI-powered facial recognition technology enabled by MediaMind， the cameras and mics could be automated to just focus on particular shots of interest to individual viewers， for example.

This CAS (Contribution Automation Solution) is one part of TVU’s MediaMind concept， but another equally important concept is the automation of the entire planning， acquisition and routing process. It integrates with the news system， router， camera， transmission devices and alert system. Once a story is created， the system will help manage resources by sending an alert message to the corresponding reporters and crews as well as all of the connected devices， such as cameras， transmission devices， routers and recording devices. Once content arrives into MediaMind， it becomes instantly searchable via metadata that is tagged to the content from acquisition onward.

This advanced search capability gives MediaMind the ability to push content to the producer， rather than the producer having to manually access it.

“A producer says ‘I want to write a story about the return of the three Americans from North Korea，’” Shen notes as an example，” the content will appear next to him rather than him having to go search for it.”

IN PRACTICE

The MediaMind API is already being integrated into the workflows of 4-5 of TVU’s approximately 2,500 TV station customers. Shen says customers can pick and choose which parts of MediaMind they want to integrate into their processes， which covers the production chain from acquisition， editing， processing and distribution. 

TVU One Live Streaming System

In today’s live televised production environment， nearly 99 percent of the raw material goes unused and therefore， un-monetized， according to Shen. Current production processes are tedious and don’t meet the demands of today’s viewer， who is used to using social media to provide the type of feedback that allows content to automatically be “pushed” to them.

Shen thinks Media 4.0，illustrated by TVU’s MediaMind platform， represents the future of live production—an integration between production and consumption—where viewers’ tastes， rather than the producers’ whims， will drive a more “story-centric” workflow.

“Media 4.0 is going to fundamentally change what’s needed to make the TV industry meet the demand of the audiences，” Shen said. “That’s what this whole initiative is about.”

(published May 21， 2018 https://www.tvtechnology.com)