Wednesday, 21 March, 2018

YouTube 'stories' feature lets creators swap out backgrounds without a green screen

YouTube offline Videos Google AI now can give YouTube videos a wacky background
Sherri Watson | 05 March, 2018, 22:31

YouTube is using Artificial Intelligence and machine learning to replace the background without even using the green screen.

This technology is created to be an easier alternative to using a green screen and chroma keying to change the background of a video.

The lightweight video format is rolling out to limited beta testers and will be helpful for YouTube creators. So, it shouldn't be a surprise the rollout of the new feature for mobile video.

"Our new segmentation technology allows creators to replace and modify the background, effortlessly increasing videos' production value without specialized equipment", Bazarevsky and Tkachenka said.

Furthermore, the specific segmentation task to compute a binary mask separating foreground from the background for every input frame (three channels, RGB) of the video was created. Having 3D scene data, for example extracted from newer iPhones' twin cameras, makes the process only a little easier.

According to the engineers, the feature will automatically segment the background and foreground of your videos. Unlike many online publications, we don't have a paywall or run banner advertising, because we want to keep our journalism open, without influence or the need to chase traffic. Google claims the training set has an accuracy of 94.8%, notes Digital Trends. Snapchat have also entered the AR game with their brand new filters.

That's not to say green screen will go out of fashion anytime soon, though. Google's new technology looks promising, but is not without some limitations (for now). As a result, the AI's background replacement quality not quite on par with a green screen, but Google's technique does not require editing skills or extra work. We wanted the app was easy and fast, so we initially set ourselves the task to get it to work 20-30 times faster than other segmentation models of photos. Although the roll-out started last month, the option to download YouTube videos didn't appear in more than several countries.

Will a similar feature be available on Instagram at some point?