NVIDIA technology will make sure you never lose eye contact
The latest version of NVIDIA Broadcast is now live. It adds a new effect which aligns the gaze on the camera.
Content creators will now be able to read the scripts while NVIDIA technology will ensure that they are looking at the camera. The Eye Contact effect has been implemented into Broadcast software stack, a special toolbox for people who record their videos.
NVIDIA Eye Contact technology, Source: NVIDIA
This technology will not only control where the speaker is staring, it will also copy the eye color and make sure that he blinks. It will do so automatically while recording and will do it smoothly enough for viewers not to notice.
The Eye Control should find its use among speakers and content creators who record themselves while reading the script. A job interview with notes plastered on the wall or teaching students while playing a game on another screen should not be a problem either.
The technology was demonstrated by Gerardo Delgado (Product Line manager at NVIDIA Studio), but there is even better demo by The Verge editor Mitchel Clark with a lot more movement involved:
Such technology is just a glimpse of what is to come in the emerging field of deep faking videos. Researches and enthusiast alike have already found a way to change their looks and voice entirely, often pretending to be celebrities. In such a case AI model training is needed. Here NVIDIA has trained its AI model to mimic ‘millions of eye colors and lighting combinations’.
What’s new in NVIDIA Broadcast 1.4.0
- New Effect – Eye Contact (beta): morphs the eyes of the speaker to simulate eye contact by estimating and aligning gaze with the camera.
- New Effect – Vignette: Simulates a lens effect by darkening the corners of the frame for cosmetic effect.
- Updated Virtual Background effects (Blur, Replace, Removal). The updated effect uses temporal information to improve segmentation quality and stability.
- App Improvements:
- New options for Mirroring Camera Preview and taking Selfie snapshots.
- Added tooltips for better accessibility.
- If the camera device selected as input is in use in another app, and the user attempts to display the NVIDIA Camera virtual device, the app will display a camera in-use icon instead of a gray frame.
