NVIDIA Broadcast can now deepfake your eyes

Published: Jan 13th 2023, 17:41 GMT   Comments

NVIDIA technology will make sure you never lose eye contact

The latest version of NVIDIA Broadcast is now live. It adds a new effect which aligns the gaze on the camera. 

Content creators will now be able to read the scripts while NVIDIA technology will ensure that they are looking at the camera. The Eye Contact effect has been implemented into Broadcast software stack, a special toolbox for people who record their videos.

NVIDIA Eye Contact technology, Source: NVIDIA

This technology will not only control where the speaker is staring, it will also copy the eye color and make sure that he blinks. It will do so automatically while recording and will do it smoothly enough for viewers not to notice.

The Eye Control should find its use among speakers and content creators who record themselves while reading the script. A job interview with notes plastered on the wall or teaching students while playing a game on another screen should not be a problem either.

The technology was demonstrated by Gerardo Delgado (Product Line manager at NVIDIA Studio), but there is even better demo by The Verge editor Mitchel Clark with a lot more movement involved:

[Pixelated Pine] Nvidia Broadcast Eye Contact Demo (39,069 views)

Such technology is just a glimpse of what is to come in the emerging field of deep faking videos. Researches and enthusiast alike have already found a way to change their looks and voice entirely, often pretending to be celebrities. In such a case AI model training is needed. Here NVIDIA has trained its AI model to mimic ‘millions of eye colors and lighting combinations’.

What’s new in NVIDIA Broadcast 1.4.0

  • New Effect – Eye Contact (beta): morphs the eyes of the speaker to simulate eye contact by estimating and aligning gaze with the camera.
  • New Effect – Vignette: Simulates a lens effect by darkening the corners of the frame for cosmetic effect.
  • Updated Virtual Background effects (Blur, Replace, Removal). The updated effect uses temporal information to improve segmentation quality and stability.
  • App Improvements:
  • New options for Mirroring Camera Preview and taking Selfie snapshots.
  • Added tooltips for better accessibility.
  • If the camera device selected as input is in use in another app, and the user attempts to display the NVIDIA Camera virtual device, the app will display a camera in-use icon instead of a gray frame.

Source: NVIDIA via TheVerge

Comment Policy
  1. Comments must be written in English and should not exceed 1000 characters.
  2. Comments deemed to be spam or solely promotional in nature will be deleted. Including a link to relevant content is permitted, but comments should be relevant to the post topic. Discussions about politics are not allowed on this website.
  3. Comments and usernames containing language or concepts that could be deemed offensive will be deleted.
  4. Comments complaining about the post subject or its source will be removed.
  5. A failure to comply with these rules will result in a warning and, in extreme cases, a ban. In addition, please note that comments that attack or harass an individual directly will result in a ban without warning.
  6. VideoCardz has never been sponsored by AMD, Intel, or NVIDIA. Users claiming otherwise will be banned.
  7. VideoCardz Moderating Team reserves the right to edit or delete any comments submitted to the site without notice.
  8. If you have any questions about the commenting policy, please let us know through the Contact Page.
Hide Comment Policy