Researchers develop AI that reads lips from video footage

Venture Beat | Dec 4, 2019 at 6:05 PM
  • AI and machine learning algorithms capable of reading lips from videos aren’t anything out of the ordinary.
  • In pursuit of a more performant system, researchers at Alibaba, Zhejiang University, and the Stevens Institute of Technology devised a method dubbed Lip by Speech (LIBS).
  • LIBS distills useful audio information from videos of human speakers at multiple scales, including at the sequence level, context level, and frame level.