Lips in the dashed oval, face still, then mouth a sentence. The words appear below as they are read. No audio is used; nothing leaves the phone unless you set a server below.
It knows 51 words, in one sentence shape:
command · colour · preposition · letter · digit · adverb bin lay place set · blue green red white · at by in with · a–z (no w) · zero–nine · again now please soon
Drag the oval to your mouth; pinch to resize. Tap the sentence for another one.
Any English words — with a server
Run example/thelip-server from the syrup repository on a computer: it prints a link (and a QR code) that brings its address here. The frames of each sentence go to that computer, which reads them with an open-vocabulary English model (LRS3, 19% word error rate in the lab) and answers in a few seconds. English only.
The Lip is the lip reader of the syrup library. Its network is LipNet (Assael, Shillingford, Whiteson, de Freitas 2016), weights from rizkiarm/LipNet (MIT), trained on the GRID corpus (CC BY 4.0): 64 of 66 words on GRID's sample clips. A new face and a phone camera are harder than that; expect misses.