Snap Inc.

Zsolt Robotka

Attila Alvarez

Kai Zhou

Jennica Pounds

Andras Nemeth

Dávid Pálházi

Dávid Retek

Márton Kajtar

András Németh

János Rovnyai

Mátyás Trosztel

Márton Gergely Kajtár

Peter Poscsi

Péter Pócsi

A system and method for translating sign language utterances into a target language, including: receiving motion capture data; producing phonemes/sign fragments from the received motion capture data; producing a plurality of sign sequences from the phonemes/sign fragments; parsing these sign sequences to produce grammatically parsed sign utterances; translating the grammatically parsed sign utterances into grammatical representations in the target language; and generating output utterances in the target language based upon the grammatical representations.

Computer vision based sign language interpreter

A method for recognizing sign language using collaborative augmented reality devices is described. In one aspect, a method includes accessing a first image generated by a first augmented reality device and a second image generated by a second augmented reality device, the first image and the second image depicting a hand gesture of a user of the first augmented reality device, synchronizing the first augmented reality device with the second augmented reality device, in response to the synchronizing, distributing one or more processes of a sign language recognition system between the first and second augmented reality devices, collecting results from the one or more processes from the first and second augmented reality devices, and displaying, in near real-time in a first display of the first augmented reality device, text indicating a sign language translation of the hand gesture based on the results.

Sign language interpretation with collaborative agents

Growing community of inventors

Budapest, Hungary

Zsolt Robotka