Google Turns Sign Language into Input Method: Pixel 11 Can Type by Sign Language in Front of Camera

According to TrendForce's Beating Monitor, Google DeepMind has released the Sign Language to Text model, SL2T, and integrated it into the Gboard and Live Transcribe on the Pixel 11. The initial release supports American Sign Language to English. Users can sign in front of their phones to search, message, input text, and even directly query Gemini.

SL2T was trained on over 100,000 hours of data, covering 50+ sign languages, with approximately a quarter being American Sign Language. The phone first extracts the hand, face, and body pose coordinates, sends only the coordinates to the server for translation, and does not upload the original video.