Contact
WorkSolid black horizontal rectangle on a white background
Talking Point powered by L+R graphic with a hand below the logo.Wide Talking Point powered by L+R graphic with a finger below the logo.

Talking Point  • Declassified
Point at any text and hear it spoken, on Meta's AI glasses

Solid black horizontal rectangle on a white background

Client since 2012

Background

Pioneering Accessible Spatial Computing

We constantly build with the latest technologies to create Baseplates, which are novel applications of emerging tools designed to help stakeholders see their true power. Recognizing that visually impaired individuals struggle to parse environmental text, we leveraged Meta smart glasses to create a screenless utility rooted in humanist design values.

Man wearing smart glasses holding a framed print.Man wearing smart glasses holding a framed print.
Product mockup of smart glasses and a black wristband.Product mockup of smart glasses and a black wristband.
Woman wearing smart glasses reading a red William Arcand book.Woman wearing smart glasses reading a red William Arcand book.
Challenge

Overcoming Low Latency Hardware Constraints

Delivering real time text recognition without visual feedback requires incredibly low latency processing. L+R needed to utilize the Meta Device Access Toolkit SDK to overcome strict compute limitations. The core friction involved designing an intuitive finger pointing gesture that reliably triggered the optical character recognition engine.

Hand tracking interface with skeleton overlay and Right Pointer label.Hand tracking screen showing a raised index finger labeled Right Pointer.
Hand pose detection interface showing a raised index finger labeled pointer.Hand tracking screen with skeleton overlay and green motion trail.
Finger pointing at Video on a projector box with tracking overlay.Finger pointing at Video on a projector box with tracking markers.
Solution

Engineering an Intuitive Translation Interface

Our strategy, design, engineering, and operations teams collaborated to architect the application using 100% on device AI. Because nothing needs to go to the cloud, the software provides powerful privacy and battery life benefits. Users simply point at physical text and the glasses automatically translate words using spatial audio.

Smartphone home screen showing the Talking Point app icon.Close-up smartphone mockup showing the Talking Point app icon.
Man using smart glasses and a phone to translate a Colombia book cover.Phone translating Colombia text from English to Spanish beside a book.
Man wearing smart glasses tapping Finish on a phone registration screen.Phone screen showing the Talking Point app registration flow.
Talking Point app mockup with onboarding screens and smart glasses.Talking Point app onboarding flow mockup for smart glasses.
Impact

Breaking Down Global Language Barriers

Talking Point successfully showcases the profound utility of screenless spatial computing. By prioritizing accessibility, the application empowers users to navigate foreign and complex environments with absolute confidence. This project illustrates how strategically deployed artificial intelligence can create deeply meaningful and inclusive experiences for a global audience.

Man using smart glasses and a phone to read a street sign.Man pointing at a Rambla de Catalunya sign while a phone shows a translation view.
Woman using smart glasses and a phone to read a restaurant menu.Woman pointing at a French menu while a phone shows a translation interface.
Man using smart glasses and a phone to read an Alhambra sign.Man pointing at a Palacio Nazari sign while a phone shows a translation view.
The Bottom Line

Talking Point shows how smart glasses can make everyday text more accessible without adding another screen. The broader challenge is designing AI that works in the moment, respects privacy, and gives people confidence in unfamiliar environments. L+R brings strategy, design, engineering, and craft together so emerging hardware becomes practical utility rather than novelty. If your product idea needs to serve people in the real world, let's make the interface disappear.

Content You May Enjoy

TEAM DUMBO logo in white outlined letters on a green background

DUMBO Public Art Spatial Guide

The hands-free AI guide to DUMBO's public art, built for Meta AI glasses

Large DUMBO sign on posts outside a building as a person walks past.
Glowing wireframe cubes on a dark digital background

Service

Smart Glasses App Development

Smart Glasses App Development for the next wearable platform

Insight
  • Bearded man wearing a black cap and white buttoned shirt on a green background
  • Head-and-shoulders portrait of a man in a dark blazer and white shirt on a green background

Introducing Ephemeral Perception: A Privacy-By-Architecture Framework for Smart Glasses Developers

Ephemeral Perception report cover surrounded by smart glasses on a dark background.
Insight

    L+R supports Meta to open Ray-Ban Display glasses to developers

    Close-up of smart glasses showing a small notification in the lens