Introducing Visual Audio Sensor

Visual Audio Sensor brings together sensor-equipped glasses, wireless earbuds, and a Flutter mobile app to conquer three common hearing hurdles—noisy environments, static audio profiles, and fragmented controls. With real-time beamforming, BLE-powered connectivity, and an intuitive app, it delivers razor-sharp speech focus and effortless control wherever you go.

The Listening Challenge

To see why Visual Audio Sensor matters, consider what today's hearing devices can't do:

• Focus on the Speaker: Background noise still overwhelms users.

• On-the-Fly Control: Adjusting left/right balance or EQ means juggling multiple devices.

• Adaptive Audio: No automatic tuning based on speaker distance or movement.

Overcoming Key Technical Hurdles

Designing a truly seamless system meant solving:

• Noise vs. Speech Discrimination: Identifying target voices in real time.

• Fragmented Controls: Unifying settings across glasses, earbuds, and app.

• Reliable BLE Integration: Keeping low-latency, secure links among three device types.

• Dynamic Environment Adaptation: Auto-tuning audio as speakers move.

• Power Efficiency: Running sensors, beamforming, and streaming without draining batteries.

Our Innovative Solution

Here's how Visual Audio Sensor tackles each challenge:

• Focused Audio Capture: Patented face-detection beamforming hones in on the active speaker.

• Unified Mobile Control: A single Flutter app handles discovery, EQ, volume, firmware updates and more.

• Adaptive Sound Profiles: Real-time proximity data automatically retunes your audio.

• Secure BLE Management: Native bridges on iOS/Android ensure rock-solid connectivity.

• Efficient Hardware Design: High-fidelity audio without sacrificing battery life.

Core Components

Each piece plays a crucial role in the overall experience:

Smart Glasses

• Embedded face-detection and range sensors drive precision beamforming.

Wireless Earbuds

• NRF5340_AUDIO ADK + LC3 codec deliver crisp, low-latency sound.

Flutter Mobile App

• BLE 5.3+ pairing, real-time sync of EQ, boosters, volume and battery status.

How It Works

1. Pair & Discover: The app scans for Visual Audio Sensor Glasses and Earbuds over BLE and pairs them independently.

2. Activate Beamforming: Glasses' sensors locate your speaker; beamforming algorithms isolate their voice.

3. Real-Time Sync: EQ, volume, channel and booster settings propagate instantly to each device.

4. Proximity Optimization: Range measurements adjust audio gain and focus based on speaker distance.

5. Continuous Monitoring: Live battery and connection indicators in the app keep you informed.

Who Benefits

• Individuals with Hearing Loss: Regain clarity in crowded or changing environments.

• Audiologists & Therapists: Offer patients a data-driven, adaptive hearing solution.

• Professionals in Noisy Settings: From restaurants to conferences—stay engaged in every discussion.

Spotlight Features

Sensor-Equipped Glasses

• Precision beamforming via embedded sensors.

Wireless Earbuds with ADK

• High-fidelity audio powered by NRF5340_AUDIO and LC3.

Cross-Platform Flutter App

• Simple setup, live control, and firmware updates over BLE.

Instant Sync

• Real-time EQ, volume and channel updates across all devices.

Battery Insights

• Live readouts and low-battery alerts to avoid downtime.

Secure BLE Management

• Native-bridge implementations for reliable, encrypted connections.

Hear the Impact

• Sharper Speech Focus even in the busiest, noisiest spaces

• Effortless Experience with one-tap pairing and unified controls

• Seamless Adaptation that follows your conversation as people move

• All-Day Uptime thanks to proactive battery monitoring and efficient design