AI Voice & Multimodal Workflows

Real-time speech-to-speech, vision inspection, audio analysis, and video processing.

One-time purchase

£29.00

Instant Access

I consent to immediate access to this digital content and acknowledge that under the UK Consumer Contracts Regulations 2013, my 14-day statutory right of cancellation is waived upon purchase.

Encrypted payment processing via Stripe Checkout

DRM-free PDF e-book delivered immediately after payment

Purchase receipt emailed automatically

About this Book

The frontier of AI is multimodal. Discover how to build low-latency voice assistants with sub-500ms response times, implement vision-based defect inspection, analyze complex diagrams, and stream real-time audio over WebSockets using Gemini Live and Whisper pipelines.

Target Audience: Engineers building next-generation conversational interfaces and spatial AI tools.

What You Will Learn & Build

Achieve conversational voice latency under 500ms with bidirectional streaming

Process high-resolution visual inputs, architectural blueprints, and UI screenshots

Implement voice activity detection (VAD) and interruptible audio playback

Build multimodal search engines combining images, speech transcripts, and text

1. The Shift to Native MultimodalitySection 1

2. Real-Time Audio Streaming: WebSockets, WebRTC & PCM AudioSection 2

3. Voice Activity Detection & Barge-In Interruption HandlingSection 3

4. Vision Prompting: Spatial Reasoning, OCR & Document UnderstandingSection 4

5. Video Chunking: Keyframe Extraction vs Temporal WindowsSection 5

6. Edge Deployment Considerations for Mobile and Embedded DevicesSection 6

Publication Specifications

AI Voice & Multimodal Workflows

About this Book

What You Will Learn & Build

Table of Contents