Building ultra-low-latency voice AI applications on AWS

Impact 8 AWS Machine Learning Blog

Summary

  • Cartesia uses State Space Models (SSMs) to deliver sub-100ms text-to-speech and speech-to-text at global scale on AWS.
  • SSMs overcome traditional transformer limitations by providing constant memory footprints and native streaming support for audio processing.
  • Cartesia's Sonic handles text-to-speech generation while Ink provides speech-to-text capabilities with native turn detection.
  • Teams can deploy Sonic via Amazon SageMaker AI as an AWS Marketplace model package or self-manage the container on Amazon EC2 GPU instances.

Why it matters

State Space Models offer an efficient alternative to transformers for streaming audio, enabling ultra-low-latency conversational AI agents that meet human turn-taking expectations on AWS infrastructure.

Who should care

manager 70