Note: The job is a remote job and is open to candidates in USA. Otter.ai is a leading tool for meeting transcription and collaboration, aiming to make conversations more valuable. They are seeking an experienced Software Engineer to build infrastructure for advanced speech recognition and real-time speaker identification systems, working closely with machine learning researchers and product managers.
Responsibilities
• Design, build, and operate backend services that power real-time, multi-language, ASR and speaker identification features
• Architect scalable, fault-tolerant infrastructure across databases, queues, and pub/sub systems to support low-latency ML workflows
• Partner with ML teams to productionize models (training pipelines, model deployment, versioning, and monitoring) for real-time and batch inference
• Improve system observability, reliability, and performance for large-scale speech data ingestion and streaming
• Contribute to the evolution of our platform architecture, including microservices, orchestration (Kubernetes), and API integrations
• Collaborate with cross-functional teams to streamline developer experience, CI/CD pipelines, and automated testing for ML-backed services
Skills
• 2+ years of experience designing and building scalable backend systems and distributed infrastructure
• Fluent in Python (bonus for C++) and familiar with building high-performance services
• Understands data structures, algorithms, distributed systems, and operating systems at a deep level
• Has worked with databases (SQL & NoSQL), queuing systems, and pub/sub solutions, and knows what's happening 'under the hood'
• Has experience with ML infrastructure / MLOps (e.g., model deployment, feature stores, pipelines) or is eager to learn quickly
• Enjoys collaborating with ML engineers and product teams to translate research into production-ready systems
• Thrives in a fast-paced environment where innovation and reliability go hand in hand
• Experience with real-time streaming frameworks (Kafka, Pulsar, Flink)
• Hands-on experience with container orchestration (Kubernetes, ECS)
• Familiarity with SDK integrations or developer platform design
• Experience building or optimizing speech/voice AI pipelines
Company Overview
• Otter.ai improves business team productivity by providing an app to capture, share, and recall all meeting notes. It was founded in 2016, and is headquartered in Mountain View, California, USA, with a workforce of 51-200 employees. Its website is https://otter.ai.
Company H1B Sponsorship
• Otter.ai has a track record of offering H1B sponsorships, with 30 in 2025, 17 in 2024, 19 in 2023, 8 in 2022, 4 in 2021. Please note that this does not guarantee sponsorship for this specific role.
Apply Now
Apply Now