Note: The job is a remote job and is open to candidates in USA. DrFirst is a healthcare IT company focused on intelligent medication management and provider solutions. The Ambient Listening Engineer will build and operate technology for capturing, transcribing, and structuring clinical conversations, while improving real-time audio pipelines, speech and language model integrations, reliability, privacy, and security.
Responsibilities
- Design, build, and maintain real-time and near-real-time ambient audio capture and streaming pipelines, from device and microphone input through transcription and downstream processing
- Integrate and fine-tune speech-to-text (ASR), speaker diarization, and noise-suppression models to maximize accuracy in noisy, multi-speaker clinical environments
- Build the services and APIs that turn raw ambient audio into structured, actionable output such as clinical notes, summaries, or discrete data elements for downstream systems
- Partner closely with product, clinical informatics, and design to translate ambiguous workflow problems into working prototypes quickly
- Own reliability, latency, and accuracy metrics for the ambient listening pipeline; instrument, monitor, and continuously improve them in production
- Implement privacy- and security-conscious handling of audio and derived data, in line with HIPAA and other applicable regulatory requirements
- Evaluate and integrate third-party and open-source speech and LLM models where they accelerate the roadmap, balancing build-vs-buy tradeoffs
- Participate in code reviews, design discussions, and the on-call rotation for the services you own
Skills
- 5+ years of professional software engineering experience, with a track record of shipping and operating production systems end to end
- Hands-on experience with real-time or streaming audio and data pipelines (e.g., WebRTC, gRPC streaming, Kafka, or similar)
- Practical experience with speech-to-text, NLP, or applied machine learning models, whether integrating third-party APIs (e.g., Whisper, Deepgram, Azure Speech) or fine-tuning your own
- Strong backend engineering skills in a language such as Python, Go, or Java, and comfort working across the stack when needed
- A demonstrated preference for hands-on building over pure architecture or process; you would rather prototype and learn than spend weeks in design docs
- Experience working in a small, fast-moving team where roles overlap and everyone pitches in outside a narrow job description
- Familiarity with cloud infrastructure (AWS, Azure, or GCP) and containerized deployment (Docker, Kubernetes)
- Clear written and verbal communication, and comfort collaborating directly with clinical or non-technical stakeholders
- 90% Desk work
- 10% Remote travel to client sites, conferences, or internal team meetings
- Experience in healthcare technology, clinical documentation, or ambient/voice AI products specifically
- Familiarity with HIPAA, SOC 2, or other healthcare and security compliance frameworks
- Experience with LLM-based summarization or structured data extraction from unstructured text
- Background in audio signal processing or acoustics
Benefits
- Eligible for a Discretionary Performance-based bonus
- Medical, dental, and vision insurance
- 401K eligible after 3 months of employment, with 50% company match up to first 5% of salary contributed to the plan with a 3-year vesting schedule
- HSA for eligible employees enrolled in the HDHP, with a generous company contribution up to $500 for individual coverage and $1000 for family coverage per year
- 100% company paid short and long-term disability, AD&D, and group life insurance
- Accrued annual paid time off (PTO) of 18 days for the first 3 years of service, increasing thereafter and 7 paid holiday days
- Employee Assistance Program
- Continuing Education funds up to $1500 annually for eligible programs after 1 year of service
- Voluntary benefits including FSA, Hospital indemnity, Accident and Critical Illness insurances
- DrFirst is committed to being a Remote-First company, creating a dynamic and flexible workplace where everyone thrives, no matter where they log in from.
Company Overview
Company H1B Sponsorship