We are looking for a mid to senior level API Platform Engineer.
In this role, youll architect and scale the foundation that powers delightful developer experiences and production-grade AI systems. You'll work at the intersection of high-performance APIs, scalable infrastructure, and cutting-edge machine learningdelivering tools that enable developers and partners to build on top of Menlos intelligent platform.
Responsibilities
- Design and build the Menlo API Platform, focusing on high reliability, performance, and a world-class developer experience
- Develop intuitive APIs and SDKs that make it easy for developers to access and integrate multimodal AI capabilities
- Deploy and optimize AI/ML models into scalable, production environments, working closely with research and applied ML teams
- Manage and evolve a modern, cloud-native infrastructure stack, using Kubernetes, Docker, and infrastructure-as-code (IaC) tools
- Ensure platform reliability, including designing and implementing telemetry, monitoring, alerting, autoscaling, failover, and disaster recovery mechanisms
- Contribute to developer and operations workflows, including CI/CD pipelines, release management, and on-call rotations
- Collaborate across teams to implement secure APIs with fine-grained access control, usage metering, and billing integration
- Continuously improve platform performance, cost-efficiency, and observability as we scale to serve millions of users worldwide
Requirements
- 3+ years of experience building and operating large-scale, production systems with real-world usage and uptime expectations
- Strong experience with containerization and orchestration: Kubernetes, Docker, Helm, and service mesh technologies (e.g., Istio or Linkerd)
- Proficiency with cloud platforms: AWS, GCP, or Azure including experience with IAM, networking, and serverless tooling
- Hands-on coding skills in Python and JavaScript/TypeScript, with familiarity in backend frameworks (e.g., FastAPI, Express)
- Deep knowledge of API architecture and design patterns: WebRTC/Websockets, REST, gRPC, OpenAPI/Swagger, authentication (OAuth2, API keys), and versioning
- Experience with databases: PostgreSQL, Redis, and modern vector databases (e.g., Pinecone, Weaviate, FAISS)
- Familiarity with CI/CD pipelines, GitOps practices, and tools like GitHub Actions, Argo CD, or Jenkins
- Comfortable with monitoring and observability tools such as Prometheus, Grafana, Datadog, or OpenTelemetry
Bonus Experience
- Experience with MLOps tools and AI workflows: model versioning, inference pipelines, model registries, etc.
- Understanding of access control systems: ACLs, RBAC, multi-tenant security and isolation
- Knowledge of billing systems, rate limiting, chargeback models, quota enforcement, and usage metering
- Prior experience working on developer platforms or API products with a strong focus on UX and documentation
Originally posted on