Note: The job is a remote job and is open to candidates in USA. AppOmni is a company that prevents SaaS data breaches by delivering end-to-end SaaS security. The Lead Software Engineer plays a key role in the company’s AI strategy, collaborating closely with Product, Engineering, and Field teams to implement different AI applications and focusing on the development, implementation, testing, and monitoring of GenAI infrastructure.
Responsibilities
- Design, build, and maintain backend services and APIs to support our GenAI product using Python and FastAPI, ensuring they are scalable, reliable, and secure
- Develop and operate LLM-powered applications and agentic workflows using LangChain, LangGraph, and LangSmith, including tracing, evaluation, and observability
- Develop and manage infrastructure using Terraform, applying infrastructure-as-code (IaC) practices across backend and ML resources
- Build and maintain monitoring and alerting systems to surface service and API health issues early, ensuring reliability and performance
- Handle large datasets to ensure data is processed, ready for model context, and collaborate in the platform data pipeline
- Evaluate and select appropriate tools and technologies and define the overall technical strategy
- Assess and interpret data to gain insights, especially for testing and monitoring purposes
- Build and maintain CI/CD pipelines, including infrastructure-as-code (IaC), and automate deployment and monitoring across backend services and ML workflows
- Continuously improve and automate monitoring and alerts processes
- Optimize infrastructure and services for performance, scalability, reliability, and cost efficiency, and troubleshoot issues across deployment and runtime
- Troubleshoot and resolve issues related to pipeline deployment and performance
- Contribute to the development of internal engineering standards and documentation
- Advocate for engineering best practices and promote a culture of continuous improvement also mentoring and guiding others in the company in this topic
- Understand the requirements of stakeholders and translate them into technical solutions
- Develop robust model monitoring and alerting systems to ensure model performance and identify issues
- Support our mission and vision and embody and demonstrate AppOmni core values of Trust, Transparency, Quality, Customer Focus, and Delivery. Comply with all company policies and governing laws and regulations
Skills
- At least 8 years of experience in backend centric software development
- Degree in a relevant field such as Engineering, Computer Science, Data Science, Machine Learning, or a related quantitative discipline
- Strong programming skills: Proficiency in coding Python for production implementation, including coding best practices, testing, performance considerations, with a good understanding of libraries like Pandas, Polars, Langchain, Langsmith
- Experience implementing infrastructure for Machine Learning and Generative AI applications
- Experience in security engineering or another complex domain
- Excellent communication and collaboration skills to work effectively with Product, Engineering, Field, and other cross-functional teams
- Experience in Cloud computing: Experience with cloud platforms like AWS, Azure, or GCP for model training and deployment
- Experience with ML services in Cloud Platforms like VertexAI in GCP
- Proficient in containerization technologies (Docker, Kubernetes)
- Experience with model monitoring and logging tools (e.g., Prometheus, Grafana, ELK stack)
- Usage of Software engineering practices: Version control, code review, and software design principles
- Expertise in CI/CD tools (Github, Jenkins, GitLab CI, CircleCI)
- Experience with infrastructure-as-code tools (Terraform, CloudFormation)
- Problem-solving and critical thinking with the ability to analyze complex problems, identify potential issues, and develop innovative solutions
- Strong self-management skills and able to prioritize tasks and manage time effectively
- Proactive approach to work and ability to take initiative
- Experience with Databricks
Benefits
- Stock Options: Our vision is to not just grow as a company but to grow together. By offering stock options, we are inviting you to be an integral part of our journey forward.
- Generous paid time off
- Paid company holidays
- Paid floating holidays
- Paid parental leave
- Paid sick time and paid family leave for applicable states
- Health insurance - medical, dental, and vision with HSA option
- LifeWorks Employee Assistance Program
- Company-provided life insurance
- AD&D
- STD/LTD and additional supplemental life insurance options
- 401(k) and Roth retirement saving accounts
- A monthly wellness benefit reimbursement
Company Overview
Company H1B Sponsorship