Note: The job is a remote job and is open to candidates in USA. EDZ Systems is seeking an experienced AI Senior Software Engineer to lead the configuration, implementation, and deployment of an on-premise AI Gateway solution within its AWS environment. The role focuses on delivering production-ready, automated AI Gateway infrastructure, comprehensive documentation, testing, and initial production rollout support.
Responsibilities
- Design and implement AI Gateway infrastructure using Infrastructure as Code (IaC)
- Configure and customize according to our organizational requirements (security and standards)
- Deploy solution within our AWS environment
- Conduct comprehensive testing including functional, performance, and integration testing
- Ensure solution meets security, scalability, and reliability requirements
- Create detailed technical documentation for the implemented solution
- Develop onboarding guides and operational runbooks
- Document configuration standards and deployment procedures
- Provide architecture diagrams and system documentation
- Support initial production rollout and deployment
- Provide troubleshooting and issue resolution during launch phase
- Conduct knowledge transfer sessions with internal teams
- Assist with early adoption and usage optimization
Skills
- • AWS Expertise: Strong experience with AWS services and cloud architecture
- • Infrastructure as Code: Proficiency with IaC tools (Terraform, CloudFormation, CDK, or similar)
- • AI Gateway Experience: Hands-on experience with LiteLLM or similar AI Gateway platforms
- • Demonstrated ability to implement and configure cloud-based infrastructure solutions
- • Experience with API management and gateway technologies
- • Strong documentation and technical writing skills
- • Security certifications or specialized security experience (AWS Security, cloud security best practices)
- • Experience with AI/ML model deployment and management
- • Knowledge of rate limiting, token management, and API cost optimization
- • Familiarity with observability and monitoring tools (CloudWatch, Grafana)
- • Experience with CI/CD pipelines and DevOps practices
Company Overview
Company H1B Sponsorship