Note: The job is a remote job and is open to candidates in USA. EPAM Systems is a global AI transformation engineering and integrated consulting company. The Lead Azure DevOps Engineer will deploy, integrate, and operate secure, scalable AI/LLM gateway technologies, while managing routing, policy enforcement, observability, resilience, and production operations.
Responsibilities
- Deploy and manage AI/LLM gateway technologies such as LiteLLM, Citadel, or Azure APIM AI Gateway
- Integrate models and providers into gateway solutions to support enterprise-scale operations
- Configure routing, policy enforcement, and token/rate controls across gateway infrastructure
- Establish observability and resilience mechanisms to maintain production stability
- Implement LLM routing and broker logic to optimize model performance and reliability
- Enforce enterprise policies, including PII detection and redaction, to ensure compliance and security
- Take ownership of gateway implementation projects and deliver functional solutions rapidly
- Collaborate with cross-functional teams to align gateway operations with organizational security standards
- Monitor and troubleshoot production systems to ensure continuous availability
Skills
- 5+ years of hands-on engineering experience with AI/LLM gateway technologies, including deployment, integration, and production operations
- Expertise in Azure API Management, Azure DevOps, and Azure AI Content Safety
- Proficiency in LiteLLM and other LLM gateway platforms
- Knowledge of LLM security, PII detection and redaction, and enterprise policy enforcement
- Understanding of LLM routing, broker logic, and token/rate control mechanisms
- Skills in observability, resilience engineering, and production system operations
- Capability to take ownership and deliver functional gateway implementations rapidly
- English proficiency at B2 level or higher
Benefits
- Armenia: Opportunity to work abroad for up to two months per year.
- Armenia: Relocation opportunities within EPAM offices in 55+ countries.
- Armenia: Corporate and social events.
- Armenia: Leadership development, career advising, soft skills and well-being programs.
- Armenia: Certifications, including GCP, Azure and AWS.
- Armenia: Unlimited access to EPAM's internal learning database.
- Armenia: Free English classes with certified teachers.
- Armenia: Participation in the Employee Stock Purchase Plan.
- Armenia: Monetary bonuses for engaging in the referral program.
- Armenia: Comprehensive medical and family care package.
- Armenia: Four trust days per year for personal needs.
- Armenia: Discounts for fitness clubs.
- Armenia: Benefits package covering hotels, restaurants, stores and services.
- Georgia: Opportunity to work abroad for up to two months per year.
- Georgia: Relocation opportunities within EPAM offices in 55+ countries.
- Georgia: Corporate and social events.
- Georgia: Leadership development, career advising, soft skills and well-being programs.
- Georgia: Certifications, including GCP, Azure and AWS.
- Georgia: Unlimited access to EPAM's internal learning database.
- Georgia: Free English classes with certified teachers.
- Georgia: Participation in the Employee Stock Purchase Plan.
- Georgia: Monetary bonuses for engaging in the referral program.
- Georgia: Comprehensive medical and family care package.
- Georgia: Five trust days per year (sick leave without a medical certificate).
- Georgia: Benefits package covering sports activities, a variety of stores and services.
- Kazakhstan: Opportunity to work abroad for up to two months per year.
- Kazakhstan: Relocation opportunities within EPAM offices in 55+ countries.
- Kazakhstan: Corporate and social events.
- Kazakhstan: Leadership development, career advising, soft skills and well-being programs.
- Kazakhstan: Certifications, including GCP, Azure and AWS.
- Kazakhstan: Unlimited access to EPAM's internal learning database.
- Kazakhstan: Free English classes with certified teachers.
- Kazakhstan: Discounts in local language schools, including online courses for the Kazakh language.
- Kazakhstan: Participation in the Employee Stock Purchase Plan.
- Kazakhstan: Monetary bonuses for engaging in the referral program.
- Kazakhstan: Medical and family care package.
- Kazakhstan: Six trust days per year (sick leave without a medical certificate).
- Kazakhstan: Coverage of psychology sessions of your choice.
- Kazakhstan: Benefits package covering sports activities, a variety of stores and services.
- Kazakhstan: Housing support program with preferential mortgage access via an Otbasy Bank partnership.
- Kyrgyzstan: Opportunity to work abroad for up to two months per year.
- Kyrgyzstan: Relocation opportunities within EPAM offices in 55+ countries.
- Kyrgyzstan: Corporate and social events.
- Kyrgyzstan: Leadership development, career advising, soft skills and well-being programs.
- Kyrgyzstan: Certifications, including GCP, Azure and AWS.
- Kyrgyzstan: Unlimited access to EPAM's internal learning database.
- Kyrgyzstan: Free English classes with certified teachers.
- Kyrgyzstan: Monetary bonuses for engaging in the referral program.
- Kyrgyzstan: Medical and family care package.
- Kyrgyzstan: Six trust days per year (sick leave without a medical certificate).
- Kyrgyzstan: Coverage of psychology sessions of your choice.
- Kyrgyzstan: Discounts for fitness clubs and sports programs.
- Kyrgyzstan: Benefits package covering sports activities, a variety of stores and services.
- Uzbekistan: Opportunity to work abroad for up to two months per year.
- Uzbekistan: Relocation opportunities within EPAM offices in 55+ countries.
- Uzbekistan: Corporate and social events.
- Uzbekistan: Leadership development, career advising, soft skills and well-being programs.
- Uzbekistan: Certifications, including GCP, Azure and AWS.
- Uzbekistan: Unlimited access to EPAM's internal learning database.
- Uzbekistan: Free English classes with certified teachers.
- Uzbekistan: Discounts in local language schools, including offline courses for the Uzbek language.
- Uzbekistan: Monetary bonuses for engaging in the referral program.
- Uzbekistan: Medical and family care package.
- Uzbekistan: Four trust days per year (sick leave without a medical certificate).
- Uzbekistan: Discounts for fitness clubs, dance schools and sports programs.
- Uzbekistan: Benefits package covering sports activities, a variety of stores and services.
- Georgia: Remote setup with flexibility to work from any location in Georgia, including home, EPAM offices in Tbilisi and Batumi, or a coworking space in Kutaisi.
- Armenia: Fully remote position with flexibility to work from any location in Armenia, including home or EPAM offices in Yerevan or Gyumri.
- Kazakhstan: Remote setup with flexibility to work from any location in Kazakhstan, including home or EPAM offices in Astana, Almaty or Karaganda.
- Kyrgyzstan: Remote work from home or access to the EPAM office in Bishkek.
- Uzbekistan: Remote work from home or access to the EPAM office in Tashkent.
Company Overview
Company H1B Sponsorship