Note: The job is a remote job and is open to candidates in USA. Codefeast is seeking a DevOps Engineer to support LLM training and evaluation workflows. The role involves reviewing DevOps tasks and AI-generated technical responses, creating infrastructure and coding evaluation materials, and providing expert feedback on cloud infrastructure, automation, deployment, and troubleshooting workflows.
Responsibilities
- Contribute to LLM training and evaluation workflows by reviewing DevOps tasks, infrastructure scenarios, and AI-generated technical responses
- Assess model outputs for technical accuracy, reliability, security, scalability, and adherence to DevOps best practices
- Create and review DevOps prompts, infrastructure scenarios, coding tasks, reference solutions, and evaluation criteria
- Provide expert feedback to improve LLM performance in cloud infrastructure, automation, deployment, and troubleshooting workflows
Skills
- 3–8 years of professional experience in DevOps, Cloud Engineering, Site Reliability Engineering (SRE), or related roles
- Strong hands-on experience with AWS, Azure, and/or GCP, Docker, Kubernetes, CI/CD, and Infrastructure as Code
- Strong knowledge of Linux, networking, Git, scripting, monitoring, cloud automation, and troubleshooting
- Experience with or strong interest in LLM training, AI-assisted development, code evaluation, prompt engineering, or AI/DevOps workflows
Company Overview