Note: The job is a remote job and is open to candidates in USA. NTT DATA is a global business and technology services company providing consulting, data and artificial intelligence, industry solutions, and application and infrastructure services. The Senior AI/LLM Engineer will design, develop, and deploy enterprise-grade Generative AI solutions using LLMs, Python, RAG, AI orchestration frameworks, and cloud-native architectures. The role also involves integrating AI into enterprise systems, optimizing model performance, establishing responsible AI practices, and mentoring junior engineers.
Responsibilities
- Design, develop, and deploy enterprise-scale Generative AI applications using modern LLM technologies
- Build production-grade backend services using Python and modern software engineering practices
- Develop scalable AI architectures utilizing OpenAI, Anthropic Claude, Gemini, Llama, or similar foundation models
- Design and implement Retrieval-Augmented Generation (RAG) pipelines using vector databases and semantic search capabilities
- Develop intelligent multi-agent AI systems capable of orchestrating complex business workflows
- Design AI solution architectures that are scalable, secure, maintainable, and aligned with enterprise standards
- Integrate AI capabilities into existing enterprise applications, APIs, and business workflows
- Develop and consume REST APIs, microservices, and event-driven services for AI applications
- Implement AI orchestration frameworks such as LangChain and related agent frameworks
- Develop and optimize prompts for improved accuracy, reasoning, and business outcomes
- Evaluate LLM performance and implement techniques to improve response quality
- Establish AI governance, model evaluation, and responsible AI best practices
- Monitor AI application performance and continuously optimize latency, cost, and quality
- Build cloud-native AI solutions using Azure or AWS AI services
- Implement Azure AI Search and vector search capabilities
- Design secure enterprise AI applications following cloud security and governance standards
- Collaborate with DevOps teams to deploy AI solutions using CI/CD pipelines
- Partner with business stakeholders to understand AI use cases and translate them into scalable technical solutions
- Present architecture decisions, solution approaches, and AI strategies to both technical and non-technical audiences
- Mentor junior engineers and contribute to AI engineering best practices across the organization
Skills
- Bachelor's or Master's degree in Computer Science, Artificial Intelligence, Software Engineering, or a related field
- 6+ years of software engineering or machine learning engineering experience
- Minimum 3+ years of hands-on experience building Artificial Intelligence and Generative AI solutions
- 3 to 5 years of strong hands-on experience developing production applications using Python
- 1 to 3 years of experience building applications using OpenAI (preferred), Anthropic Claude, Gemini, Llama, or similar LLM platforms
- 3+ years of strong experience implementing Retrieval-Augmented Generation (RAG) architectures
- 1 to 3 years of experience integrating vector databases and semantic search solutions
- 1 to 3 years of strong understanding of LangChain and AI orchestration frameworks
- Experience designing multi-agent AI architectures
- Strong knowledge of prompt engineering, model evaluation, AI governance, and Responsible AI principles
- Experience building REST APIs, microservices, and event-driven architectures
- Experience with Azure or AWS cloud platforms
- Strong understanding of scalable enterprise application architecture
- Excellent analytical, problem-solving, and communication skills
- Experience with LangGraph, AutoGen, CrewAI, Semantic Kernel, or similar AI agent frameworks
- Experience with vector databases such as Pinecone, Weaviate, ChromaDB, Qdrant, Milvus, or Azure AI Search
- Experience with containerization technologies such as Docker and Kubernetes
- Knowledge of CI/CD pipelines and MLOps practices
- Experience with AI observability and monitoring platforms
- Familiarity with enterprise security, compliance, and Responsible AI frameworks
- Experience working in Agile/Scrum environments
Benefits
- Medical, dental, and vision insurance
- Flexible spending or health savings account
- AD&D insurance
- Employee assistance
- Participation in a 401k program
- Additional voluntary or legally-required benefits
Company Overview
Company H1B Sponsorship