Note: The job is a remote job and is open to candidates in USA. IBM is hiring a Forward Deployed Engineer - AI to turn client business challenges into production-ready AI solutions. The role combines software engineering, data science, generative and agentic AI, and advanced analytics to build, deploy, and scale solutions and demonstrate their business impact.
Responsibilities
- Partner with business and technical teams to identify opportunities, define AI use cases, and establish success metrics
- Develop end-to-end GenAI, RAG, and agentic AI applications using tools such as LangGraph, CrewAI, and hyperscaler cloud AI platforms (e.g., AWS, Google, Azure)
- Design and implement LLM-powered agents, tool use and orchestration, prompt and context engineering, and evaluation frameworks using platforms such as LangGraph, CrewAI, Vertex AI, Azure AI Foundry, or Amazon Bedrock. Apply guardrails, observability, and testing to ensure accuracy, safety, and reliability
- Prepare structured and unstructured data and integrate AI solutions with enterprise systems, APIs, and data platforms
- Apply MLOps/LLMOps, testing, monitoring, and responsible AI practices to ensure solutions are reliable, secure, and production-ready
- Present insights, demonstrate outcomes, support client adoption, and turn successful solutions into reusable assets for future engagements
Skills
- 5+ years of experience in AI/ML, data science, or software engineering, delivering production AI solutions
- Strong Python and SQL skills, with hands-on experience building **GenAI and agentic AI applications**, including LLMs, RAG, and multi-step workflows using tools such as LangChain, LangGraph, or CrewAI
- Hands-on experience building GenAI applications with large language models, including RAG, prompt and context engineering, embeddings and vector databases (e.g., Milvus, Elasticsearch, pgvector, Pinecone), and LLM evaluation
- Experience designing and building agentic AI workflows using frameworks such as LangChain/LangGraph, CrewAI, AutoGen, including tool calling and multi-step orchestration
- Experience with machine learning and data processing using tools such as scikit-learn, PyTorch, Pandas, or Spark
- Experience integrating and deploying AI solutions using APIs (REST/FastAPI), cloud AI platforms (AWS Bedrock, Azure AI, or Google Vertex AI), and tools such as Git, Docker, or Kubernetes
- Experience with at least one major cloud AI platform (AWS Bedrock, Azure AI Foundry, or Google Vertex AI)
- Strong client-facing skills, with the ability to translate business challenges into technical solutions and communicate with technical and non-technical audiences
- Demonstrable ability to deploy solutions to production for critical business areas
- Ability to understand business needs and drive technical solutions
- Bachelor's degree in Computer Science, Engineering, Data Science, or a related field
- IBM will not be providing visa sponsorship for this position now or in the future. Therefore, in order to be considered for this position, you must have the ability to work without a need for current or future visa sponsorship
- Master's or PhD in a technical or quantitative field
- Experience with LLM fine-tuning, AI evaluation and governance
- Industry experience in high tech, electronics or manufacturing
- Background in forward deployed engineering, solutions engineering, or client-facing consulting
- Front-end development experience (e.g., React or Streamlit), cloud/AI certifications, or open-source AI contributions
Benefits
- Eligible employees may have access to healthcare benefits including medical & prescription drug coverage, dental, vision, and mental health & well being.
- Eligible employees may have access to financial programs such as 401(k), cash balance pension plan, the IBM Employee Stock Purchase Plan, financial counseling, life insurance, short & long-term disability coverage, and opportunities for performance based salary incentive programs.
- Eligible employees may have access to generous paid time off including 12 holidays, minimum 56 hours sick time, 120 hours vacation, 12 weeks parental bonding leave in accordance with IBM Policy, and other Paid Care Leave programs.
- Eligible employees may have access to paid family leave benefits where required by applicable law.
- Training and educational resources on a personalized, AI-driven learning platform, where IBMers can grow skills and obtain industry-recognized certifications to achieve their career goals.
- Diverse and inclusive employee resource groups, giving & volunteer opportunities, and discounts on retail products, services & experiences.
- This job can be performed from anywhere in the US.
Company Overview