Note: The job is a remote job and is open to candidates in USA. Beacon Hill is a technology staffing company providing IT professionals and services across various industries. The company is seeking a Backend AI Engineer to build and scale production AI-powered backend systems, including generative AI, RAG pipelines, AI agents, vector databases, and cloud-native deployments.
Responsibilities
- Design, develop, and maintain scalable AI-powered backend systems and services
- Build and optimize RAG pipelines and prompt-engineering workflows
- Develop asynchronous backend services and REST APIs using modern Python frameworks
- Design and manage vector database infrastructure to support semantic search and AI applications
- Create document-processing pipelines capable of extracting information from PDFs, images, tables, and other unstructured data sources
- Build AI agent and tool-calling workflows for engineering and business use cases
- Support intelligent knowledge-management solutions and automated content generation initiatives
- Collaborate with cross-functional engineering, systems, and validation teams
- Implement AI governance, monitoring, reliability controls, and cost optimization strategies
- Document solution architecture, APIs, and AI workflows
Skills
- • 2+ years of software engineering, backend engineering, machine learning engineering, or related experience
- • Hands-on experience building AI-powered applications in production environments
- • 2+ years of experience developing RAG pipelines, LLM-based applications, or AI agent solutions
- • Strong Python development experience
- • Experience with Google Gemini, Vertex AI, LangChain, and LangSmith
- • Experience building backend APIs and integrating AI services into enterprise applications
- • Experience processing unstructured data, including PDFs, technical documentation, and image-based content
- • Experience with vector databases and retrieval systems
- • Bachelor's degree in Computer Science, Software Engineering, Information Technology, Engineering, or a related STEM discipline
- Python
- Google Gemini
- Vertex AI
- LangChain
- LangSmith
- Retrieval-Augmented Generation (RAG)
- AI Agents / Tool Calling
- Vector Databases
- FastAPI
- REST APIs
- Docker
- Kubernetes
- Cloud-Native Architecture
- Prompt Engineering
- Unstructured Data Processing
- 2+ years of software engineering, backend engineering, machine learning engineering, or related experience
- Hands-on experience building AI-powered applications in production environments
- 2+ years of experience developing RAG pipelines, LLM-based applications, or AI agent solutions
- Strong Python development experience
- Experience with Google Gemini, Vertex AI, LangChain, and LangSmith
- Experience building backend APIs and integrating AI services into enterprise applications
- Experience processing unstructured data, including PDFs, technical documentation, and image-based content
- Experience with vector databases and retrieval systems
- Bachelor's degree in Computer Science, Software Engineering, Information Technology, Engineering, or a related STEM discipline
- • Experience developing FastAPI or Flask-based services
- • Experience working with AI deployment platforms such as Cloud Run, Kubernetes, or Docker
- • Experience integrating multiple LLM providers including OpenAI, Anthropic Claude, or AWS Bedrock
- • Front-end integration experience using React, Next.js, Streamlit, or Gradio
- • Experience working in regulated industries such as healthcare, life sciences, medical device, or other compliance-heavy environments
- • AI/ML certifications are a plus
- Experience developing FastAPI or Flask-based services
- Experience working with AI deployment platforms such as Cloud Run, Kubernetes, or Docker
- Experience integrating multiple LLM providers including OpenAI, Anthropic Claude, or AWS Bedrock
- Front-end integration experience using React, Next.js, Streamlit, or Gradio
- Experience working in regulated industries such as healthcare, life sciences, medical device, or other compliance-heavy environments
- AI/ML certifications are a plus
Benefits
- Medical benefits for those who meet eligibility.
- Dental benefits for those who meet eligibility.
- Vision benefits for those who meet eligibility.
- Federal and state leave programs as required by applicable agency regulations for those who meet eligibility.
Company Overview