Note: The job is a remote job and is open to candidates in USA. District Cyber LLC is a US-based software development company specializing in enterprise software and AI solutions. They are seeking a Mid-Level or Senior LLM / AI Engineer to build production-ready AI solutions using Python and modern LLM technologies, while collaborating closely with backend engineers.
Responsibilities
- Develop and maintain production RAG services
- Build document ingestion pipelines, including parsing, chunking, metadata extraction, indexing, and updates
- Integrate LLM APIs and implement prompt engineering, structured outputs, and response validation
- Improve retrieval quality using embeddings, metadata filtering, vector search, and retrieval tuning
- Optimize performance, reliability, logging, monitoring, and production readiness
- Collaborate with the backend team on AI architecture and new product development
Skills
- 3+ years of commercial Python backend development experience (FastAPI or similar)
- Experience building production RAG pipelines
- Experience working with LLM APIs
- Strong understanding of vector search, embeddings, metadata filtering, and semantic retrieval
- Experience designing document ingestion pipelines
- Experience with Docker
- Good understanding of backend development best practices
- English B2 or higher
- We prefer candidates located in Ukraine or Europe
- LangChain, LangGraph, LlamaIndex, or similar frameworks
- Hybrid Search (BM25 + Vector Search)
- Experience with reranking techniques
- Experience evaluating retrieval quality (Recall@K, MRR, nDCG)
- Experience with observability, tracing, latency monitoring, and AI performance metrics
- Experience with multi-tenant architectures and document permissions (ACL)
Benefits
- Full-time remote position.
- Long-term collaboration.
- No time tracking.
- Opportunity to work with modern AI technologies and enterprise-scale products.
- Professional and experienced engineering team.
- Direct impact on product development and technical decisions.
Company Overview