Note: The job is a remote job and is open to candidates in USA. Aretec, Inc. delivers advanced analytics, machine learning, data analysis, cybersecurity, and business optimization solutions for federal agencies. The Senior AI / Backend Engineer will build intelligent backend services for a greenfield AI solution, including Python services, LLM integrations, retrieval pipelines, agent workflows, APIs, guardrails, and automated evaluations. The role also involves testing, instrumentation, documentation, and collaboration with technical, data, full-stack, and enterprise-search stakeholders.
Responsibilities
- Design and develop Python backend services and APIs for the greenfield AI solution
- Integrate large language models and build retrieval-augmented generation pipelines over approved enterprise data sources
- Implement agent orchestration and reusable prompt-framework components
- Build retrieval, ranking, context-assembly, and citation mechanisms that tie summaries and findings to supporting documents
- Develop guardrails that constrain unsupported assumptions, overly prescriptive outputs, legal determinations, and decisions that belong to human staff
- Create deterministic and probabilistic evaluation automation that measures accuracy, completeness, consistency, grounding, and adherence to guardrails
- Build automated unit, integration, regression, and AI-quality tests
- Instrument services for troubleshooting, performance analysis, and continuous improvement
- Work closely with the technical lead, data engineer, full-stack engineer, and enterprise-search stakeholders throughout design and delivery
- Learn the greenfield AI solution use cases, enterprise-search environment, available data sources, security boundaries, and current AI components
- Align with the technical lead on development standards and priority workflows
- Deliver initial Python/API contributions and prototype or improve a priority retrieval or LLM workflow
- Add foundational tests and quality measurements for early AI capabilities
- Own significant RAG, agent, guardrail, or evaluation components and integrate them with the application
- Use system tests and user feedback to improve grounding, accuracy, completeness, and appropriate scope
- Take end-to-end ownership of core AI/backend capabilities from design through production-ready validation
- Help establish repeatable evaluation, monitoring, and improvement practices for the greenfield AI layer
Skills
- Strong Python software-development skills
- Practical experience integrating LLMs into production or production-oriented applications
- Experience designing RAG systems, retrieval pipelines, embeddings, context construction, or comparable information-retrieval workflows
- Experience with RESTful APIs and backend service design
- Understanding of agent orchestration, prompt design, AI guardrails, and model-output evaluation
- Experience with automated testing and disciplined software-engineering practices
- Strong analytical, debugging, documentation, and communication skills
- Please note that due to the nature of our federal contracts and the secure environments in which we operate, only applicants who are sole U.S. Citizens can be considered for this position. Dual citizens are not eligible
- Experience with source citation, document intelligence, enterprise search, or knowledge-retrieval systems
- Experience with structured human feedback loops and AI evaluation frameworks
- Experience delivering applications in federal, regulated, or security-conscious environments
- Familiarity with identity, access control, observability, and secure API integration
Benefits
- Health, Dental, and Vision Insurance
- 401(k) Plan with Employer Match
- Certification Stipends
- Professional Development Opportunities
- Flexible Work Arrangements, including remote options when permitted by contract
- Paid Time Off and Holidays
Company Overview