Note: The job is a remote job and is open to candidates in USA. White Tree Solutions is seeking a Prompt Engineer to design, test, and refine AI interactions for enterprise use cases. The role translates business requirements into tested AI behavior, develops evaluation criteria, diagnoses failure patterns, and collaborates with technical and governance teams to improve AI solution quality and release readiness.
Responsibilities
- Develop system instructions, prompt templates, examples, and response formats for approved use cases
- Define how AI solutions should use supplied context, retrieve information, handle ambiguity, and escalate unsupported requests
- Build representative test cases and evaluation criteria covering accuracy, relevance, instruction adherence, and appropriate refusals
- Evaluate behavior under ambiguous questions, incomplete context, conflicting instructions, and adversarial inputs
- Diagnose failure patterns and recommend changes to prompts, source content, retrieval, or application design
- Maintain versioned prompt documentation, test results, and release recommendations
- Collaborate with security and engineering teams on safeguards that require controls beyond prompt instructions
Skills
- • Hands-on experience building and evaluating applications using large language models
- • Strong writing skills and the ability to express complex requirements as clear instructions
- • Experience developing repeatable tests and analyzing AI outputs
- • Understanding of grounding, retrieval-augmented generation, context limitations, and common model failure modes
- • Ability to work with technical teams and explain tradeoffs to business stakeholders
- Candidates must be U.S. citizens
- All work, including access to client systems and data, must be performed within the United States throughout the engagement
- • Microsoft Foundry, Copilot Studio, or Microsoft Fabric data agents
- • Python, APIs, and automated evaluation workflows
- • Conversational analytics or enterprise knowledge assistants
- • AI solutions subject to formal governance and release controls
Company Overview