Note: The job is a remote job and is open to candidates in USA. TextYess is an AI-first CRM company that uses autonomous AI Agents to help B2C brands sell, support, and retain customers across conversations. The AI Engineer will build and own production components for an agentic runtime, focusing on context building, retrieval and tool orchestration, ranking, evaluation, multilingual quality, latency, cost, and guardrails.
Responsibilities
- Grounding. The agent sometimes says a product is unavailable when it's in stock. Fixing that is a retrieval problem, a prompt problem, and an eval problem at the same time
- Exact match vs. semantic. Semantic search is good at •"warm jacket for winter"• and bad at a SKU, a size, or a specific variant. We need both, in one ranking
- Multilingual quality. Our customers write in Italian, English, and more. An agent that answers in the wrong language is worse than one that says nothing
- Latency and cost. A customer is waiting on their phone. You'll profile requests, test prompt and model changes, and ship improvements you can point at on a graph
- Evals that catch problems before customers do. Every conversation has a Langfuse trace, and we have a golden-dataset harness. Making it actually predict production quality is open work
- Deciding what's worth saying. Ranking, scoring, and suppressing proactive insights so the agent interrupts a customer only when it has earned it
Skills
- 2+ years shipping software professionally, including at least one LLM feature real users touched — a chatbot, a RAG system, an agent. Not a weekend project
- You know how RAG actually behaves: embeddings, vector search, chunking, reranking, and where each one breaks
- You can read traces. Given a bad answer in production, you can find why: retrieval missed, the prompt was wrong, the model picked the wrong tool. Langfuse, LangSmith, Braintrust, Arize, Humanloop — any of them
- Strong Python and backend fundamentals, and the instinct to measure latency, cost and quality instead of guessing
- Nice to have: search infra (Elastic, Algolia, Qdrant, Weaviate), fine-tuning, graph search, you know how e-commerce operate
Benefits
- Real ownership, from day one.
- You'll work shoulder-to-shoulder with top-notch international talent.
- Roles and responsibilities scale with what you prove you can do, not with tenure.
- A dynamic, close-knit crew that moves fast, laughs a lot, and has each other's backs.
Company Overview