Note: The job is a remote job and is open to candidates in USA. InSite is seeking a Senior Test Automation Engineer and Quality Engineering Lead to establish and scale quality engineering for its AI platform and AI-enabled applications. The role will define automation strategy, build reusable frameworks and test suites, integrate quality gates into CI/CD, validate AI and agent behavior, and guide engineering teams toward shared product-quality ownership.
Responsibilities
- Define an automation-first strategy across UI, APIs, services, integrations, data, and AI workflows
- Build reusable automation frameworks and high-value regression suites, with API/service-level testing as the foundation
- Automate critical web, mobile, and end-to-end journeys, including authentication, authorization, multi-tenant behavior, asynchronous interactions, and failure scenarios
- Integrate automated tests and quality gates into CI/CD pipelines
- Establish test execution monitoring, failure triage, reporting, and flaky-test management
- Automate critical performance, latency, resilience, concurrency, and dependency-failure scenarios
- Establish repeatable evaluation and regression testing for Generative AI and agentic applications
- Validate appropriate tool and data usage, workflow and authorization boundaries, human-approval controls, and handling of missing or conflicting information
- Validate groundedness, factual accuracy, relevance, evidence quality, hallucination risk, instruction adherence, latency, and reliability
- Test retrieval, tool-calling, multi-step agent workflows, and AI application failure scenarios
- Automate data-quality validation covering freshness, integrity, completeness, transformation, traceability, and tenant isolation
- Establish representative synthetic and simulated datasets for deterministic regression and AI evaluation
- Build the initial automation architecture and highest-value test suites
- Lead automation design, code quality, and engineering standards
- Partner with software, platform, data, AI, and DevOps engineers to embed testability early
- Participate in architecture and design reviews and mentor engineers contributing to shared automation frameworks
- Promote the right mix of unit, API, integration, end-to-end, performance, exploratory, and AI evaluation testing while driving distributed quality ownership
Skills
- Senior-level test automation or quality engineering experience, including designing automation frameworks from the ground up
- Strong Python skills for API, service, data, and AI test automation
- Experience with TypeScript/JavaScript and modern web application automation
- Strong web, API/service, integration, and end-to-end automation experience
- Experience testing React-based applications
- Experience with automated testing of iOS and Android applications
- Strong experience testing REST APIs , asynchronous services, authentication, authorization, and multi-tenant systems
- Strong SQL and data-validation skills across relational, operational, time-series, and document-oriented data
- Hands-on experience testing applications and services deployed on AWS
- Experience testing applications built with OpenAI models/APIs or comparable production LLM platforms
- Hands-on experience with Generative AI and agentic systems , including retrieval, grounding, tool-calling, multi-step workflows, behavioral regression, hallucination/evidence validation, and AI observability
- Experience integrating automated testing into Git-based CI/CD workflows
- Experience with Docker/containerized applications and container-based test environments
- Strong debugging and failure-analysis skills using application logs, metrics, traces, APIs, data, and infrastructure
- Candidates should be comfortable contributing production-quality automation code and working directly with software engineers
- TypeScript preferred
- Playwright or comparable browser automation preferred
- Ant Design experience is desirable
- Cross-platform mobile automation is desirable
- AWS application, data, container, and observability services are strongly preferred
- OpenAI experience preferred
- Bitbucket and Bitbucket Pipelines experience preferred
- Container-based test environments preferred
Company Overview
Company H1B Sponsorship