Automation Agent Engineer (SDET + RAG / Prompt Engineering)

Join or sign in to find your next job

Join to apply for the Automation Agent Engineer (SDET + RAG / Prompt Engineering) role at Perform

3 days ago Be among the first 25 applicants

We're looking for a forward-thinking Automation Agent Engineer —part seasoned SDET, part prompt engineer—who’s excited to bridge the gap between classic QA automation and AI-assisted workflows. In this hybrid role, you’ll help develop and refine a mini-RAG system that transforms manual test cases into intelligent, LLM-generated test skeletons.

You'll shape how context is retrieved, how prompts are designed, and how generated test code aligns with standards for our Java-based automation stack (RestAssured, Selenium, Cucumber, Screenplay). This is a hands-on, highly collaborative role where your decisions will directly affect the quality, consistency, and scalability of our AI-enabled testing pipeline.

What You’ll Do

• Design and refine prompt templates and few-shot examples to guide the LLM toward generating high-quality test code.
• Collaborate on RAG logic , including chunking strategies, metadata filters, and reranker tuning for optimal context retrieval.
• Help convert manual test cases into structured test skeletons , normalizing them to project standards.
• Build evaluation loops to validate generated code—ensuring compliance with naming, format, assertions, lint rules, and compile / run requirements.
• Review and land autoscripted code with proper guardrails , documentation, and handoff to the SDET team.
• Optimize token usage and latency while maintaining test fidelity in collaboration with the AI and QA teams.

What You Bring

It is an asset if you have :

Seniority level

Employment type

Job function

Referrals increase your chances of interviewing at Perform by 2x

Get notified about new Agent jobs in Santiago, Santiago Metropolitan Region, Chile .

Santiago, Santiago Metropolitan Region, Chile $800.00-$1,000.00 1 month ago

#J-18808-Ljbffr