fulltime·Rubrik
Senior AI Evals Engineer
Bengaluru, IndiaEstimated ₹24 - 70 LPA7 skills
This is our market estimate, based on AmbitionBox Rubrik India Senior Software Engineer benchmark. It is not the employer's disclosed pay.
Skills & Stack
PythonLLM evaluationDeepEvalRAGSeleniumPlaywrightCI/CD
About the Role
Senior AI evals test engineering for LLM agents built on Google ADK and similar agentic frameworks; 70% automation, 30% manual.
About Rubrik
Data security and cyber resilience company.
What You'll Do
- 1Design and build evaluation frameworks for LLM-based agents across correctness, latency, cost, safety and task completion.
- 2Build synthetic test environments, golden datasets and CI-integrated regression and drift detection for AI agents.
What We're Looking For
- 8+ years in software test engineering, with 5+ years in QA automation or developer tooling and 2+ years on production ML/AI systems.
- Hands-on LLM evaluation experience with tools such as DeepEval, LLM-as-a-Judge, Promptfoo, RAGAS or LangSmith.
- Strong Python scripting, pytest and CI/CD experience; familiarity with GCP or another cloud for AI/ML.
Check your fit before you apply
Upload your resume, paste it, or list your skills and experience. You get a match score for this role at Rubrik, what is missing, and what to fix before you apply.
Ready to apply for this role?
Senior AI Evals Engineer at Rubrik — click below to submit your application.
