Verantos

Senior SDET

Pune, India · Work style not stated

Apply on the employer’s site ↗See how well you match this job

You apply directly with the employer. ROLIVA does not submit applications from this page and is not the employer.

About the role

Description from the employer’s posting. Check the employer’s page for the current version.

EmployerVerantos
LocationPune, India
Work styleWork style not stated
Employer posted1 month ago

Overview

Verantos (https://verantos.com) is the market leader in high-accuracy real-world evidence (RWE) generation. The Verantos RWE platform integrates heterogeneous real-world data sources and generates evidence with the accuracy necessary for regulatory and reimbursement use. The platform leverages data science and artificial intelligence, along with advanced data sources such as electronic health records (EHR), to generate RWE capable of supporting complex clinical studies. Some of the largest biopharma companies in the world are Verantos customers.

We use a heterogeneous AWS-centric tech stack with data processing, AI, workflows, and analytics. Our teams are cross-functional and collaborative, bringing together engineering, product, design, QA, and clinical domain experts to deliver meaningful, real-world impact.

This position is open only to candidates currently based in Pune.

Show full description

Description

We're looking for a Senior SDET to own end-to-end quality for assigned product features across web apps and backend APIs, with a strong focus on evaluating AI/LLM-powered workflows. You'll build CI-gated automation and evaluation harnesses — covering UI, API, and non-deterministic AI agent behavior — set testing standards for the team, and drive a shift-left quality culture with engineering and product teams.

Responsibilities

Design and maintain Python-based test automation frameworks for UI (Playwright) and REST APIs — reusable, scalable, and maintainable across the team's test suites
Build automated evaluation suites for AI/LLM-powered features — tracking output correctness, hallucination rate, and regression across model/prompt versions — using tools such as Langfuse, Ragas, or equivalent
Collaborate with engineering leads to define and integrate CI/CD quality checks in GitHub Actions — wiring test suites and evaluation runs into the pipeline and agreeing on pre-merge gates that block on failed tests, evaluation-score thresholds, or schema-compatibility issues
Set testing standards and best practices for automation and AI evaluation, and mentor other SDETs on the team
Contribute to acceptance criteria and flag quality risks early, working with cross-timezone engineering and product stakeholders
Execute release verification for assigned features — feature-flag checks, smoke tests, and rollback validation

Qualifications

5+ years as an SDET with end-to-end quality ownership across web apps, backend APIs, and release processes
Strong Python skills for test automation, API testing, and Pytest; hands-on experience with Playwright
Experience evaluating AI/LLM-powered features — familiarity with metrics such as hallucination rate, output correctness, or LLM-as-judge approaches, and hands-on experience with at least one evaluation/tracing tool (e.g., Langfuse, Ragas)
Experience integrating quality checks into CI/CD pipelines in GitHub Actions (or equivalent) — writing and maintaining pre-merge checks, test/quality gates, and pipeline configuration
Track record of setting testing standards or mentoring other engineers/SDETs
Strong communication skills; comfortable working across time zones
Bachelor's in CS, Engineering, or equivalent experience

Nice to Have

SQL proficiency and experience validating ETL/batch transforms in Snowflake, Athena, or equivalent; familiarity with idempotency and failure recovery
Experience testing access control and data security in multi-tenant systems (RBAC, dataset-level permissions); exposure to compliance frameworks such as HIPAA, SOC 2, or HITRUST
Working knowledge of AWS (S3, ECS, CloudWatch) and tracing/logging tools
Experience conducting performance, load, or stress testing (k6, JMeter)
Familiarity with healthcare data infrastructure, the OMOP Common Data Model (CDM), or clinical vocabularies

Why Verantos?

Work at the intersection of cutting-edge tech, complex data, and healthcare research — where your quality engineering directly shapes research-grade evidence.

We Offer

Competitive salary

Comprehensive medical benefits and work-life balance

Collaboration with healthcare technology visionaries

See how well you match this job Apply on the employer’s site ↗

Check your resume against this job Free, no sign-up. Nothing you paste is stored.

Staying safe while you apply

Never pay to apply, interview or accept an offer. ROLIVA never asks you for payment to apply to a job.
Apply only through the official “Apply on the employer’s site” button, on the employer’s own site, and check that a recruiter’s email uses that employer’s own domain rather than a free email address.
Be cautious of an offer made with no real interview, or pressure to decide quickly or share financial details early.

Does something look wrong with this listing? Use “Report broken link” in the role details, or read ROLIVA’s full job-safety guidance ↗.

Preparing for this role with ROLIVA

Check the fit.
Compare the requirements with the experience you have confirmed, including gaps.
Prepare honestly.
Build interview stories and application drafts from your own evidence.
Keep track.
Save the role and record your own application status and follow-ups.

Create a free workspace or log in.