AI Engineer, Agent/Platform Tracks

You'll join a fast-paced, innovation-driven environment focused on making a meaningful impact through AI-powered pharmacovigilance automation. With diverse teams and continuous learning opportunities, this role offers pathways to deepen your expertise in large language models, prompt engineering, and healthcare AI while influencing the future of clinical research safety systems.

Key Responsibilities

Implement the specialized pharmacovigilance agents: write system prompts, configure model parameters, build tool-use definitions, and define agent boundaries to ensure precise adverse event processing

Build and iterate prompt chains for each processing step: source document parsing, field extraction, MedDRA coding suggestions, causality assessment logic, narrative drafting, and E2B(R3) output generation

Develop the deterministic rule engine layer: implement ICH E2B field validation checks, MedDRA hierarchy verification, and regulatory logic constraints that operate alongside LLM outputs

Create and maintain evaluation datasets in collaboration with the pharmacovigilance domain team: annotated ground-truth cases, edge case libraries, and regression test suites

Develop and maintain Model Context Protocol (MCP) servers to expose enterprise applications, APIs, databases, and services as standardized tools for AI agents

Implement secure MCP integrations, tool definitions, authentication, and testing to enable reliable agent interaction with internal and external systems

Run accuracy benchmarks, analyze failure modes, and iterate on prompts and agent configurations to improve performance against defined thresholds

Implement the quality control agent's cross-verification logic: configure separate Claude instances, build comparison algorithms, and calibrate confidence scoring

Build human-in-the-loop feedback mechanisms: reviewer interfaces for accept/modify/reject decisions, structured feedback capture, and feedback-to-prompt-improvement pipelines

You'll thrive in this role if you bring:

Strong prompt engineering skills and experience writing and iterating system prompts, few-shot examples, chain-of-thought patterns, and structured output formats

Solid foundation in Python with hands-on experience in LLM orchestration frameworks such as LangChain, LangGraph, or similar tools

Experience building evaluation pipelines for NLP or LLM outputs: precision/recall measurement, confusion matrices, and threshold tuning

Comfort with AWS services including S3, Lambda, and IAM basics, with AWS Bedrock experience being a plus

Excellent written communication skills: ability to document prompt design decisions, evaluation results, and agent behavior specifications for validation purposes

A collaborative mindset and ability to work effectively with cross-functional teams including domain experts and platform engineers

Required Qualifications

3+ years of software engineering experience, with at least 1 year building applications that use LLM APIs (Anthropic, OpenAI, or equivalent)

Proficiency in Python with demonstrated experience in production environments

Experience building and evaluating NLP or LLM-based systems with measurable quality metrics

Strong problem-solving skills and ability to work independently while collaborating with team members

Bachelor's degree in computer science, or a related field, or equivalent professional experience

Preferred Qualifications

Experience with medical or clinical NLP: named entity recognition in clinical text, medical coding, or adverse event extraction

Familiarity with MedDRA, ICD-10, or other medical terminologies

Exposure to document processing: OCR pipelines, PDF parsing, email or fax ingestion

Experience in pharma, biotech, clinical research organization (CRO), or healthcare IT environments

We believe in flexibility, growth, and creating space for people to do their best work. Join us and be part of a team where your contributions help shape the future of clinical research.

If this job doesn't sound like the next step in your career, but perhaps you know of someone who'd be a perfect fit, send them the link to apply!