Agent Infrastructure Engineer — Core Harness (Superagent)

Key Responsibilities

Own the architecture, development, and evolution of Superagent, our core agent harness.

Design and optimize the agent execution loop for latency, reliability, token efficiency, cost, and task completion.

Build and improve core harness systems including context management, memory/state handling, tool routing, function schemas, structured outputs, retries, and error recovery.

Build and maintain agent evaluation infrastructure to measure quality and guide engineering decisions with data.

Integrate and benchmark multiple LLM providers and models, evaluating performance, cost, reliability, and capabilities.

Implement performance optimizations such as caching, batching, parallel tool execution, and prompt/context compression.

Build deep observability and instrumentation across agent runs, including tracing, logging, metrics, and regression detection.

Extend and customize underlying agent frameworks when existing abstractions are insufficient.

Build reliable integrations with evolving AI and tool ecosystems.

Work closely with product engineering teams to expose clean abstractions while keeping harness complexity behind the platform.

Debug and resolve complex issues across non-deterministic, distributed, and model-driven systems.

Required Skills & Qualifications

4+ years of experience in software engineering, backend engineering, or systems infrastructure.

Strong proficiency in Python and/or TypeScript.

Hands-on experience building or operating LLM-based agents in production.

Strong understanding of tool calling, function schemas, context limits, structured outputs, model failures, and unreliable LLM behavior.

Experience with at least one agent framework such as LangGraph, OpenAI Agents SDK, CrewAI, AutoGen, or a custom/homegrown agent harness.

Strong understanding of agent orchestration and multi-step workflows.

Experience building or working with evaluation suites, benchmarks, A/B testing, or other measurement systems for AI products.

Strong understanding of concurrency, caching, profiling, performance optimization, and latency/cost tradeoffs.

Experience working with LLM APIs and production AI infrastructure.

Excellent debugging and problem-solving skills, especially for complex and non-deterministic systems.

Passionate about technology, self-driven, and proactive with a strong builder mindset.

Optional / Nice-to-Have Skills

Contributions to open-source agent frameworks, LLM tooling, or AI infrastructure.

Experience with RAG pipelines, vector databases, or long-term memory systems for AI agents.

Familiarity with MCP (Model Context Protocol) or similar tool-integration standards.

Experience with LLM inference infrastructure, model routing, rate limits, fallbacks, or high-volume model APIs.

Experience with LangChain, LlamaIndex, LangGraph, DSPy, or similar AI infrastructure frameworks.

Experience with Kubernetes, Docker, cloud infrastructure, or distributed systems.

Experience building internal developer platforms or infrastructure used by multiple engineering/product teams.

Strong background in observability, distributed tracing, and production reliability.

Contributions to open-source projects or personal AI infrastructure projects.

Why Join Us?

Own the core agent infrastructure behind our AI products — every improvement you make can multiply across the entire platform.

Work on real production-scale AI systems, not demo agents or simple API wrappers.

Solve challenging problems across LLMs, distributed systems, orchestration, performance, and infrastructure.

Have direct influence over the architecture and technical roadmap of our entire agent stack.

Collaborate with a passionate and talented team building some of the most ambitious GenAI products in the market.

Competitive salary and benefits package.

A culture that encourages ownership, experimentation, learning, and data-driven engineering.