Guidepoint
Senior AI Engineer
Toronto, Ontario, Canada · Work style not stated · Full Time
Apply on the employer’s site ↗See how well you match this job
You apply directly with the employer. ROLIVA does not submit applications from this page and is not the employer.
About the role
Description from the employer’s posting. Check the employer’s page for the current version.
- EmployerGuidepoint
- LocationToronto, Ontario, Canada
- Work styleWork style not stated
- Employment typeFull Time
- Employer posted
Overview:
Guidepoint is investing in applied AI across its research platform. We're building conversational AI systems that interact with our global expert network at scale — combining real-time voice, LLM-driven orchestration, and retrieval over large proprietary datasets.
You'll be an early engineer on a new initiative: taking working prototypes to production and shaping the architecture as the product scope grows. This is a hands-on role with broad ownership, close to product and leadership.
This role is hybrid in our Toronto Office
What You'll Do:
- Real-time conversational AI: voice- and chat-based agents with low-latency requirements, built on modern telephony and real-time media infrastructure.
- LLM orchestration: agentic systems that pursue goals over multi-turn conversations, with hard behavioral guarantees enforced in code — not just prompts.
- Multi-channel session management: stateful user interactions that move seamlessly across channels.
- Retrieval and grounding: connecting LLM systems to large internal knowledge assets, with structured data flowing back.
- Evaluation infrastructure: measuring conversational quality against human baselines and gating rollouts on metrics, not vibes.
- Own services end-to-end: design, implementation, deployment (Kubernetes/Azure), and operations, including latency-sensitive real-time workloads.
- Design and tune LLM pipelines: context engineering, structured outputs, model selection, cost/latency tradeoffs across vendors.
- Build the eval loop and treat quality as a number: define metrics, run experiments, gate releases on them.
- Integrate third-party AI and voice vendors behind clean abstractions so providers stay swappable.
- Partner with product and compliance stakeholders to encode domain rules into the system.
- Set engineering patterns for a growing team: code review, observability, incident habits.
Show full description
What You Have:
- 6+ years of software engineering, with 2+ years building LLM-powered products in production (not notebooks): orchestration, RAG/grounding, structured outputs, eval-driven iteration.
- Strong TypeScript or Python; comfortable working across both.
- Real-time or streaming systems experience: WebSockets, WebRTC, audio pipelines, or comparable low-latency work.
- Cloud-native production experience: containers, Kubernetes, CI/CD, observability. Azure a plus.
- Familiarity with agent/LLM frameworks such as LangGraph, LangChain, or CrewAI — hands-on exposure is enough; we care that you know the landscape and when plain code beats a framework.
- Working familiarity with vector databases and embedding-based retrieval.
- Pragmatic product judgment: you scope prototypes, kill weak approaches with data, and ship.
Nice-to-have:
- Voice AI: telephony platforms, conversational agent frameworks, STT/TTS, turn-taking/VAD.
- Knowledge graphs or large-scale search/retrieval systems.
- Regulated or compliance-sensitive domains (healthcare, finance).
- Eval harnesses or LLM-as-judge systems.
What We Offer:
The annual base salary range for this position is 175,000-210,000 CAD. Additionally, this position is eligible for an annual discretionary bonus based on performance.
You will also be eligible for the following benefits:
- Paid time off
- Comprehensive benefits plan
- Company RRSP match
- Development opportunities through the LinkedIn Learning platform
About Guidepoint:
Guidepoint powers end-to-end research workflows for the world’s best research teams.
Backed by a global network of more than 2 million experts and over 1,600 employees, Guidepoint delivers real-time access to expertise, primary research, and actionable knowledge that help organizations make informed decisions. Through consultations, surveys, events, proprietary content, and AI-enabled tools, we support every stage of the decision-making process—from developing hypotheses and gathering insights to validating assumptions and building conviction for critical decisions.
At Guidepoint, our success relies on the diversity of our employees, experts, and clients, which enables us to foster meaningful connections and a broad range of perspectives. We are committed to creating an inclusive and welcoming environment where individuals of all backgrounds, identities, and experiences can contribute and succeed.
#LI-LG1
#LI-HYBRID
This job posting is for an existing vacancy. The salary offered will be based on the successful candidate’s skills, experience, qualifications, and location.
Compensation
$175,000—$210,000 CAD
Check your resume against this job Free, no sign-up. Nothing you paste is stored.
Staying safe while you apply
- Never pay to apply, interview or accept an offer. ROLIVA never asks you for payment to apply to a job.
- Apply only through the official “Apply on the employer’s site” button, on the employer’s own site, and check that a recruiter’s email uses that employer’s own domain rather than a free email address.
- Be cautious of an offer made with no real interview, or pressure to decide quickly or share financial details early.
Does something look wrong with this listing? Use “Report broken link” in the role details, or read ROLIVA’s full job-safety guidance ↗.
Preparing for this role with ROLIVA
- Check the fit.
Compare the requirements with the experience you have confirmed, including gaps.
- Prepare honestly.
Build interview stories and application drafts from your own evidence.
- Keep track.
Save the role and record your own application status and follow-ups.
Machine learning engineer jobs in Toronto
ROLIVA currently lists 12 open roles like this in Toronto.
Employers hiring for this
- Guidepoint3 open roles
- Okta3 open roles
- Vanguard2 open roles
- Altusgroup1 open role
- Autodesk1 open role
Top skills asked for
Listings whose description mentions each term. A mention is not a requirement.
- LLM9 postings
- Python9 postings
- AWS8 postings
- Machine learning8 postings
- Airflow5 postings
- Kubernetes5 postings
- Spark5 postings
- Azure4 postings
At a glance
- Employment typeFull Time
- SenioritySenior
- Employer posted
- Added to ROLIVA
- Last checked
Skills in this posting
Skills ROLIVA found in the employer’s own description above. A mention is not a requirement.
Explore similar roles
Similar jobs
Allstate
Applied Machine Learning Engineer Senior Consultant II (Software Engineering Focus)
United States