Senior Staff Computer Vision QA Automation Engineer

Job Description

We are looking for a driven Senior AI/CV QA Automation Engineer to take ownership of our automated evaluation and testing framework for our core Video Analytics Engine. In this role, you will design automated evaluation infrastructure, benchmark Computer Vision model performance, and optimize end-to-end testing execution time down to just a few minutes per cycle. You will collaborate closely with R&D, Platform, and System Architecture teams to ensure high stability and continuous release quality. ​

Key Responsibilities

• Infrastructure & Optimization: Build, maintain, and optimize automated evaluation pipelines for AI/CV models and core video analytics libraries to achieve rapid, end-to-end test execution times.
• Automation & CI/CD Integration: Develop Python automation test suites and integrate evaluation workflows directly into CI/CD pipelines for automated testing on Pull Requests (PRs).
• Metrics & Analytics: Measure and report model accuracy metrics (mAP, Precision, Recall, IoU) and system performance metrics (FPS, Latency, CPU/GPU/Memory utilization).
• Dataset Management: Manage, curate, and maintain golden datasets and annotation standards for regression, performance, and stress testing.
• Cross-functional Collaboration: Work with Core C++ and Architecture teams to identify pipeline bottlenecks, isolate root causes, and drive continuous release pipeline improvements.

#LI-MM8

#LI-Onsite

Basic Requirements

• Bachelor/Master Degree in Software Engineering, Computer Science, Machine Learning or any relevant Field
• 3+ years of experience in QA Automation, MLOps, Software Engineer in Test (SET), or AI/CV Evaluation.
• Strong proficiency in Python for test framework development and data processing.
• Hands-on experience with Docker containerization and CI/CD tools (Jenkins, GitLab CI, GitHub Actions).
• Solid understanding of Machine Learning and Computer Vision evaluation metrics.
• Proficient in Linux environments and Bash/Shell scripting.
• Strong problem-solving skills with a focus on performance and execution speed.

Nice to Have

• Ability to read and understand basic C/C++ code.
• Familiarity with video streaming concepts and processing frameworks (e.g., GStreamer).
• Prior experience with Edge AI, Smart Cameras, or Embedded Vision systems.

Travel Requirements

None

Relocation Provided

None

Position Type

Experienced

Referral Payment Plan

Yes

EEO Statement

Motorola Solutions is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion or belief, sex, sexual orientation, gender identity, national origin, disability, veteran status or any other legally-protected characteristic.

We are proud of our people-first and community-focused culture, empowering every Motorolan to be their most authentic self and to do their best work to deliver on the promise of a safer world. If you’d like to join our team but feel that you don’t quite meet all of the preferred skills, we’d still love to hear why you think you’d be a great addition to our team.