Trendmicro

Staff/Sr. ML Infrastructure / Platform Engineer

Taiwan · Work style not stated · Full time

Apply on the employer’s site ↗See how well you match this job

You apply directly with the employer. ROLIVA does not submit applications from this page and is not the employer.

About the role

Description from the employer’s posting. Check the employer’s page for the current version.

EmployerTrendmicro
LocationTaiwan
Work styleWork style not stated
Employment typeFull time
Employer posted29 Sep 2026

Join Trend ‧ Join New Generation

趨勢科技 - 全球雲端資安領航者 / 全亞洲最大軟體公司 / 企業版圖橫跨五大洲 / 趨勢全球研發基地在台灣
===============================================================

About the Role

We are building a production-grade, GPU-accelerated LLM serving platform that powers multiple AI products at enterprise scale. You will be responsible for designing, building, and operating the infrastructure that serves large language models — from raw Kubernetes cluster management to multi-GPU inference optimization and autoscaling.

Required Qualifications

Model Serving & Inference

Operate multi-model LLM serving infrastructure

Tune autoscaling policies to balance GPU cost and latency SLAs

Kubernetes & GPU Infrastructure

Operate production K8s clusters with NVIDIA GPU nodes

Handle GPU node lifecycle: NVIDIA driver setup

Show full description

Infrastructure as Code

Write and maintain Terraform/Terragrunt modules for AWS/GCP cloud

Package platform components and model deployments as Helm charts

Manage multi-environment configurations

Observability & Performance

Maintain monitoring stack: Prometheus, Grafana,

Build dashboards for GPU utilization, KV cache occupancy, TTFT/ITL latency, and cost per token

Set up alerting for SLA violations and OOM events

Bonus Skills

These are not required, but candidates with these skills will stand out.

LoRA / PEFT fine-tuning workflows

MLflow for experiment tracking, model registry, and automated adapter deployment

Experience building LoRA adapter CI/CD pipelines (training → registry → serving)

Experience with alternative inference frameworks such as SGLang or NVIDIA NIM, including deep Parameter Tuning for Continuous Batching, KV Cache management, and Speculative Decoding.

===============================================================
連結智慧守護世界 --- Connected Intelligence for Securing a Connected World

See how well you match this job Apply on the employer’s site ↗

Check your resume against this job Free, no sign-up. Nothing you paste is stored.

Staying safe while you apply

Never pay to apply, interview or accept an offer. ROLIVA never asks you for payment to apply to a job.
Apply only through the official “Apply on the employer’s site” button, on the employer’s own site, and check that a recruiter’s email uses that employer’s own domain rather than a free email address.
Be cautious of an offer made with no real interview, or pressure to decide quickly or share financial details early.

Does something look wrong with this listing? Use “Report broken link” in the role details, or read ROLIVA’s full job-safety guidance ↗.

Preparing for this role with ROLIVA

Check the fit.
Compare the requirements with the experience you have confirmed, including gaps.
Prepare honestly.
Build interview stories and application drafts from your own evidence.
Keep track.
Save the role and record your own application status and follow-ups.

Create a free workspace or log in.