NIM Solution Architect

NVIDIA·Shanghai, Shanghai, China | Beijing, Beijing, China·posted 15d ago · last seen 50m ago

Track this application

Get Started Free

Match score against your CV

Get Started Free

Tailor your resume to this job

Get Started Free

About interviewing at NVIDIA

Recruiter screen, a technical screen mixing resume deep-dive with live coding, a hiring-manager conversation, then a panel of three to five 45–60 minute rounds: coding, systems design under hardware constraints, a domain deep-dive, and behavioral. Highly team-specific — you interview directly with the team — with C++ depth expected almost universally and decisions sometimes taking five-plus weeks after the panel.

Read the full NVIDIA interview process →

Description

NVIDIA is leading company of AI computing. At NVIDIA, our employees are passionate about AI, HPC , VISUAL, GAMING. SA team is more focusing to bring NVIDIA new technology into difference industries. This role focuses on NVIDIA Inference Microservices (NIM), inference / RL rolloutperformance, and AI workflow enablement for LLM, VLM, and other generative AI workloads. It is a highly hands-on position at the intersection of model optimization, inference infrastructure, and customer solution delivery. 


What you’ll be doing:

  • Drive the implementation, deployment, and optimization of NVIDIA Inference Microservices (NIM) solutions for enterprise and industry AI workloads.
  • Package and serve open-source, NVIDIA, and customer-proprietary models through NIM with standardized, containerized APIs for on-premises, cloud, and hybrid environments.
  • Optimize high-volume inference and rollout workloads for LLMs and VLMs.
  • Evaluate and tune the NIM models.
  • Deliver technical projects, demos and client support tasks as directed by the Solution Architecture Leadership.
  • Provide technical support and guidance to customers, facilitating the adoption and implementation of NVIDIA technologies and products.
  • Collaborate with cross-functional teams to enhance and expand our AI solutions portfolio.

What we need to see:

  • Master’s degree or higher in Computer Science, Machine Learning, Electrical Engineering, Mathematics, or a related technical field, or equivalent experience.
  • 2+ years of hands-on experience in machine learning engineering, applied research, LLM/VLM inference, or RL rollout.
  • Production-quality Python and PyTorch skills, including distributed GPU training, solution, profiling, debugging, memory optimization.
  • Working knowledge of transformer architectures, performance optimization, rollout sampling strategies, structured generation, and model-quality evaluation.
  • Strong written and verbal communication skills, with the ability to collaborate effectively across research, engineering, infrastructure, product, and customer-facing teams.

Ways to stand out from the crowd:

  • Publications, open-source contributions, or significant technical projects, LLM/VLM, agent systems.
  • Experience applying programmatic verification, simulators, compilers, execution sandboxes, APIs, or external tools as reward sources for model training. agent system.
  • Familiar with oss RL framework such as SLIME, Nemo-RL.
  • Familiarity with enterprise AI deployment, customer adaptation, or adapting foundation models to specialized vertical domains.

More engineering roles at NVIDIA