Senior Technical Support Engineer – Slurm
NVIDIA · Remote · Austin, United States · 15d ago
At NVIDIA, we’re tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPU acts as the brains of computers, robots, and self-driving cars that can understand the world. Doing what’s never been done before takes vision, innovation, and the world’s best talent. As an NVIDIAN, you’ll be immersed in a diverse, supportive environment where everyone is inspired to do their best work.
Slurm is a critical workload manager for many of the globe’s most intense and fast paced AI and high-performance computing environments. We are looking for a Technical Support Engineer dedicated to supporting Slurm for NVIDIA’s customers. You will join a dedicated team of Slurm subject-matter guides, owning sophisticated support cases and helping customers run reliable, efficient, and highly scalabable. This role requires extensive production experience with Slurm. It demands skill in diagnosing issues in the scheduler and Linux, networking, storage, authentication, database, and GPU environments. frastructure.
What you’ll be doing:
Own Slurm support cases from initial investigation through resolution for customers running production AI and HPC clusters.
Diagnose complex problems involving slurmctld, slurmd, slurmdbd, job scheduling, node management, resource allocation, accounting, authentication, and high availability.
Solve Slurm configuration and policy features, including partitions, reservations, priorities, fair-share, quality of service, backfill, preemption, GRES/TRES, cgroups, and job constraints.
Investigate performance, reliability, and scalability issues using logs, diagnostic data, configuration analysis, reproductions, and source-level debugging when required.
Isolate problems across Slurm and its surrounding dependencies, including Linux, MUNGE, databases, networking, parallel storage, containers, GPUs, and cluster-management systems.
Advise customers on Slurm configuration, upgrades, operational practices, managing system resources, and safe recovery from production incidents.
Collaborate with engineering teams by producing clear technical descriptions, reproducible test cases, and well-supported defect reports.
Develop guides, knowledge-base articles, diagnostic tools, and internal training that strengthen Slurm expertise across the support organization.
What we need to see:
BS degree in Computer Science, Engineering, or a related field, or equivalent experience.
5+ years of hands-on experience administering and supporting Slurm in production HPC or AI environments including business-critical outage incidents.
Expert-level understanding of Slurm architecture, daemons, configuration, scheduling behavior, accounting, resource management, and failure modes.
Capacity to identify sophisticated Slurm incidents independently and guide them to a technically sound resolution.
In-depth Linux system-administration and solve experience, including systemd, cgroups, authentication, networking, and database-backed services.
Experience operating Slurm across multi-user clusters with complex scheduling policies and heterogeneous compute resources.
Strong analytical and research skills, showing proficiency in distinguishing Slurm defects from configuration, integration, infrastructure, and workload problems.
Excellent written and verbal communication skills, including the ability to turn detailed technical findings into clear explanations and actionable recommendations.
Ways to stand out from the crowd:
Experience supporting large-scale Slurm environments containing thousands of nodes or GPUs.
Experience diagnosing scheduler performance, job-throughput, controller-load, and database-scaling issues.
Familiarity with Slurm source code, plugins, SPANK, Lua job-submit plugins, or upstream issue investigation.
Experience with containers and HPC integration technologies such as Pyxis, Enroot, Apptainer, or Singularity.
Previous experience integrating Slurm with NVIDIA Base Command Manager, Bright Cluster Manager, or another cluster-management platform.
Widely considered to be one of the technology world’s most desirable employers, NVIDIA offers highly competitive salaries and a comprehensive benefits package. As you plan your future, see what we can offer to you and your family www.nvidiabenefits.com/
You will also be eligible for equity and benefits.
This posting is for an existing vacancy.
NVIDIA uses AI tools in its recruiting processes.
NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.