Senior Math Libraries Engineer - Sparsity in AI
NVIDIA · Remote · Santa Clara, United States · 3mo ago
We are looking for software engineers to contribute to the design and development of libraries and tools to simplify and accelerate computing for unstructured sparsity in DL and HPC. Around the world, leading commercial and academic organizations are revolutionizing AI, data analytics, and scientific and engineering simulations, using data centers powered by GPUs and high-performance linear algebra libraries. Applications of these technologies include LLMs, computer aided engineering, quantum chemistry, autonomous vehicles, computer vision, and countless others. Did you know our team develops the GPU accelerated libraries and SDKs that help make these possible?
In this role, you will work together with other developers on developing solutions that involve generalizations to sparse tensor computations, domain specific language (DSL) specifications of sparse storage formats, and on-demand code generation. Ideal candidates will not only have experience developing accelerated computing software, but also be motivated to advance the state-of-the-art in a variety of accelerated computing domains and DL frameworks like PyTorch. If this sounds exciting, we would love to meet you!
What you will be doing:
Design and develop a C++-based system to simplify and accelerate computing for unstructured sparsity in DL and HPC on NVIDIA GPUs
Enable the system in languages and frameworks that are more commonly used in DL, such as Python and PyTorch
Evaluate and improve the performance of the system on real-life applications
Realize opportunities to improve library quality, performance and maintainability by writing effective and well-tested code for production use
Work closely with product management and other internal and external partners to understand feature and performance requirements and contribute to technical roadmaps
What we need to see:
BS, MS or PhD degree in Computer Science, Applied Math, or related field (or equivalent experience)
6+ years of overall experience in developing, debugging and optimizing high-performance software using C++ and parallel programming; ideally for sparse linear algebra applications and using CUDA, MPI, OpenMP, or equivalent technologies
Experience with domain-specific language design and compiler optimizations, in particular sparse compilers (MLIR or TACO)
Excellent C++, Python, and CUDA programming skills
Strong collaboration, communication, and documentation habits and ideally experience with working in a globally distributed organization
Ways to stand out from the crowd:
Strong understanding of sparse computations, in particular sparsity in AI and HPC
Good understanding of LLMs, Deep Learning methods and frameworks
Experience with low-level GPU performance optimization
Understanding of numerical linear algebra methods like direct and iterative solvers
Experience with adopting and advancing, software development practices such as CI/CD systems and project management tools such as JIRA.
NVIDIA’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined modern computer graphics, and revolutionized parallel computing for science and engineering. More recently, GPU deep learning ignited modern AI — the next era of computing — with the GPU acting as the brain of computers, robots, and self-driving cars that can perceive and understand the world. Today, we are increasingly known as “the AI computing company.” We're looking to grow our company and build our teams with the smartest people in the world! Join us at the forefront of technological advancement. NVIDIA is widely considered to be one of the technology world's most desirable employers. We have some of the most forward-thinking and talented people in the world working for us. If you're creative, autonomous and love a challenge, we want to hear from you!
Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 184,000 USD - 287,500 USD for Level 4, and 224,000 USD - 356,500 USD for Level 5.You will also be eligible for equity and benefits.
This posting is for an existing vacancy.
NVIDIA uses AI tools in its recruiting processes.
NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.