NVIDIA is a pioneering company that revolutionized the computing world with its GPU technology, driving the growth of the PC gaming market and redefining modern computer graphics. With the recent advancement of GPU deep learning has ushered AI into a new era of computing, positioning GPUs as the driving force behind intelligent applications in productivity, gaming, and creative fields, solidifying NVIDIA's position as the leading "AI computing company."
There is a growing emphasis on processing AI computations at the edge, closer to the source of data. This approach reduces latency, enhances real-time processing, and addresses privacy concerns by minimizing the need for sending data to centralized servers. As technology continues to advance, we can expect client-side AI (local execution) to play a pivotal role in shaping the digital landscape. The Windows AI Automation team is seeking a senior software engineer passionate about building and maintaining robust infrastructure for deploying high-quality AI applications and models. You will collaborate with a team of highly qualified engineers dedicated to creating top-tier infrastructure for Windows AI automation. If you have a real passion for setting up automation systems in the Windows AI ecosystem to achieve excellence, this could be an excellent opportunity for us to work together!
What you'll be doing:
Develop, deploy, and sustain reliable infrastructure to efficiently run various AI workloads through different inference backends like WinML, Direct ML, TRT-RTX, and others.
Scope out the requirements for deploying various AI applications, benchmarks and models in automation, and develop solutions to measure accuracy, functionality and performance.
Develop Infrastructure to download AI models from various sources and efficiently handle a local repository, create an automated synchronization mechanism to keep repository up to date.
Analyze large datasets to derive insights and design visualizations, implement data processing engines to transform raw data into a more usable format for developers to review.
Collaborate with internal WinAI developers to identify and implement features in automation that help them quickly debug/isolate issues.
Understand existing infrastructure and debug issues in current frameworks. Identify performance bottlenecks and devise solutions to enhance efficiency.
Build, implement, and maintain robust continuous integration and continuous delivery workflows for automated build and deployment.
What we need to see:
B.Tech or higher degree in Computer Science, Information Technology, Software engineering, or related field.
5+ years of experience.
Strong analytical and problem-solving abilities, with the capacity to multitask optimally in a multifaceted environment.
Confirmed experience as a developer includes at least 4 years of proficiency in application development using C#, Java, or another programming language. You should also have exposure to at least one scripting language such as Python, Perl, or PHP.
Familiarity with databases and SQL and experience working with source control systems, CI/CD pipelines (Git, Perforce, Jenkins) , .
Outstanding written and oral communication skills, enabling effective collaboration with management and engineering teams.
Ways to stand out from the crowd:
Experience of building robust backend automation systems with practical involvement in working the databases.
Familiarized in setting up visualization interfaces using Grafana, Kibana, or similar platforms.
Confirmed background working with Git, jenkins CICD pipelines.
Hands on experience with inference frameworks Llama.cpp, Ollama, Pyotrch etc.
We are an equal-opportunity employer and value diversity at our company. With competitive salaries and a generous benefits package, we are widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us and, due to unprecedented growth, our exclusive engineering teams are rapidly growing. If you're a creative and autonomous engineer with a real passion for technology, we want to hear from you.
