Qualcomm
Posted 2mo ago

Sr Software Engineer, AI Tools – On-Device Generative AI Model Optimization

Qualcomm
San Diego or Raleigh
$141k-$211k/yrOnsiteFull Time
Responsibilities
  • reauthoring models
  • optimizing inference
  • enabling deployment
Requirements
  • Experience in ML systems or model optimization
  • Strong Python skills
  • PyTorch familiarity
  • Generative AI architecture knowledge, and cross-functional communication
  • BS/MS/PhD in CS/Engineering or related with multi-year relevant experience
Technical tools mentioned
PythonPyTorchHuggingFace transformersQAIRT/QNNONNXRuntimeLiteRT-LLMGitHub CopilotCursorClaude CodeCodeium

Job description


Company:

Qualcomm Technologies, Inc.

Job Area:

Engineering Group, Engineering Group > Machine Learning Engineering

General Summary:

As a leading technology innovator, Qualcomm pushes the boundaries of what's possible to enable next-generation AI experiences and drive agentic transformation, creating a smarter, connected future for all. As a Qualcomm Machine Learning Engineer, you will develop and implement cutting-edge tools and solutions to enable state-of-the-art AI solutions across various technology verticals. 

All Qualcomm employees are expected to actively support diversity on their teams, and in the Company.

This role is open to both San Diego, CA and Raleigh, NC and will be onsite full-time.

Minimum Qualifications:

• Bachelor's degree in Computer Science, Engineering, Information Systems, or related field and 2+ years of Hardware Engineering, Software Engineering, Systems Engineering, or related work experience.
OR
Master's degree in Computer Science, Engineering, Information Systems, or related field and 1+ year of Hardware Engineering, Software Engineering, Systems Engineering, or related work experience.
OR
PhD in Computer Science, Engineering, Information Systems, or related field.

What You'll Do

Model Reauthoring & Architecture Adaptation

  • Reauthor generative AI architectures for efficient execution on Qualcomm AI hardware. This covers LLMs (Llama, Phi, Qwen) and multimodal models (vision-language, speech, diffusion), including custom attention, normalization, positional embedding, and modality-specific components.
  • Translate hardware execution constraints — operator support, memory layout, dispatch behavior — into model-level transformations. These transformations need to preserve accuracy while enabling efficient on-device execution.
  • Build clean extension points so internal teams and external contributors can onboard new architectures without changing core pipeline code.

Inference Optimization for Edge Hardware

  • Integrate inference acceleration techniques into the model preparation pipeline. This includes memory-efficient attention, decode acceleration, and serving-time optimizations.
  • Translate end-customer deployment constraints — target SoC, context length, latency budget, memory envelope — into concrete model preparation strategies.

Custom Model & OEM Enablement

  • Work with research teams to develop reauthoring strategies for custom OEM models and customer-specific use cases. Take research prototypes and turn them into production deployments.

Cross-Functional Collaboration

  • Partner with compiler teams to understand on-target constraints. Decide on the right response: a graph-level optimization or model-level reauthoring.
  • Partner with quantization engineers so architectural decisions compose cleanly with the quantization stack.

Pipeline & Tooling

  • Contribute reauthoring and adaptation stages to a multi-stage model preparation pipeline. Build developer-facing diagnostics that give clear, actionable feedback when models fail to lower or run efficiently.

Minimum Qualifications

  • Bachelor's degree in Computer Science, Engineering, or related field and 4+ years of Software Engineering, ML Engineering, or related experience
  • OR Master's degree in Computer Science, Engineering, or related field and 3+ years of relevant experience
  • OR PhD in Computer Science, Engineering, or related field and 2+ years of relevant experience
  • 2+ years in ML systems, model optimization, or inference engineering. Proficient in Python in large, typed codebases.
  • Strong written and verbal communication. Comfortable operating across compiler, research, and partner-facing teams.

Preferred Qualifications

  • Deep implementation-level knowledge of generative AI architectures across LLMs and multimodal models
  • Demonstrated experience optimizing inference for edge or resource-constrained deployments, with measurable latency or memory wins to point to.
  • Strong PyTorch internals knowledge — module customization, export flows, tracing. Familiarity with the HuggingFace transformers ecosystem.
  • Familiarity with on-device runtimes and SoC-level constraints (memory bandwidth, compute precision, NPU/DSP execution). Exposure to QAIRT/QNN, ONNXRuntime, LiteRT-LLM or similar is a plus.
  • Working understanding of how quantization interacts with model architecture decisions, even if you're not a quantization specialist.
  • Experience using agentic coding tools such as GitHub Copilot, Cursor, Claude Code, Codeium, or similar AI-assisted development tools to improve coding productivity and problem-solving

Level of Responsibility

  • Works independently on open-ended optimization challenges. Provides technical guidance and mentorship to teammates.
  • Decisions have broad impact on model accuracy, on-device performance, and the developer experience of teams using the preparation pipeline.
  • Communicates complex model architecture and inference optimization concepts to a range of audiences: hardware engineers, research scientists, compiler engineers, OEM partners, and external developers.
  • Has meaningful influence on the generative AI optimization roadmap, supported model strategy, and cross-team integration priorities.

Qualcomm is an equal opportunity employer. If you are an individual with a disability and need an accommodation during the application/hiring process, rest assured that Qualcomm is committed to providing an accessible process. You may e-mail [email protected] or call Qualcomm's toll-free number found here. Upon request, Qualcomm will provide reasonable accommodations to support individuals with disabilities to be able participate in the hiring process. Qualcomm is also committed to making our workplace accessible for individuals with disabilities. (Keep in mind that this email address is used to provide reasonable accommodations for individuals with disabilities. We will not respond here to requests for updates on applications or resume inquiries).

To all Staffing and Recruiting Agencies: Our Careers Site is only for individuals seeking a job at Qualcomm. Staffing and recruiting agencies and individuals being represented by an agency are not authorized to use this site or to submit profiles, applications or resumes, and any such submissions will be considered unsolicited. Qualcomm does not accept unsolicited resumes or applications from agencies. Please do not forward resumes to our jobs alias, Qualcomm employees or any other company location. Qualcomm is not responsible for any fees related to unsolicited resumes/applications.

EEO Employer: Qualcomm is an equal opportunity employer; all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or any other protected classification.

Qualcomm expects its employees to abide by all applicable policies and procedures, including but not limited to security and other requirements regarding protection of Company confidential information and other confidential and/or proprietary information, to the extent those requirements are permissible under applicable law.

 

Pay range and Other Compensation & Benefits:

$140,800.00 - $211,200.00

The above pay scale reflects the broad, minimum to maximum, pay scale for this job code for the location for which it has been posted. Even more importantly, please note that salary is only one component of total compensation at Qualcomm.  We also offer a competitive annual discretionary bonus program and opportunity for annual RSU grants (employees on sales-incentive plans are not eligible for our annual bonus).  In addition, our highly competitive benefits package is designed to support your success at work, at home, and at play. Your recruiter will be happy to discuss all that Qualcomm has to offer – and you can review more details about our US benefits at this link.

If you would like more information about this role, please contact Qualcomm Careers.

About Qualcomm

Designs and manufactures semiconductors and wireless telecommunications products.

Similar jobs

Software Engineer roles near San Diego, California
13h
Save
Mark Applied
Hide
Software Engineer, Satellite Operations
San Diego, California, United States
OnsiteFull Time
Apple
AppleNASDAQ: AAPL: Designs and sells consumer electronics, software, and online services.
Build automation and runtime infrastructure for a satellite network, collaborate with hardware, cloud, and operations teams, investigate root causes, and support systems on pager duty.
17h
Save
Mark Applied
Hide
Staff Software Engineer, Core Infrastructure
San Francisco or Ottawa or Charlotte or Phoenix or Toronto or Los Angeles or Denver or Salt Lake City or Atlanta or Raleigh or Chicago or Houston or Portland or New York City or Vancouver or San Diego or Sacramento or Jacksonville or Seattle or Mexico City or Austin or Miami or Boston or Dallas
$145k-$275k/yr RemoteFull Time
Scribd
Scribd: Subscription-based digital library for e-books, audiobooks, and documents.
10+ YOE10+ years building backend, distributed, or data-intensive systems; production Rust and strong Python; storage and database expertise; AWS, infrastructure as code, operational excellence, technical leadership, and mentoring.
Rust, Python, Apache Arrow, Parquet, DataFusion, Amazon S3, PostgreSQL, MySQL, AWS, AWS Lambda, Amazon ECS, Amazon Aurora, Terraform, delta-rs, Claude Code
17h
Save
Mark Applied
Hide
Senior Software Engineer, Embedded, Pixel Graphics
Mountain View or San Diego
$174k-$252k/yr OnsiteFull Time
Google
GoogleNASDAQ: GOOGL: Provides online search, advertising, cloud computing, and consumer electronics.
5+ YOEBachelor’s degree or equivalent experience, 5 years in low-level systems programming, 3 years developing hardware-interface device drivers and embedded systems, and 1 year with GPU architecture.
C++, C, Rust, GPU Programming
20h
Save
Mark Applied
Hide
Specialist, Software Engineering (42285)
San Diego, California, United States
$97k-$180k/yr OnsiteFull Time
L3Harris Technologies
L3Harris TechnologiesNYSE: LHX: Aerospace and defense providing mission-critical technology solutions.
4+ YOEBachelor's degree and 4 years of relevant experience, or graduate degree and 2 years, or 8 years in lieu of a degree. Requires C++ development, embedded systems, testing, debugging, and active TS/SCI clearance.
C++, FreeRTOS, Linux, Python, PIC, STM, TCP/IP, RS422, TCP, UDP, Java, Rust
1d
Save
Mark Applied
Hide
Senior Software Engineer Expeditionary Systems (OpAI)
San Diego or Arlington or Colorado Springs or Charleston or Denver
$155k-$175k/yr OnsiteFull Time
The Marlin Alliance
The Marlin Alliance: Provides digital transformation and automation services to defense agencies.
10+ YOE10+ years in a relevant technical role, active Secret clearance, US citizenship without dual citizenship, bachelor's degree or equivalent, expert Python, intermediate Rust or Go, and tactical data pipeline experience.
Docker, Kubernetes, Python, Rust, Go, CSV, JSON, XML, Parquet, ORC, Apache Kafka, AWS Kinesis, RabbitMQ, ZeroMQ, Zenoh, Tactical Assault Kit (TAK), AirByte, Apache Airflow, dbt, Apache Iceberg, Snowflake, Geographic Information Systems (GIS), ArcGIS, PostGIS, Elasticsearch, Redis, S3, PostgreSQL
1d
Save
Mark Applied
Hide
Staff Software Engineer - Front End
San Diego or California or United States
$189k-$255k/yr OnsiteFull Time
Intuit
IntuitNASDAQ: INTU: Provides financial software for accounting, tax, and personal finance.
7+ YOERequires a BS/MS in computer science or equivalent experience, 7+ years developing web, software, or mobile applications, and expertise in JavaScript, TypeScript, React, HTML, CSS, web services, testing, scalable applications, and AI integration.
JavaScript, TypeScript, React, HTML, CSS, REST, SOAP, Test Driven Development (TDD), AutoML
1d
Save
Mark Applied
Hide
Staff Software Engineer
San Diego or La Jolla or Redwood City
$114k-$228k/yr OnsiteFull Time
Abbott
AbbottNYSE: ABT: Provides medical devices, diagnostics, and science-based nutritional products.
12+ YOEBachelor's degree in a relevant field or high school diploma with 12 years of relevant experience; expert object-oriented programming skills and experience with databases, web services, cloud frameworks, and Agile tools.
Postgres, SQL Server, JPA2, Hibernate, Entity Framework, Azure, Amazon AWS Services/SDKs, JIRA, Confluence, C, C++, Java, JavaScript, Python, SQL, PL/SQL, .NET, Google Web Toolkit, RESTful web services, Relational Databases, ORM technologies, Next Generation Sequencing data analysis tools
1d
Save
Mark Applied
Hide
Software Engineer, Embedded Linux
San Diego, California, United States
$115k-$200k/yr OnsiteFull Time
TrellisWare Technologies
TrellisWare Technologies: Provides resilient wireless communication systems and tactical networking solutions.
4+ YOEBachelor's degree required; 4 years of embedded Linux integration and software development, C++ and Python, 2 years of Yocto Project, kernel development, device drivers, cross-compilation, and lab equipment experience.
Embedded Linux, C++, Python, Yocto Project, Linux, oscilloscope, logic analyzer, PC, printer, telephone