ByteDance
Posted 1mo ago

Senior Machine Learning Engineer, Model Serving Infrastructure (Multiple Positions)

ByteDance
San Jose, California, United States
$265k-$388k/yrOnsiteFull Time
Responsibilities
  • designing infrastructure
  • building tools
  • mentoring engineers
Requirements
  • Master's (plus 2 years) or Bachelor's (plus 5 years) in a quantitative field
  • 2+ years coding in Python or C++
  • Linux development experience
  • ML, system design, and production deployment experience
Technical tools mentioned
PythonC++Linux

Job description

About ByteDance
Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Lemon8, CapCut and Pico as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content.

Why Join Us
Inspiring creativity is at the core of ByteDance's mission. Our innovative products are built to help people authentically express themselves, discover and connect – and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and enrich life - a mission we work towards every day.
As ByteDancers, we strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. By constantly iterating and fostering an "Always Day 1" mindset, we achieve meaningful breakthroughs for ourselves, our Company, and our users. When we create and grow together, the possibilities are limitless.
Join us.

About the Team
Our team plays a crucial role in ensuring the company’s success. We seek people who are willing to learn and put in the effort to solve problems. Our challenges are not your regular day-to-day problems - you’ll be part of a team that’s developing new solutions to new challenges. It’s working fast, at scale, and we’re making a difference. We are looking for talents to join us on this exciting journey!

Responsibilities
Design and implement distributed inference infrastructure for feeds, ads, and search ranking models.
Build monitoring/managing tools to oversee the reliability and scalability of online inference servers.
Triage system inefficiency and bottlenecks improving system performance.
Build tools to analyze bottlenecks and sources of instability and design and implement solutions.
Research and design Machine Learning (ML) models to optimize systems, features, algorithms, and product strategies.
Collaborate with key stakeholders and cross-functional teams to define product strategy and features, and to assist in defining products and driving initiatives from a ML engineering viewpoint.
Mentor junior Machine Learning Engineers and interns.

Qualifications
Must have a Master's degree or foreign equivalent degree in Computer Science, Engineering (any), Information Technology, Machine Learning, Data Science, Data Analytics, Statistics, Mathematics, or a related quantitative field, and 2 years of related work experience; OR a Bachelor's degree or foreign equivalent degree in Computer Science, Engineering (any), Information Technology, Machine Learning, Data Science, Data Analytics, Statistics, Mathematics, or a related quantitative field, and 5 years of post-bachelor's, progressive related work experience.

Of the required experience, must have 2 years of experience in each of the following:
Coding using Python or C++;
Developing code and identifying issues in Linux environment;
Implementing design features and functionality using C or C++;
Translating business requirements into technical solutions, ensuring alignment with organizational goals and objectives; and
Working across all phases of the software development lifecycle, including development, implementation, testing, and deployment.

Travel Requirement: International travel required up to 20%.

Type: Full time, 40 hours/week
Location: San Jose, CA
Salary Range: $264514 - $387600 per year

To Apply, click the apply button below. Contact [email protected] if you have difficulty submitting resume through the website.

ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At ByteDance, our mission is to inspire creativity and enrich life. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.

ByteDance is committed to providing reasonable accommodations in our recruitment processes for candidates with disabilities, pregnancy, sincerely held religious beliefs or other reasons protected by applicable laws. If you need assistance or a reasonable accommodation, please reach out to us at https://tinyurl.com/RA-request

#IND-DNI

About ByteDance

Developing AI-driven content platforms and mobile applications.

Similar jobs

Machine Learning Engineer roles near San Jose, California
22h
Save
Mark Applied
Hide
Founding Engineer - Machine Learning
Mountain View, California, United States
$220k-$300k/yr OnsiteFull Time
Clera
Clera: AI talent agent matching professionals with high-growth startup roles
3+ YOERequires 3–10 years of ML engineering, applied science, or research engineering experience; Python and PyTorch, TensorFlow, or JAX; distributed systems, cloud ML infrastructure, MLOps, and large-scale data experience.
Python, PyTorch, TensorFlow, JAX, AWS, GCP, Azure, Weights & Biases, MLflow
1d
Save
Mark Applied
Hide
Machine Learning Engineer
San Francisco, California, United States
$170k-$300k/yr HybridFull Time
Clay
Clay: Platform for automated lead enrichment and sales workflows.
5+ YOE5+ years in machine learning engineering or ML-heavy software engineering, production ML features, strong coding, LLMs or classical ML, data-intensive systems, and product-oriented problem solving.
LLMs, Snowflake, dbt, Dagster
1d
Save
Mark Applied
Hide
Machine Learning Engineer - Satellite Capacity Optimization & Planning
Carlsbad or San Jose or San Francisco or New York City
$141k-$222k/yr OnsiteFull Time
Viasat
ViasatNASDAQ: VSAT: Provider of global satellite-based connectivity and secure communication solutions.
7+ YOERequires 7+ years in ML or optimization, optimization techniques, production cloud ML systems, ML frameworks, geospatial visualization, containerized development, SQL, RESTful APIs, and up to 10% travel.
AWS, GCP, TensorFlow, PyTorch, SQL, RESTful APIs, Airflow, Athena, BigQuery, ECS, Batch
2d
Save
Mark Applied
Hide
Staff Machine Learning Engineer, Generative AI Modeling and Inference
Los Angeles or Seattle or Palo Alto or New York City or Bellevue
$229k-$343k/yr OnsiteFull Time
Snap
SnapNYSE: SNAP: Provides visual messaging software and augmented reality wearable devices.
8+ YOEBachelor's degree or equivalent experience and 8+ years of post-bachelor's machine learning experience, with expertise in generative modeling, computer vision, deep learning, and ML frameworks.
TensorFlow, PyTorch, JAX, MLX, scikit-learn
2d
Save
Mark Applied
Hide
(USA) Staff, Machine Learning Engineer
Sunnyvale, California, United States
$169k-$338k/yr OnsiteFull Time
Walmart
WalmartNYSE: WMT: Operates a chain of hypermarkets, discount stores, and grocery stores.
4+ YOEBachelor's degree and 4 years, or 6 years of experience, in software engineering, machine learning engineering, AI systems, or a related field. Requires ML, MLOps, cloud, and programming expertise.
TensorFlow, PyTorch, Scikit-learn, Python, SQL, AWS, GCP, Azure, Kubernetes, CI/CD, MLOps, Web Content Accessibility Guidelines (WCAG) 2.2 AA
2d
Save
Mark Applied
Hide
Machine Learning Engineer
Chicago or Washington or Tallahassee or Sarasota or Hartford or Nashville or Costa Mesa or San Jose or Atlanta or Boston or Burlington or Cleveland or Columbus or Dallas or Denver or Fort Lauderdale or Fort Wayne or Grand Rapids or Indianapolis or Knoxville or Lexington or Livingston or Plano or Louisville or Los Angeles or Miami or The Woodlands or New York City or Oakbrook Terrace or Sacramento or San Francisco or South Bend or Springfield or Tampa or Houston or Austin or Charlotte
$62k-$100k/yr OnsiteFull Time
Crowe
Crowe: Global professional services firm providing audit, tax, and consulting.
Expert Python and Git skills; ability to develop, test, debug, and document production AI solutions, navigate ambiguity, communicate technical details, and support ethical and security reviews.
Python, Git, ChatGPT Enterprise, Microsoft Copilot, Azure AI Foundry
2d
Save
Mark Applied
Hide
Lead Machine Learning Engineering, (Hybrid)
Seattle or San Jose
$198k-$250k/yr HybridFull Time
Cisco
CiscoNASDAQ: CSCO: Develops and sells networking hardware and cybersecurity software.
8+ YOESTEM degree and 8+ years relevant experience, or equivalent advanced-degree pathways; 3+ years scaling ML datasets; 5+ years programming and ML framework experience.
Python, C++, Go, PyTorch, TensorFlow, Spark, Ray, Beam, Large Language Models (LLMs)
2d
Save
Mark Applied
Hide
Staff Machine Learning Engineer, Generative AI Modeling and Inference
Los Angeles or Seattle or Palo Alto or New York City or Bellevue
$195k-$343k/yr OnsiteFull Time
Snap
SnapNYSE: SNAP: Develops social media applications and augmented reality technology.
8+ YOEBachelor's degree or equivalent experience and 8+ years of post-bachelor's ML experience, or advanced degree with equivalent experience. Requires computer vision or generative modeling and ML framework experience.
TensorFlow, PyTorch, JAX, MLX, scikit-learn, GPU, CPU, NPU, RSUs