HiringCafe
Join our community

48 software engineer gpu jobs at 36 companies in New York City, NY

1mo
Save
Mark Applied
Hide
Software Engineer, Compute (GPU)
San Francisco or New York or Austin or Seattle
$175k-$300k/yr OnsiteFull Time
Fluidstack
Fluidstack: Provides high-performance cloud GPU infrastructure for AI development.
Experience building automation and observability for large GPU fleets; familiarity with firmware/BMC/Redfish/IPMI, Kubernetes, metrics and alerting, and production automation; comfortable with incident response and on-call.
Kubernetes, Redfish, BMC, IPMI, Temporal, Cadence, Prometheus, Grafana, Go, Python, LLM APIs, Claude Code, Cursor
Job PostingView all
3mo
Save
Mark Applied
Hide
Infrastructure Engineer (GPU & Compute)
New York or San Francisco or Seattle
$180k-$200k/yr RemoteFull Time
Lightning AI
Lightning AI: Unified platform to build, train, and deploy AI models.
5+ YOE5+ years in infrastructure or systems engineering; strong Linux in production; GPU hardware and software experience; bare-metal provisioning; Python automation; debugging across hardware/OS/GPU.
NVIDIA DCGM, PXE, IPMI, Redfish, iDRAC, LiveCD, InfiniBand, NVLink, Linux, Python
Job PostingView all
1mo
Save
Mark Applied
Hide
Lead Software Developer – GPU-accelerated Free Energy Simulation and Machine Learning Methods
Piscataway, New Jersey, United States
$94k/yr HybridFull Time
Rutgers University
Rutgers University: Providing higher education degrees and conducting academic research.
PhD in biology or chemistry with postdoctoral experience using Amber; proficiency in Python, C++, CUDA/GPU programming, molecular simulation (alchemical free energy/quantum/ML), and high-performance computing; strong English communication.
Python, C++, CUDA, Amber, GPU
Job PostingView all
2w
Save
Mark Applied
Hide
Software Engineer - Control Systems
Princeton, New Jersey, United States
$150k-$235k/yr OnsiteFull Time
Logiqal
Logiqal: Developing modular quantum computing systems using neutral atom technology.
Hands-on instrumentation and software fundamentals; hardware-in-the-loop testing, data pipelines, distributed monitoring; experience integrating high-speed cameras, RF signal generators, GPUs, and Linux kernel customizations.
high-speed cameras, RF signal generators, GPUs, Linux kernel
Job PostingView all
1mo
Save
Mark Applied
Hide
Software Engineer, AI Labs
Edinburgh or New York City or Atlanta or San Francisco or Seattle
HybridFull Time
BlackRock
BlackRockNYSE: BLK: Provides investment management and financial technology services globally.
3+ YOE3+ years professional software engineering experience; strong Python and SQL skills; experience building, testing, deploying, and operating cloud-native applications, services, APIs, or data pipelines; strong engineering fundamentals and communication.
Python, SQL, Spark, Airflow, Dagster, Flyte, GPUs, TPUs, AWS Inferentia, CI/CD, AI coding assistants
Job PostingView all
2mo
Save
Mark Applied
Hide
Staff Software Engineer - AI Research Infrastructure
San Francisco or New York City
$199k-$270k/yr HybridFull Time
Databricks
Databricks: A unified platform for data analytics and artificial intelligence.
5+ YOEBS/MS or PhD in computer science; 5+ years of software engineering experience in distributed systems or infrastructure; strong experience with GPUs, clusters, and cloud platforms; proficient in systems languages and large-scale job orchestration.
C++, Rust, Go, Java, Scala, Kubernetes, Slurm, Ray, GPU, Cloud computing, Distributed systems
Job PostingView all
1mo
Save
Mark Applied
Hide
Staff+ Software Engineer, Inference Runtime
San Francisco or Seattle or New York City
$405k-$485k/yr HybridFull Time
Anthropic
Anthropic: Developing safe and reliable artificial intelligence systems.
Senior IC with deep systems or ML infrastructure experience, hands-on performance profiling and optimization, accelerator ecosystem expertise (CUDA/TPU/Trainium), strong software engineering and cross-org alignment skills, and a relevant bachelor’s degree or equivalent.
Rust, Python, CUDA, XLA, Triton, NeuronX, AWS Neuron, Kubernetes, CI/CD
Job PostingView all
3w
Save
Mark Applied
Hide
Software Engineer - Systems
New York City or San Francisco or London
$200k-$275k/yr OnsiteFull Time
Spiral
Spiral: Building high-performance multimodal data infrastructure for AI systems.
5+ YOE5+ years systems programming experience, strong OS foundation, performance engineering, familiarity with Apache Arrow/Parquet/DataFusion/Clickhouse/DuckDB, PyTorch/CUDA understanding, Rust a bonus; able to work onsite in NYC, SF, or London.
Vortex, Apache Arrow, Parquet, DataFusion, Clickhouse, DuckDB, PyTorch, CUDA, Rust
Job PostingView all
1w
Save
Mark Applied
Hide
Staff Software Engineer, Storage
Bellevue or Dallas or Livingston or New York City or San Francisco or Sunnyvale
$207k-$303k/yr OnsiteFull Time
CoreWeave
CoreWeaveNASDAQ: CRWV: Cloud platform providing GPU-accelerated infrastructure for AI workloads.
10+ YOE10+ years in storage systems, hands-on distributed file/block storage, proficiency in Rust/C++/Go, Kubernetes, experience with RDMA/GPU Direct Storage/InfiniBand/SPDK, and storage observability tooling.
RDMA, GPU Direct Storage, RoCE, InfiniBand, SPDK, Ceph, Lustre, DAOS, NFS, S3, Rust, C++, Go, Kubernetes, ClickHouse, Prometheus, Grafana
Job PostingView all
2w
Save
Mark Applied
Hide
Senior Software Engineer, Gemini Audio, DeepMind
Mountain View or New York
$174k-$253k/yr OnsiteFull Time
Google
GoogleNASDAQ: GOOGL: Provides online search, advertising, cloud computing, and consumer electronics.
5+ YOEBachelor's degree or equivalent experience; 5+ years software development with Python; 3+ years testing/maintaining/launching software; 1+ year software design; experience with compilers, codegen, runtimes, ML and performance optimization.
Python, GPU, TPU, OpenXLA, MLIR, vLLM, sglang, JAX, PyTorch, Accelerated Linear Algebra (XLA)
Job PostingView all
1mo
Save
Mark Applied
Hide
Software Engineer, Machine Learning Infrastructure - Gen AI
San Francisco or New York City or Illinois or Colorado or United States
$137k-$202k/yr OnsiteFull Time
DoorDash
DoorDashNASDAQ: DASH: On-demand delivery platform connecting consumers with local merchants.
4+ YOEB.S./M.S./PhD in CS or equivalent; 4+ years software engineering; strong backend fundamentals in Python and distributed systems; experience building production services, observability, and ML workflows.
Python, Kubernetes, AWS, GCP, GPUs, LLM
Job PostingView all
4w
Save
Mark Applied
Hide
Principal Software Engineer, Machine Learning Infrastructure
Palo Alto or Seattle or Los Angeles or New York or Bellevue
$235k-$414k/yr OnsiteFull Time
Snap
SnapNYSE: SNAP: Develops social media applications and augmented reality technology.
10+ YOE10+ years software development experience, technical leadership, distributed systems and ML inference platform expertise, strong software design and debugging skills, ability to operate highly-available systems at scale.
Tensorflow, PyTorch, Kubernetes, GPU, LLM inference, RPC
Job PostingView all
3w
Save
Mark Applied
Hide
Senior Lead Software Engineer-AI Foundation Services
Plano or Jersey City or Wilmington or McLean
$171k-$260k/yr OnsiteFull Time
JPMorgan Chase
JPMorgan ChaseNYSE: JPM: Global financial services firm providing banking and investment solutions.
5+ YOE5+ years software engineering experience building cloud-native AI/ML platform services with Kubernetes, CI/CD, and infrastructure-as-code; proficiency in Python/Java/Go; strong production reliability and secure-by-design practices.
Kubernetes, CI/CD, infrastructure-as-code, Python, Java, Go, GPU
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Software Developer for Quantum-Centric Supercomputing
Yorktown Heights, New York, United States
$161k-$276k/yr OnsiteFull Time
IBM
IBMNew York Stock Exchange: IBM: Global technology providing enterprise software, cloud, and consulting.
Master's degree required; strong proficiency in Python and a systems language (C, C++, or Rust); experience with modern software engineering practices, HPC/resource managers, EM/quantum ecosystems, and strong communication skills.
Python, Rust, C, OpenMP, MPI, GPU, Slurm, PBS, Grid Engine, LSF, Qiskit, OpenQASM, CUDA-Q, Linux, HPC, CI/CD
Job PostingView all
4w
Save
Mark Applied
Hide
Principal Software Engineer, Machine Learning Infrastructure
Palo Alto or Seattle or Los Angeles or New York City or Bellevue
$235k-$414k/yr OnsiteFull Time
Snap
SnapNYSE: SNAP: Provides visual messaging software and augmented reality wearable devices.
10+ YOE10+ years software development experience (or equivalent with advanced degree), technical leadership experience, expertise in large-scale distributed systems, RPC services, debugging, performance analysis, and mentorship.
Tensorflow, PyTorch, Kubernetes, GPU
Job PostingView all
1mo
Save
Mark Applied
Hide
Staff HPC Systems Software Engineer
New York City or United States
$225k-$275k/yr OnsiteFull Time
Nscale
Nscale: Vertically integrated AI infrastructure provider for high-performance computing.
Extensive experience designing and building Slurm-based HPC systems, strong software skills in Go or Python, deep knowledge of GPU infrastructure and HPC networking (InfiniBand, RoCE, RDMA), and experience integrating HPC with cloud-native platforms.
Slurm, Kubernetes, Go, Python, Kueue, InfiniBand, RoCE, RDMA
Job PostingView all
3w
Save
Mark Applied
Hide
Backend Software Engineer - Platforms
New York, New York, United States
OnsiteFull Time
ByteDance
ByteDance: Developing AI-driven content platforms and mobile applications.
3+ YOEBS in CS or equivalent, experience with web apps, Unix/Linux, distributed systems, networking, and large systems; DICM/ITOM/ITSM experience required; GPU or big data (Hadoop/Kafka/Apache) experience valuable; Golang or Python development experience and production troubleshooting skills.
Golang, Python, Unix/Linux, Hadoop, Kafka, Apache, GPU, Discovery, Insights, and Configuration Management (DICM), IT Operation Management (ITOM), IT Service Management (ITSM)
Job PostingView all
1mo
Save
Mark Applied
Hide
Wireless Protocols Software Engineer
Florham Park, New Jersey, United States
$113k-$238k/yr HybridFull Time
CACI
CACINYSE: CACI: Provides information technology and professional services to government clients.
5+ YOEBachelor's in CS/EE (or equivalent), 5+ years industry experience, DSP and wireless PHY knowledge, strong C++ (C++11/17/20) on Linux, code profiling, test equipment use; ability to obtain clearance preferred.
C++11, C++17, C++20, Linux, Docker, KVM, FPGA, GPU
Job PostingView all
1mo
Save
Mark Applied
Hide
Member of Technical Staff (Software Engineer, Acceleration)
San Francisco or New York City
$250k-$405k/yr HybridFull Time
Perplexity
Perplexity: AI-powered search engine providing conversational answers with citations.
5+ YOE5+ years infrastructure/platform or developer-acceleration experience; daily use of AI models/tools; proficiency with Python; familiarity or willingness to learn Rust, TypeScript, and Go; strong technical judgment and systems thinking.
Python, Rust, TypeScript, Go, CUDA
Job PostingView all
3w
Save
Mark Applied
Hide
Senior Solution Engineer for NVIDIA Experience, Compute Software
Santa Clara or Austin or Westford or Durham or New York City or Redmond
$168k-$322k/yr OnsiteFull Time
NVIDIA
NVIDIANASDAQ: NVDA: Designs graphics processing units and artificial intelligence hardware.
10+ YOEBS in Computer Science or Electrical Engineering (or equivalent),10+ years software engineering experience, AI/ML expertise, strong communication and problem-solving, experience with NVIDIA technologies preferred.
AI Enterprise, Omniverse, vGPU, CUDA
Job PostingView all

Explore Jobs

Expand Your Job Search