HiringCafe
Join our community

65 software engineer gpu jobs at 41 companies in New Rochelle, NY

1d
Save
Mark Applied
Hide
Software Engineer, GPU Fleet
New York City, New York, United States
$200k-$300k/yr HybridFull Time
Tower Research Capital
Tower Research Capital: Global quantitative trading firm developing automated algorithmic strategies.
2+ YOEBachelor's or master's in computer science or related field, 2+ years of relevant experience, Python development, GPU management, Linux/UNIX, debugging, software design, and configuration or monitoring technologies.
Python, Linux, UNIX, CI/CD
Job PostingView all
1mo
Save
Mark Applied
Hide
Software Engineer, Compute (GPU)
San Francisco or New York or Austin or Seattle
$175k-$300k/yr OnsiteFull Time
Fluidstack
Fluidstack: Provides high-performance cloud GPU infrastructure for AI development.
Experience building automation and observability for large GPU fleets; familiarity with firmware/BMC/Redfish/IPMI, Kubernetes, metrics and alerting, and production automation; comfortable with incident response and on-call.
Kubernetes, Redfish, BMC, IPMI, Temporal, Cadence, Prometheus, Grafana, Go, Python, LLM APIs, Claude Code, Cursor
Job PostingView all
1w
Save
Mark Applied
Hide
Member of Technical Staff (Software Engineer, GPU Cluster Infrastructure)
San Francisco or Seattle or New York City or United States
$250k-$485k/yr OnsiteFull Time
Perplexity
Perplexity: AI-powered search engine providing conversational answers with citations.
Deep Kubernetes and GPU cluster experience, multi-cloud orchestration, strong distributed systems fundamentals, systems-level coding in Go/Rust/C++, and experience with training and inference workloads.
Kubernetes, kubectl, NVIDIA, CUDA, InfiniBand, RoCE, CoreWeave, AWS, GCP, Go, Rust, C++, vLLM, SGLang, TensorRT-LLM, Slurm, Triton, RDMA, Prometheus, Grafana, Weights & Biases
Job PostingView all
3mo
Save
Mark Applied
Hide
Infrastructure Engineer (GPU & Compute)
New York or San Francisco or Seattle
$180k-$200k/yr RemoteFull Time
Lightning AI
Lightning AI: Unified platform to build, train, and deploy AI models.
5+ YOE5+ years in infrastructure or systems engineering; strong Linux in production; GPU hardware and software experience; bare-metal provisioning; Python automation; debugging across hardware/OS/GPU.
NVIDIA DCGM, PXE, IPMI, Redfish, iDRAC, LiveCD, InfiniBand, NVLink, Linux, Python
Job PostingView all
1mo
Save
Mark Applied
Hide
Lead Software Developer – GPU-accelerated Free Energy Simulation and Machine Learning Methods
Piscataway, New Jersey, United States
$94k/yr HybridFull Time
Rutgers University
Rutgers University: Providing higher education degrees and conducting academic research.
PhD in biology or chemistry with postdoctoral experience using Amber; proficiency in Python, C++, CUDA/GPU programming, molecular simulation (alchemical free energy/quantum/ML), and high-performance computing; strong English communication.
Python, C++, CUDA, Amber, GPU
Job PostingView all
1d
Save
Mark Applied
Hide
Principal Software Engineer - LLM Optimization
Jersey City or London
$204k-$285k/yr OnsiteFull Time
JPMorgan Chase
JPMorgan ChaseNYSE: JPM: Global financial services firm providing banking and investment solutions.
7+ YOEFormal software engineering training or certification and 7+ years of experience, with hands-on LLM inference, GPU infrastructure, quantization, benchmarking, cloud systems, and agentic AI development expertise.
vLLM, TensorRT-LLM, SGLang, LLM-D, FP8, INT8, INT4, GPTQ, AWQ, AWS, EKS, GuideLLM, DCGM, NVML, XID
Job PostingView all
1d
Save
Mark Applied
Hide
Photoshop Developer, GPU/Imaging
San Francisco or San Jose or Seattle or New York City
$139k-$258k/yr OnsiteFull Time
Adobe
AdobeNASDAQ: ADBE: Provides software for digital media creation and marketing analytics
Bachelor's or master's in computer science or equivalent experience; graphics and GPU programming fundamentals; modern C++, graphics APIs, asynchronous production code, and strong analytical and debugging skills.
C++, WebGPU, WGSL, Metal, DirectX, Vulkan, WebAssembly, Adobe Photoshop, AI tools
Job PostingView all
1mo
Save
Mark Applied
Hide
Software Engineer, AI Labs
Edinburgh or New York City or Atlanta or San Francisco or Seattle
HybridFull Time
BlackRock
BlackRockNYSE: BLK: Provides investment management and financial technology services globally.
3+ YOE3+ years professional software engineering experience; strong Python and SQL skills; experience building, testing, deploying, and operating cloud-native applications, services, APIs, or data pipelines; strong engineering fundamentals and communication.
Python, SQL, Spark, Airflow, Dagster, Flyte, GPUs, TPUs, AWS Inferentia, CI/CD, AI coding assistants
Job PostingView all
1w
Save
Mark Applied
Hide
Senior Software Engineer
New York City, New York, United States
$129k-$150k/yr OnsiteFull Time
Weill Cornell Medicine
Weill Cornell Medicine: Providing medical education, clinical research, and patient care services.
Bachelor's degree; software development experience with pipelines, messaging services, cloud environments, databases, and languages including Python, Java, C++, SQL, and R.
Nextflow, Kafka, Microsoft Azure, AWS, Google Cloud, PHP, JavaScript, HTML, CSS, SQL, XML, C, C++, Qt, Matlab, Python, Java, R, JDBC, JSP, OpenMP, CUDA, AMP, MPI, GPGPU, Sybase, Microsoft SQL Server, Oracle, MySQL
Job PostingView all
2mo
Save
Mark Applied
Hide
Staff Software Engineer - AI Research Infrastructure
San Francisco or New York City
$199k-$270k/yr HybridFull Time
Databricks
Databricks: A unified platform for data analytics and artificial intelligence.
5+ YOEBS/MS or PhD in computer science; 5+ years of software engineering experience in distributed systems or infrastructure; strong experience with GPUs, clusters, and cloud platforms; proficient in systems languages and large-scale job orchestration.
C++, Rust, Go, Java, Scala, Kubernetes, Slurm, Ray, GPU, Cloud computing, Distributed systems
Job PostingView all
4d
Save
Mark Applied
Hide
Software Engineer, Inference Runtime
New York City, New York, United States
$150k-$350k/yr HybridFull Time
LM Studio
LM Studio: Desktop software for running large language models locally and privately.
Significant production ML, inference runtime, or performance infrastructure experience; strong Python and C++; transformer and inference expertise; CPU/GPU profiling; PyTorch and inference system experience.
Python, C++, PyTorch, llama.cpp, MLX, ExecuTorch, vLLM, SGLang, TensorRT-LLM, CUDA, Metal, Vulkan, ROCm
Job PostingView all
2mo
Save
Mark Applied
Hide
Staff+ Software Engineer, Inference Runtime
San Francisco or Seattle or New York City
$405k-$485k/yr HybridFull Time
Anthropic
Anthropic: Developing safe and reliable artificial intelligence systems.
Senior IC with deep systems or ML infrastructure experience, hands-on performance profiling and optimization, accelerator ecosystem expertise (CUDA/TPU/Trainium), strong software engineering and cross-org alignment skills, and a relevant bachelor’s degree or equivalent.
Rust, Python, CUDA, XLA, Triton, NeuronX, AWS Neuron, Kubernetes, CI/CD
Job PostingView all
1mo
Save
Mark Applied
Hide
Software Engineer - Systems
New York City or San Francisco or London
$200k-$275k/yr OnsiteFull Time
Spiral
Spiral: Building high-performance multimodal data infrastructure for AI systems.
5+ YOE5+ years systems programming experience, strong OS foundation, performance engineering, familiarity with Apache Arrow/Parquet/DataFusion/Clickhouse/DuckDB, PyTorch/CUDA understanding, Rust a bonus; able to work onsite in NYC, SF, or London.
Vortex, Apache Arrow, Parquet, DataFusion, Clickhouse, DuckDB, PyTorch, CUDA, Rust
Job PostingView all
38m
Save
Mark Applied
Hide
Software Engineer, MTIA SW Tooling Engineer
Bellevue or Menlo Park or New York City
$184k-$257k/yr OnsiteFull Time
Meta
MetaNASDAQ: META: Develops social networking platforms and virtual reality technologies.
6+ YOEBachelor's degree or equivalent practical experience, 6+ years in systems software or developer tooling, C++ and Python proficiency, debugging tool development, cross-stack systems experience, and technical project leadership.
C++, Python, PyTorch, torch.compile, MLIR, LLVM, TVM, Triton, CUDA, cuda-gdb, nsight-compute, nsight-systems, cuda-memcheck, Linux, gdb, perf, eBPF, ftrace, ELF, DWARF
Job PostingView all
3w
Save
Mark Applied
Hide
Senior Software Engineer, Gemini Audio, DeepMind
Mountain View or New York
$174k-$253k/yr OnsiteFull Time
Google
GoogleNASDAQ: GOOGL: Provides online search, advertising, cloud computing, and consumer electronics.
5+ YOEBachelor's degree or equivalent experience; 5+ years software development with Python; 3+ years testing/maintaining/launching software; 1+ year software design; experience with compilers, codegen, runtimes, ML and performance optimization.
Python, GPU, TPU, OpenXLA, MLIR, vLLM, sglang, JAX, PyTorch, Accelerated Linear Algebra (XLA)
Job PostingView all
1mo
Save
Mark Applied
Hide
Software Engineer, Machine Learning Infrastructure - Gen AI
San Francisco or New York City or Illinois or Colorado or United States
$137k-$202k/yr OnsiteFull Time
DoorDash
DoorDashNASDAQ: DASH: On-demand delivery platform connecting consumers with local merchants.
4+ YOEB.S./M.S./PhD in CS or equivalent; 4+ years software engineering; strong backend fundamentals in Python and distributed systems; experience building production services, observability, and ML workflows.
Python, Kubernetes, AWS, GCP, GPUs, LLM
Job PostingView all
1mo
Save
Mark Applied
Hide
Principal Software Engineer, Machine Learning Infrastructure
Palo Alto or Seattle or Los Angeles or New York or Bellevue
$235k-$414k/yr OnsiteFull Time
Snap
SnapNYSE: SNAP: Develops social media applications and augmented reality technology.
10+ YOE10+ years software development experience, technical leadership, distributed systems and ML inference platform expertise, strong software design and debugging skills, ability to operate highly-available systems at scale.
Tensorflow, PyTorch, Kubernetes, GPU, LLM inference, RPC
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Software Developer for Quantum-Centric Supercomputing
Yorktown Heights, New York, United States
$161k-$276k/yr OnsiteFull Time
IBM
IBMNew York Stock Exchange: IBM: Global technology providing enterprise software, cloud, and consulting.
Master's degree required; strong proficiency in Python and a systems language (C, C++, or Rust); experience with modern software engineering practices, HPC/resource managers, EM/quantum ecosystems, and strong communication skills.
Python, Rust, C, OpenMP, MPI, GPU, Slurm, PBS, Grid Engine, LSF, Qiskit, OpenQASM, CUDA-Q, Linux, HPC, CI/CD
Job PostingView all
1mo
Save
Mark Applied
Hide
Principal Software Engineer, Machine Learning Infrastructure
Palo Alto or Seattle or Los Angeles or New York City or Bellevue
$235k-$414k/yr OnsiteFull Time
Snap
SnapNYSE: SNAP: Provides visual messaging software and augmented reality wearable devices.
10+ YOE10+ years software development experience (or equivalent with advanced degree), technical leadership experience, expertise in large-scale distributed systems, RPC services, debugging, performance analysis, and mentorship.
Tensorflow, PyTorch, Kubernetes, GPU
Job PostingView all
1mo
Save
Mark Applied
Hide
Staff HPC Systems Software Engineer
New York City or United States
$225k-$275k/yr OnsiteFull Time
Nscale
Nscale: Vertically integrated AI infrastructure provider for high-performance computing.
Extensive experience designing and building Slurm-based HPC systems, strong software skills in Go or Python, deep knowledge of GPU infrastructure and HPC networking (InfiniBand, RoCE, RDMA), and experience integrating HPC with cloud-native platforms.
Slurm, Kubernetes, Go, Python, Kueue, InfiniBand, RoCE, RDMA
Job PostingView all

Explore Jobs

Expand Your Job Search