2,892 spark engineer jobs at 1,036 companies in United States

4d
Save
Mark Applied
Hide
Spark Engineer
Atlanta, Georgia, United States
$62k-$72k/yr OnsiteFull Time
Capgemini
CapgeminiEuronext Paris: CAP: Provides global IT consulting and digital transformation services.
Experience designing and building integrations with Apache Spark, Spark Engine/Flow, APIs and microservices; strong Python, distributed systems, big-data (Hadoop, Hive, SQL, Kafka) and cloud (AWS/Azure/GCP) skills; CI/CD with Github Actions, Docker, Kubernetes.
Apache Spark, Spark Engine, Spark Flow, Python, Hadoop, Hive, SQL, Kafka, AWS, Azure, GCP, Github Actions, Docker, Kubernetes
2mo
Save
Mark Applied
Hide
Spark Engineer
Sunnyvale, California, United States
OnsiteFull Time
IT Convergence
IT Convergence: Global provider of Oracle cloud, managed services, and digital transformation.
5+ YOE5+ years in software development; data engineering with pipelines; Python/Perl/Shell; Java; Oracle/MySQL; real-time pipelines with Kafka/Storm.
Python, Perl, Shell, Java, Oracle, MySQL, Kafka, Storm, HDFS, Hive, Pig, Oozie, HBase, Spark
2mo
Save
Mark Applied
Hide
Apache Spark Developer
Herndon or Springfield or St. Louis or Aurora
$150k-$225k/yr OnsiteFull Time
Absolute Business Solutions Corp
Absolute Business Solutions Corp: Provides technology and intelligence services to the US government.
5+ YOETS/SCI eligibility preferred, Bachelor\u0002s plus 5+ years in data engineering or Spark development, strong Spark and PySpark experience, Python, large-scale data processing, performance tuning, Kubernetes/Docker familiarity.
Apache Spark, PySpark, Scala, Delta Lake, Parquet, Structured Streaming, Kubernetes, Docker, S3, AWS, GCP, Azure, Git, Jenkins, Python, Bash, Terraform, Iceberg
2mo
Save
Mark Applied
Hide
Spark Operator - 3rd Shift
Turners Falls, Massachusetts, United States
OnsiteFull Time
Sumitomo Electric
Sumitomo ElectricTokyo Stock Exchange: 5802: Manufacturer of electrical wires, cables, and automotive wiring harnesses.
0+ YOEEntry-level Spark Operator on 3rd shift; HS diploma or GED; basic math; ability to lift up to 50 lbs; standing; flexible schedule; willingness to learn.
1w
Save
Mark Applied
Hide
Lead Data Engineer - Pipelines, Spark Streaming and Spark Offline
Tampa, Florida, United States
OnsiteFull Time
JPMorgan Chase
JPMorgan ChaseNYSE: JPM: Global financial services firm providing banking and investment solutions.
5+ YOE5+ years applied data engineering experience; strong Python/PySpark; experience with Spark/Flink, Databricks, AWS Glue/EMR, batch and real-time pipelines, and distributed system design; AI-assisted workflow experience.
Python, PySpark, Spark, Spark Streaming, Spark Offline, Flink, Databricks, Data brick live tables, Amazon Web Services (AWS), AWS Glue, EMR, Glue, Lamida, Flask, AWS EKS, Kubernetes, Docker, Hadoop, Kafka, NoSQL, relational database
3w
Save
Mark Applied
Hide
Check out this job at Deloitte, Java Spark Developer-Software Engineer II
United States
$81k-$134k/yr OnsiteFull Time
Deloitte
Deloitte: Provides professional audit, consulting, advisory, and tax services.
3+ YOE3+ years professional software engineering experience with Java/J2EE and Apache Spark, strong SQL skills, unit testing (JUnit), containerization (Docker), orchestration (Kubernetes), Git and CI/CD, Bachelor's degree (or equivalent), ability to travel ~10%.
Java, Java 8, J2EE, Apache Spark, Spark SQL, SQL, JUnit, Docker, Kubernetes, Git, CI/CD
1mo
Save
Mark Applied
Hide
Principal Software Engineer - Spark
San Jose or Austin
$270k-$320k/yr HybridFull Time
Cloudera
Cloudera: Provides hybrid data platforms for enterprise analytics and AI.
10+ YOE10+ years in software engineering; strong in Spark, Java/Scala/Python; distributed systems; cloud-native; open-source experience; excellent communication.
Apache Spark, Apache Airflow, Iceberg, Kubernetes, Docker, OpenShift, Rancher, Java, Scala, Python, Go, SQL
1mo
Save
Mark Applied
Hide
Principal Machine Learning Engineer, Accelerated Apache Spark
Santa Clara, California, United States
$272k-$431k/yr OnsiteFull Time
NVIDIA
NVIDIANASDAQ: NVDA: Designs GPU-accelerated computing and artificial intelligence hardware.
12+ YOESenior ML/DS engineer with 12+ years of experience; 5+ years leading ML model development; strong Python and ML tooling; experience with GPU-accelerated Spark; expertise in ML methods and feature engineering.
Python, numpy, pandas, scikit-learn, scipy, pytorch, tensorflow, Apache Spark, Scala, Java, C++, XGBoost
1w
Save
Mark Applied
Hide
Lead Software Engineer (Python, Scala, Spark, AWS)
Richmond or McLean or Chicago
$179k-$225k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: Financial services offering credit cards, banking, and loans.
4+ YOEBachelor's degree, 4+ years professional software engineering, 1+ year cloud experience (AWS/Azure/GCP). Experience with Java/Scala/Python/Spark, containerization, distributed microservices, and mentoring/leading teams.
Python, Scala, Spark, AWS, Java, SQL, Node, Go, Docker, Kubernetes
2d
Save
Mark Applied
Hide
Software Engineer – Presto / Spark Development
San Jose or Austin
$131k-$245k/yr HybridFull Time
IBM
IBMNew York Stock Exchange: IBM: Global technology providing enterprise software, cloud, and consulting.
6+ YOE6+ years software engineering experience with ≥2 years on Presto/Trino or Apache Spark internals; strong Java or Scala; connectors, UDFs/UDAFs, optimizer work; JVM tuning, open table formats, and clear written communication.
Presto, Trino, Apache Spark, Java, Scala, Iceberg, Delta, Hudi, JVM, async-profiler, flamegraphs, Kubernetes, RAPIDS Accelerator, cuDF, Arrow, ORC, Parquet, CI/CD
2w
Save
Mark Applied
Hide
Software Engineer, Spark Platform
San Francisco or Sunnyvale or Seattle or New York City
$131k-$285k/yr HybridFull Time
DoorDash
DoorDashNASDAQ: DASH: On-demand delivery platform connecting consumers with local merchants.
24+ YOEExperience operating production distributed systems and Apache Spark at scale, Kubernetes production experience, familiarity with schedulers and observability stacks, cloud (AWS) experience, programming in Python/Go/Scala/Java, and SQL fluency. BS/MS/PhD in CS or equivalent.
Apache Spark, Amazon EMR, Databricks, Kubernetes, YuniKorn, Volcano, Kueue, Spark-on-Kubernetes operator, Prometheus, OpenTelemetry, Python, Go, Scala, Java, SQL, VPC
1mo
Save
Mark Applied
Hide
Java Developer with Spark Experience
Rockville, Maryland, United States
$120k/yr RemoteFull Time
Global Alliant
Global Alliant: Provides IT modernization and software development for government agencies
5+ YOE5+ years JVM development with Java/Kotlin/Scala, strong Apache Spark experience (Spark SQL, DataFrames, Datasets), SQL, AWS, Git; US citizenship and ability to undergo security clearance required.
Java, Kotlin, Scala, Apache Spark, Spark SQL, DataFrames, Datasets, Git, AWS, SQL
2d
Save
Mark Applied
Hide
Senior Data Engineer - Hadoop/Spark/OCP/Big Data
Pittsburgh or Strongsville or Denver or Phoenix or Birmingham or Dallas
$50k-$186k/yr OnsiteFull Time
PNC Financial Services
PNC Financial ServicesNYSE: PNC: Provides banking, lending, and investment services to customers.
5+ YOEDesign and maintain scalable data pipelines with Spark/SQL; containerize workloads; optimize Spark performance; CI/CD and data governance experience; 5+ years industry experience.
Hadoop, Spark, SQL, Docker, Kubernetes, OCP, S3, ADLS, Apache Iceberg, Jenkins, GitHub, Bitbucket, Azure DevOps
1mo
Save
Mark Applied
Hide
Senior Apache Spark Technical Specialist - Scala, Python (121100)
United States
OnsiteFull Time
HCLTech
HCLTechNational Stock Exchange of India: HCLTECH: Global provider of information technology services and software consulting.
Expertise in Apache Spark, Scala, and Python for developing scalable big data solutions; strong data engineering knowledge and collaboration skills; relevant certifications a plus.
Apache Spark, Scala, Python
2mo
Save
Mark Applied
Hide
MID-LEVEL DATA ENGINEER-Python, AWS, Spark (Hybrid)
Bloomington or Richardson or Tempe or Dunwoody
HybridFull Time
State Farm
State Farm: Provider of auto, home, life, and health insurance.
2+ YOE2-4 years as a Data Engineer; proficiency in Python, Spark SQL/PySpark, R, Java, Bash; hands-on AWS (ETL tools, Lambda, Step Functions, S3, DynamoDB, Kinesis, Redshift, SageMaker); Spark/Databricks; IaC (OpenTofu); CI/CD with Airflow.
Python, Apache Spark, PySpark, R, Java, Bash, AWS, Glue, EMR Serverless, Lambda, Step Functions, EventBridge, S3, DynamoDB, Kinesis Firehose, Redshift, Iceberg, SageMaker, Databricks, OpenTofu, Terraform, Airflow, SQL, Athena
2mo
Save
Mark Applied
Hide
Senior Software Engineer I (Data Engineer - Spark, Scala, ETL)
San Francisco, California, United States
RemoteFull Time
UnitedHealth Group
UnitedHealth GroupNYSE: UNH: Provides health insurance and technology-enabled health care services.
6+ YOE6+ years data engineering (Spark/Scala); 4+ years ETL/Databricks; Azure PaaS; Agile; unit tests; SQL/PLSQL; Git; GenAI tools; OO and secure coding.
Apache Spark, Scala, Databricks, Azure, Git, Docker, Splunk, GitHub Actions, SQL, GenAI
1w
Save
Mark Applied
Hide
Engineer
Pittsburgh, Pennsylvania, United States
$90k-$110k/yr OnsiteFull Time
Tata Consultancy Services
Tata Consultancy ServicesNational Stock Exchange of India: TCS: Global provider of IT services, consulting, and business solutions.
8+ YOEBachelor in Computer Science, 8+ years experience in data/feature engineering or ML engineering; production feature pipelines, Python and SQL, Spark/Flink, cloud platforms; mentoring experience.
Python, SQL, Spark, Flink, Hopsworks, Feast, SageMaker, Azure, AWS, GCP
2mo
Save
Mark Applied
Hide
Senior Data Engineer (Apache Spark, NiFi, SQL)
O'Fallon, Missouri, United States
$140k-$231k/yr OnsiteFull Time
Mastercard
MastercardNYSE: MA: Global payment processing and financial technology service provider.
6+ YOE6+ years in data warehouse/big data, Spark with Scala/Python/Java, NiFi pipelines; experience with Oracle/Netezza; strong debugging, communication, and collaboration.
Apache Spark, NiFi, SQL, Hadoop, Scala, Python, Java, Oracle, Netezza
2mo
Save
Mark Applied
Hide
Senior Data Engineer – Enterprise Data Frameworks (Java Spark Focus)
United States
$120k-$160k/yr HybridFull Time
Citizens Financial Group
Citizens Financial GroupNYSE: CFG: Provides retail, commercial, and private banking services to customers.
7+ YOE7+ years in data engineering with Java and Apache Spark; experience building Spark batch/streaming jobs; data lake knowledge (Iceberg/Parquet); Spring Boot, REST APIs; CI/CD, Docker/Kubernetes; cloud exposure (AWS); strong collaboration; optional familiarity with Generative AI tools.
Java, Apache Spark, Spring Boot, RESTful APIs, Microservices, CI/CD, Git, Docker, Kubernetes, AWS
1mo
Save
Mark Applied
Hide
Software Engineer 2 - Spark/MapReduce/SQL/NoSQL/Pandas/Numpy/SciPy
Annapolis Junction, Maryland, United States
$130k-$270k/yr OnsiteFull Time
Captivation Software
Captivation Software: Provides specialized software engineering for the intelligence and defense communities.
14+ YOETop Secret/SCI with Polygraph and U.S. citizenship required; 14 years SWE experience (or Bachelor's in CS + experience; 4 years SWE may substitute for degree); skilled in Spark, MapReduce, SQL/NoSQL, Pandas/Numpy/SciPy.
Spark, MapReduce, SQL/NoSQL, Pandas, Numpy, SciPy