579 spark engineer jobs at 205 companies in Parsippany, NJ
1mo
Save
Mark Applied
Hide
1mo
Spark Engineer
Jersey City or New York City
OnsiteFull Time
InfosysNYSE: INFY: Global leader in next-generation digital services and consulting.
Experience with Spark/Hadoop ecosystem, Kafka, HBase/Hive/Impala, Python/SQL/PySpark/Shell; bachelor's degree or equivalent experience; ability to work full SDLC; US work authorization required.
San Francisco or Seattle or Sunnyvale or New York City
$131k-$285k/yrHybridFull Time
DoorDashNYSE: DASH: Technology enabling local on-demand delivery and commerce.
24+ YOERequires a CS degree or equivalent, 24+ years operating production distributed systems, Spark at scale, Kubernetes, cloud infrastructure, observability, and professional Python, Go, Scala, or Java with SQL fluency.
San Francisco or Sunnyvale or Seattle or New York City
$131k-$285k/yrHybridFull Time
DoorDashNYSE: DASH: Technology enabling local on-demand delivery and commerce.
24+ YOEExperience operating production distributed systems and Apache Spark at scale, Kubernetes production experience, familiarity with schedulers and observability stacks, cloud (AWS) experience, programming in Python/Go/Scala/Java, and SQL fluency. BS/MS/PhD in CS or equivalent.
Lead Data Engineer (Python, AWS, Spark, Kafka, SQL, Snowflake, Databricks, GenAI)
New York City or McLean or Richmond
$215k-$246k/yrOnsiteFull Time
Capital OneNYSE: COF: A technology-driven bank providing diverse financial services.
4+ YOEBachelor's degree, 4+ years application development, 2+ years big data, 1+ year cloud experience; proficiency with Python, SQL, Spark, ETL, and distributed data tools.
Cogent: AI cybersecurity providing autonomous agents for enterprise vulnerability management.
5+ YOE5+ years infrastructure engineering experience, hands-on AWS, Clickhouse, Postgres, Spark; startup experience; security and on-prem deployment experience; able to drive large cross-stakeholder projects.
UnityNYSE: U: Develops tools for games and interactive experiences.
10+ YOE10+ years engineering experience; hands-on with LLMs/agentic systems, productionizing AI features, and distributed systems (Kafka, Flink, Spark); strong cross-team influence and mentorship skills.
FanDuel: American sports-tech gaming offering sports betting, daily fantasy, horse racing, casino, and sports media to fans.
8+ YOE8+ years data engineering experience building scalable batch and streaming systems; proficiency with Spark, Airflow, Kafka, Databricks, cloud services; SQL and Python/Scala/Java; strong system ownership and communication skills.
Austin or San Francisco or New York City or Seattle or Los Angeles or Chicago or Gurugram or Bengaluru
$170k-$230k/yrRemoteFull Time
SentiLink: Your fraud and risk partner
5+ YOE5+ years engineering experience; strong Python or Golang skills; building ETL/ELT pipelines at scale with Spark/Hadoop/Kafka; cloud (AWS/Azure/GCP) and database expertise; containerization and IaC experience.
Vistar Media: Private advertising technology helping brands, agencies, and media owners buy and sell digital out-of-home media.
4+ YOE4+ years experience building scalable big-data pipelines using Python, Spark, SQL, cloud (GCP), Airflow and Kafka; strong software engineering, data architecture, and geospatial experience preferred.
Lead Data Engineer (Python, AWS, Spark, Kafka, SQL, Snowflake, Databricks, GenAI)
Richmond or McLean or New York City
$179k-$246k/yrOnsiteFull Time
Capital OneNYSE: COF: A technology-driven bank providing diverse financial services.
4+ YOEBachelor's degree, 4+ years of application development, 2+ years with big data technologies, and 1+ year with cloud computing. Preferred experience includes Python, SQL, Spark, AWS, streaming, data warehousing, and AI tools.
Chartmetric: Private music analytics serving labels, artists, managers, distributors, agencies, and live-music executives.
6+ YOE6+ years building production data systems; expert Python, PostgreSQL, Apache Airflow, Clickhouse, Snowflake, Elasticsearch, Apache Spark, and AWS; bachelor's in CS/Data Engineering preferred or equivalent experience.
Sr Data Engineer, Python + Spark (Data Federation skillset - Data Lakehouse - Eg: Starburst) - New York
New York, New York, United States
$40k-$140k/yrOnsiteFull Time
Photon Interactive: Full-service digital agency driving AI-led digital transformation.
5+ YOESenior Data Engineer with 5+ years in Python, Spark; expertise in data federation, lakehouse architectures (Delta Lake/Iceberg/Hudi); Starburst/Trino/Dremio; cloud platforms (AWS/Azure/GCP); strong SQL and data modeling.
Practice Customer Engineer, Data Analytics, Google Cloud
Sunnyvale or Atlanta or Austin or Boulder or Chicago or Kirkland or Los Angeles or New York City or Seattle or San Francisco or Portland or Phoenix or Playa Vista
$192k-$267k/yrOnsiteFull Time
GoogleNASDAQ: GOOG, GOOGL: Global technology specializing in internet-related services and products.
10+ YOEBachelor's degree or equivalent, 10 years in cloud-native architecture, Big Data expertise, technical stakeholder engagement, and programming experience with Python, Spark, or SQL.
Google Cloud, Python, Spark, SQL, Informatica, Talend, Alooma, SAP, Data Services, Java, JavaScript, C++, Scala, R, Go, DNS, TCP, Linux, Microsoft Windows, VPN, VPC
Sr Software Engineer II - GCP, Java/Python - The Personalization, Brand, and Communications Technology
New York, New York, United States
$123k-$215k/yrHybridFull Time
American ExpressNYSE: AXP: Global financial services offering payment and travel products.
10+ YOEBachelor's or Master's in CS/Engineering, 10+ years software engineering, experience building cloud-native solutions on GCP with Java/Python, Spark/BigQuery/Dataflow/PubSub/GKE, microservices, CI/CD; US work eligibility required.
TerraForm Power: Private renewable energy owner and operator supplying wind, solar, and battery-storage power to North American customers.
5+ YOEBachelor's degree and 5+ years building production data platforms; strong Python and SQL skills; ETL and distributed processing experience; Databricks/Spark/Delta Lake experience preferred.
Python, SQL, Databricks, Apache Spark, Delta Lake, Streamlit, SCADA
Databricks: Data and AI software providing a unified platform.
6+ YOE6+ years in data or software engineering; coding in Python, Scala, JavaScript/TypeScript; two cloud ecosystems; Apache Spark, CI/CD, MLOps, production architectures, enterprise delivery, and Databricks Certification.
H1: AI-powered healthcare data platform helping life sciences, payers, providers, and patients identify and engage doctors.
8+ YOE8+ years building and scaling distributed data platforms; technical leadership and mentoring; strong Python (PySpark), Java/Scala, advanced SQL, Apache Spark, cloud-native big data (AWS EMR/Glue/S3/Athena/Redshift), orchestration (Argo/Airflow), containerization, observability, and experience with large-scale ingestion and data quality.
ESPN: -controlled American sports media serving fans through television networks, digital platforms, streaming, radio, and live events.
5+ YOEExperience building and operating large-scale data/ML systems, strong distributed systems fundamentals, streaming/batch technologies (Kafka, Kinesis, Spark, Flink), Python, plus working knowledge of Java/Scala/Go/C++, cloud-native (AWS, containers, Kubernetes, IaC), observability, and collaboration skills; Bachelor's or Master's required.
Amalgamated Bank: Socially responsible commercial bank serving nonprofits, labor unions, advocacy groups, businesses, and individuals through banking and investment services.
2+ YOEBachelor's degree or equivalent experience; 2+ years of data engineering experience preferred, with Databricks, SQL, Python, Spark, Azure, ETL, and data architecture expertise.