HiringCafe
Join our community

346 spark data engineer jobs at 166 companies in Wayne, NJ

PromotedHiringCafe
Founding Machine Learning / AI Search Engineer
Cupertino, CA, US
$160k-$310k/yr On-SiteFull Time
HiringCafe
HiringCafe: Building a 100× better job search engine to take on Indeed and LinkedIn.
Build the ML and AI search behind HiringCafe — ranking, recommenders, retrieval, and LLM agents that surface jobs people would never find on their own.
Python, PyTorch, Elasticsearch, LLMs
Help us #BeatIndeed & #BeatLinkedIn
1mo
Save
Mark Applied
Hide
Data Engineer
New York City or San Francisco
OnsiteFull Time
Bedrock Robotics
Bedrock Robotics: Automates heavy construction machinery with AI retrofit kits.
5+ YOE5+ years data engineering experience in large-scale data lake/warehouse environments; strong SQL and distributed query engine experience; pipeline orchestration (Airflow/Prefect) and Spark/Databricks experience; data quality and observability expertise.
SQL, Spark, BigQuery, Snowflake, Airflow, Prefect, Databricks
Job PostingView all
2mo
Save
Mark Applied
Hide
Sr Data Engineer, Python + Spark (Data Federation skillset - Data Lakehouse - Eg: Starburst) - New York
New York, New York, United States
$40k-$140k/yr OnsiteFull Time
Photon: Global technology services provider.
5+ YOESenior Data Engineer with 5+ years in Python, Spark; expertise in data federation, lakehouse architectures (Delta Lake/Iceberg/Hudi); Starburst/Trino/Dremio; cloud platforms (AWS/Azure/GCP); strong SQL and data modeling.
Python, Apache Spark, Starburst Enterprise, Trino (Presto), Dremio, Delta Lake, Iceberg, Hudi, AWS, S3, Glue, Azure Databricks, ADLS, GCP, SQL, Medallion Architecture, Starburst/Trino
Job PostingView all
3mo
Save
Mark Applied
Hide
Senior Data Engineer
New York City, New York, United States
$138k-$182k/yr HybridFull Time
FanDuel
FanDuelNYSE: FLUT: Offers online sports betting and daily fantasy sports services.
5+ YOE5+ years in data engineering or software engineering; strong SQL; experience with Airflow, Spark, dbt, Kafka, Databricks; cloud experience (AWS, GCP, Azure); data modeling and quality; independent, fast-paced environment.
Airflow, Spark, dbt, Kafka, Databricks
Job PostingView all
3w
Save
Mark Applied
Hide
Senior Data Engineer
United States or San Francisco or New York City or Washington or Austin
$118k-$179k/yr RemoteFull Time
Samsara
SamsaraNYSE: IOT: Connected Operations Cloud platform for physical operations and IoT.
8+ YOEBachelor's in CS or equivalent, 8+ years as a software/data engineer, 5+ years building production data pipelines and Spark/PySpark experience, strong Python and SQL, cloud data warehouse and ETL tooling experience.
Spark, PySpark, Databricks, Python, SQL, Snowflake, Google BigQuery, Apache Iceberg, Fivetran, dbt, NetSuite, Salesforce, MySQL, AWS RDS/Aurora, PostgreSQL, Oracle, Microsoft SQL Server, AWS, Azure, GCP, Splunk, Datadog, AWS CloudWatch, API Gateway, Lambda, S3, SNS, SQS, SecretsManager, MCP (Model Context Protocol)
Job PostingView all
1mo
Save
Mark Applied
Hide
Sr. Data Engineer
New York City, New York, United States
$140k-$165k/yr HybridFull Time
The Leading Hotels of the World
The Leading Hotels of the World: Provides marketing, sales, and reservation services for independent hotels.
7+ YOE7+ years in data engineering; Snowflake/BigQuery/Redshift/Databricks; ETL/ELT tools (Airflow, dbt, Spark); SQL and Python; large-scale data processing; data governance and security; strong cross-functional communication.
Snowflake, BigQuery, Redshift, Databricks, Airflow, dbt, Spark, SQL, Python
Job PostingView all
5d
Save
Mark Applied
Hide
Senior Data Engineer
North Hollywood or New York
$140k-$160k/yr HybridFull Time
Versant
VersantNasdaq: VSNT: Operates cable television networks and digital media entertainment platforms.
5+ YOE5+ years building production data pipelines with Spark-based platforms, expertise in PySpark and SQL, Databricks experience preferred, bachelor's in CS/data engineering or equivalent, strong CI/CD, orchestration, and data governance skills.
Delta Lake, Databricks Auto Loader, Databricks, Structured Streaming, Change Data Capture (CDC), Unity Catalog, Spark, Photon, Databricks Workflows, Delta Live Tables, Airflow, MLflow, Presto, Flink, Git, Dagster, EMR, Dataproc, Lakeflow Spark Declarative Pipelines (SDP), ChatGPT
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer
Jersey City or Irving or New York or Tampa
$142k-$213k/yr HybridFull Time
Citi
CitiNYSE: C: Providing global banking, investment, and wealth management services.
5+ YOE5-8 years of data engineering experience; strong ETL, data warehousing, Python, Spark; AWS Glue, Snowflake; SQL databases; project experience.
AWS Glue, AWS Athena, Airflow, Snowflake, MongoDB, Oracle, PostgreSQL, Unix Shell, Python, PySpark, Ab Initio
Job PostingView all
1mo
Save
Mark Applied
Hide
Principal Data Engineer
New York, New York, United States
$170k-$200k/yr HybridFull Time
Quantexa
Quantexa: Develops decision intelligence software for data analytics and management.
8+ YOE5+ Mgmt8+ years in data engineering with 5+ years in lead roles; strong Scala/Java/Python skills; experience with Spark, Hadoop, Elasticsearch, cloud platforms, CI/CD tooling, production data pipelines, and mentoring teams.
Spark, Hadoop, Scala, Elasticsearch, Google Cloud, Microsoft Azure, Amazon, Java, Python, Git, Gradle, Nexus, Jenkins, Docker, Bash, ScalaTest
Job PostingView all
1w
Save
Mark Applied
Hide
Data Engineer, Clinical Operations
Princeton, New Jersey, United States
$88k-$106k/yr OnsiteFull Time
Bristol Myers Squibb
Bristol Myers SquibbNYSE: BMY: Develops and manufactures innovative prescription biopharmaceutical medicines.
5+ YOE5+ years data engineering experience with Databricks, cloud-native data platforms, Python/SQL/Spark, GenAI/LLM experience, data pipeline and governance expertise for clinical/cross-study data.
Generative AI, Databricks, Databricks Delta Lake, Databricks Unity Catalog, Databricks Workflows, Databricks Mosaic AI, MLflow, Python, SQL, Spark, PySpark, RAG, vector embeddings
Job PostingView all
2mo
Save
Mark Applied
Hide
Senior Data Engineer
New York City, New York, United States
$160k-$250k/yr OnsiteFull Time
Linero
Linero: AI-native, venture-backed building data infrastructure software.
5+ YOE5+ years data engineering; Airflow, dbt, Spark; streaming and batch processing; ontology design; multi-tenant, high-security data environments; based in or relocate to New York City.
Airflow, dbt, Spark
Job PostingView all
2mo
Save
Mark Applied
Hide
AI Data Engineer
New York or United States
RemoteFull Time
C the Signs
C the Signs: AI-powered clinical decision support platform for early cancer detection.
Bachelor's in CS/Engineering; data engineering experience; Python/Scala/Java; ETL, data warehousing, data modeling; cloud (AWS/GCP/Azure); Spark; strong problem-solving and communication.
Python, Scala, Java, Apache Spark, AWS, GCP, Azure, Airflow
Job PostingView all
2w
Save
Mark Applied
Hide
Data Engineer, Data Architecture and Engineering, gData
Sunnyvale or Boulder or New York City
$130k-$188k/yr OnsiteFull Time
Google
GoogleNASDAQ: GOOGL: Provides online search, advertising, cloud computing, and consumer electronics.
3+ YOEBachelor's in CS/Math/related or equivalent; 3+ years with data processing (Hadoop, Spark, Pig, Hive), DB administration or data engineering, software experience in Java/C++/Python/Go/JavaScript, and client-facing project experience.
Hadoop, Spark, Pig, Hive, MapReduce, Flume, Java, C++, Python, Go, JavaScript, Advanced SQL, ETL/ELT, NoSQL, AI technologies
Job PostingView all
1d
Save
Mark Applied
Hide
Senior Engineer, Data Platform Technology
New York, New York, United States
$175k-$225k/yr OnsiteFull Time
Balyasny Asset Management
Balyasny Asset Management: Global multi-strategy investment firm managing diverse alternative asset classes.
3+ YOE3+ years data engineering experience; strong Python, SQL, Spark; Snowflake and cloud (AWS/Azure/GCP) experience; pipeline orchestration and data quality expertise.
Python, SQL, Spark, NoSQL, Snowflake, Hive, Hadoop, Airflow, Luigi, Oozie, NiFi, AWS, Azure, Google Cloud, Go
Job PostingView all
1w
Save
Mark Applied
Hide
Principal Data Engineer - Semantic Layer
Cary or Tampa or New York City or Bridgewater
$130k-$189k/yr HybridFull Time
MetLife
MetLifeNYSE: MET: Global provider of insurance, annuities, and financial services.
10+ YOE10+ years in data engineering/architecture with 3+ years in semantic layer/ontology engineering; expertise with OWL/RDF/SPARQL, cloud data platforms, SQL/NoSQL, Python, and Spark; Bachelor's degree required.
OWL, RDF, SPARQL, Stardog, Timbr.ai, AtScale, dbt Semantic Layer, Databricks, Microsoft Fabric, Azure Databricks, Azure Synapse Analytics, Delta Lake, Power BI, Cognos Analytics, JDBC, ODBC, MDX, DAX, REST, GraphQL, Collibra, SQL, NoSQL, Python, Spark, Cypher, HermiT, Pellet, RDFox, Apache Jena, GraphDB, Amazon Neptune
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Data Engineer
New York City or Sunnyvale or Bellevue
$182k-$242k/yr OnsiteFull Time
CoreWeave
CoreWeaveNASDAQ: CRWV: Cloud platform providing GPU-accelerated infrastructure for AI workloads.
5+ YOE5+ years building analytical data models and production data systems; expertise in Python/Scala/Rust, advanced SQL, Spark/Flink, lakehouse technologies, and dimensional modeling for OLAP workloads.
Python, Scala, Rust, SQL, Spark, Flink, Iceberg, Delta, StarRocks, ClickHouse, Trino, Kafka, AutoMQ, Pulsar, Kubernetes
Job PostingView all
1w
Save
Mark Applied
Hide
Data Engineer, Clinical Operations
Princeton, New Jersey, United States
$88k-$106k/yr OnsiteFull Time
Bristol Myers Squibb
Bristol Myers SquibbNew York Stock Exchange: BMY: Develops and distributes innovative medicines for serious diseases.
5+ YOE5+ years data engineering experience with cloud platforms, Databricks (Delta Lake, Unity Catalog), Python, SQL, Spark/PySpark, GenAI/LLM (RAG, embeddings), and building production-grade ETL/ELT pipelines and data products.
Generative AI (GenAI), Databricks, Databricks Delta Lake, Databricks Unity Catalog, Databricks Workflows, Databricks Mosaic AI, MLflow, Python, SQL, Spark, PySpark, RAG, LLM
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Data Engineer - Infra
London or Tel Aviv or Singapore or New York City
HybridFull Time
Solidus Labs
Solidus Labs: Provides market integrity and risk monitoring software for crypto.
8+ YOEBSc in Computer Science; 8+ years in data engineering; 5+ years software engineering with Java, Rust, or Python; deep ClickHouse expertise; experience with Kafka, Spark, Airflow, Kubernetes, Redis, Snowflake, Prometheus/Grafana, and advanced SQL.
ClickHouse, ReplacingMergeTree, CollapsingMergeTree, Apache Kafka, Spark, Airflow, Kubernetes, Redis, Snowflake, Prometheus, Grafana, Java, Rust, Python, SQL
Job PostingView all
1w
Save
Mark Applied
Hide
Data Scientist & Engineer
New York, New York, United States
$85k-$110k/yr OnsiteFull Time
NYU Langone Health
NYU Langone Health: Academic medical system providing comprehensive patient care and education.
3+ YOEMaster's in a quantitative field and 3 years' data science/machine learning experience; proficiency in Python or R, scikitlearn, big data tools (Hadoop/Spark), SQL and NoSQL; strong software engineering, deployment, and communication skills.
Python, R, scikitlearn, Hadoop, MapReduce, Spark, SQL, MongoDB
Job PostingView all
2w
Save
Mark Applied
Hide
Data Engineer - AVP
Whippany, New Jersey, United States
$190k-$195k/yr OnsiteFull Time
Barclays
BarclaysLondon Stock Exchange: BARC: Global bank providing retail, corporate, and investment financial services.
Experience building Java-based data pipelines, data warehouses and lakes; strong skills in Java, Spark, Kafka, Kubernetes, OAuth2/JWT, JUnit, Mockito, GitLab/Bitbucket; experience leading technical teams and ensuring data governance and observability.
Java, Spark, Kafka, Kubernetes, OAuth2, JWT, JUnit, Mockito, GitLab, Bitbucket
Job PostingView all
3mo
Save
Mark Applied
Hide
Data Engineer
New York, New York, United States
RemoteFull Time
Nscale
Nscale: Vertically integrated AI infrastructure provider for high-performance computing.
Deep data engineering with Palantir Foundry, Python, and data pipeline design; experience with data modeling, governance, and API integration.
Palantir Foundry, Python, Spark, PySpark, Dask, pandas, REST, GraphQL, Foundry Action APIs, Git, CI/CD
Job PostingView all

Explore Jobs

Expand Your Job Search