HiringCafe
Join our community

375 spark data engineer jobs at 179 companies in Plainfield, NJ

1mo
Save
Mark Applied
Hide
Data Engineer
New York City or San Francisco
OnsiteFull Time
Bedrock Robotics
Bedrock Robotics: Automates heavy construction machinery with AI retrofit kits.
5+ YOE5+ years data engineering experience in large-scale data lake/warehouse environments; strong SQL and distributed query engine experience; pipeline orchestration (Airflow/Prefect) and Spark/Databricks experience; data quality and observability expertise.
SQL, Spark, BigQuery, Snowflake, Airflow, Prefect, Databricks
Job PostingView all
2mo
Save
Mark Applied
Hide
Sr Data Engineer, Python + Spark (Data Federation skillset - Data Lakehouse - Eg: Starburst) - New York
New York, New York, United States
$40k-$140k/yr OnsiteFull Time
Photon: Global technology services provider.
5+ YOESenior Data Engineer with 5+ years in Python, Spark; expertise in data federation, lakehouse architectures (Delta Lake/Iceberg/Hudi); Starburst/Trino/Dremio; cloud platforms (AWS/Azure/GCP); strong SQL and data modeling.
Python, Apache Spark, Starburst Enterprise, Trino (Presto), Dremio, Delta Lake, Iceberg, Hudi, AWS, S3, Glue, Azure Databricks, ADLS, GCP, SQL, Medallion Architecture, Starburst/Trino
Job PostingView all
6d
Save
Mark Applied
Hide
Data Engineer
Atlanta or New York City
$116k-$145k/yr HybridFull Time
FanDuel
FanDuelNYSE: FLUT: Offers online sports betting and daily fantasy sports services.
3+ YOE3+ years in data or software engineering with strong SQL, Python/Java/Scala, Databricks, Airflow, dbt, Spark, Kafka, and cloud (AWS/GCP/Azure) experience.
Python, SQL, Spark, Databricks, Airflow, dbt, Kafka, Java, Scala, AWS, GCP, Azure
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Data Engineer
United States or San Francisco or New York City or Washington or Austin
$118k-$179k/yr RemoteFull Time
Samsara
SamsaraNYSE: IOT: Connected Operations Cloud platform for physical operations and IoT.
8+ YOEBachelor's in CS or equivalent, 8+ years as a software/data engineer, 5+ years building production data pipelines and Spark/PySpark experience, strong Python and SQL, cloud data warehouse and ETL tooling experience.
Spark, PySpark, Databricks, Python, SQL, Snowflake, Google BigQuery, Apache Iceberg, Fivetran, dbt, NetSuite, Salesforce, MySQL, AWS RDS/Aurora, PostgreSQL, Oracle, Microsoft SQL Server, AWS, Azure, GCP, Splunk, Datadog, AWS CloudWatch, API Gateway, Lambda, S3, SNS, SQS, SecretsManager, MCP (Model Context Protocol)
Job PostingView all
1d
Save
Mark Applied
Hide
Databricks Data Engineer
Jersey City or United States
$65k-$87k/yr HybridFull Time
EXL
EXLNASDAQ: EXLS: Provides data analytics and digital operations solutions to businesses.
10+ YOE10+ years data engineering experience with Databricks, Spark, Delta Lake and Azure Data Platform; strong Python/PySpark and SQL skills; experience with CI/CD, REST APIs, CDC/SCD, and data quality frameworks.
Databricks, Spark, Delta Lake, Unity Catalog, Databricks Workflows, SQL Warehouses, PySpark, Spark SQL, SQL, Python, Azure Data Lake Storage (ADLS Gen2), Azure Synapse, Azure Key Vault, Azure DevOps, Git, Ab Initio, REST APIs, JSON, XML
Job PostingView all
2w
Save
Mark Applied
Hide
Senior Data Engineer
North Hollywood or New York
$140k-$160k/yr HybridFull Time
Versant
VersantNasdaq: VSNT: Operates cable television networks and digital media entertainment platforms.
5+ YOE5+ years building production data pipelines with Spark-based platforms, expertise in PySpark and SQL, Databricks experience preferred, bachelor's in CS/data engineering or equivalent, strong CI/CD, orchestration, and data governance skills.
Delta Lake, Databricks Auto Loader, Databricks, Structured Streaming, Change Data Capture (CDC), Unity Catalog, Spark, Photon, Databricks Workflows, Delta Live Tables, Airflow, MLflow, Presto, Flink, Git, Dagster, EMR, Dataproc, Lakeflow Spark Declarative Pipelines (SDP), ChatGPT
Job PostingView all
1w
Save
Mark Applied
Hide
Snowflake Data Engineer
Teaneck, New Jersey, United States
OnsiteFull Time
Cognizant
CognizantNasdaq: CTSH: Provides global information technology and business process outsourcing services.
5+ YOE5+ years data engineering experience; strong Python, SQL, Spark; experience with Snowflake, DBT and AWS/Azure; exposure to real-time streaming (Kafka/Kinesis); collaborate with data science and analytics teams.
Python, SQL, Spark, AWS, Azure, Snowflake, DBT, Kafka, Kinesis
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer
Jersey City or Irving or New York or Tampa
$142k-$213k/yr HybridFull Time
Citi
CitiNYSE: C: Providing global banking, investment, and wealth management services.
5+ YOE5-8 years of data engineering experience; strong ETL, data warehousing, Python, Spark; AWS Glue, Snowflake; SQL databases; project experience.
AWS Glue, AWS Athena, Airflow, Snowflake, MongoDB, Oracle, PostgreSQL, Unix Shell, Python, PySpark, Ab Initio
Job PostingView all
1mo
Save
Mark Applied
Hide
Principal Data Engineer
New York, New York, United States
$170k-$200k/yr HybridFull Time
Quantexa
Quantexa: Develops decision intelligence software for data analytics and management.
8+ YOE5+ Mgmt8+ years in data engineering with 5+ years in lead roles; strong Scala/Java/Python skills; experience with Spark, Hadoop, Elasticsearch, cloud platforms, CI/CD tooling, production data pipelines, and mentoring teams.
Spark, Hadoop, Scala, Elasticsearch, Google Cloud, Microsoft Azure, Amazon, Java, Python, Git, Gradle, Nexus, Jenkins, Docker, Bash, ScalaTest
Job PostingView all
3w
Save
Mark Applied
Hide
Data Engineer, Clinical Operations
Princeton, New Jersey, United States
$88k-$106k/yr OnsiteFull Time
Bristol Myers Squibb
Bristol Myers SquibbNYSE: BMY: Develops and manufactures innovative prescription biopharmaceutical medicines.
5+ YOE5+ years data engineering experience with Databricks, cloud-native data platforms, Python/SQL/Spark, GenAI/LLM experience, data pipeline and governance expertise for clinical/cross-study data.
Generative AI, Databricks, Databricks Delta Lake, Databricks Unity Catalog, Databricks Workflows, Databricks Mosaic AI, MLflow, Python, SQL, Spark, PySpark, RAG, vector embeddings
Job PostingView all
6d
Save
Mark Applied
Hide
Data Engineer
Manhattan or United States
$140k-$180k/yr RemoteFull Time
Reality Defender
Reality Defender: Detects deepfakes and AI-generated media to identify fraud.
Hands-on experience with Kubernetes and AWS, distributed computing (Spark, Ray), workflow orchestration (Airflow), Python and SQL; experience building multi-terabyte and streaming data pipelines for audio/video is preferred.
Kubernetes, AWS, Spark, Ray, Airflow, Dagster, Prefect, Luigi, Python, SQL, Golang
Job PostingView all
1d
Save
Mark Applied
Hide
Databricks Data Engineer
United States or Arlington or Tysons or Washington or New York City or Chicago or Austin or Atlanta or Boston or Boulder
$113k-$188k/yr RemoteFull Time
Guidehouse
Guidehouse: Provides management and technology consulting services to diverse organizations.
3+ YOEBachelor's degree,3+ years data engineering experience,proficiency with Python/PySpark/SQL,Databricks/Spark/Delta Lake experience,knowledge of data pipelines,governance,and cloud platforms.
Databricks, PySpark, Python, SQL, Delta Lake, Unity Catalog, Spark, CI/CD, Terraform, Azure, AWS, GCP
Job PostingView all
3mo
Save
Mark Applied
Hide
AI Data Engineer
New York or United States
RemoteFull Time
C the Signs
C the Signs: AI-powered clinical decision support platform for early cancer detection.
Bachelor's in CS/Engineering; data engineering experience; Python/Scala/Java; ETL, data warehousing, data modeling; cloud (AWS/GCP/Azure); Spark; strong problem-solving and communication.
Python, Scala, Java, Apache Spark, AWS, GCP, Azure, Airflow
Job PostingView all
2mo
Save
Mark Applied
Hide
Senior Data Engineer
New York City, New York, United States
$160k-$250k/yr OnsiteFull Time
Linero
Linero: AI-native, venture-backed building data infrastructure software.
5+ YOE5+ years data engineering; Airflow, dbt, Spark; streaming and batch processing; ontology design; multi-tenant, high-security data environments; based in or relocate to New York City.
Airflow, dbt, Spark
Job PostingView all
4w
Save
Mark Applied
Hide
Data Engineer, Data Architecture and Engineering, gData
Sunnyvale or Boulder or New York City
$130k-$188k/yr OnsiteFull Time
Google
GoogleNASDAQ: GOOGL: Provides online search, advertising, cloud computing, and consumer electronics.
3+ YOEBachelor's in CS/Math/related or equivalent; 3+ years with data processing (Hadoop, Spark, Pig, Hive), DB administration or data engineering, software experience in Java/C++/Python/Go/JavaScript, and client-facing project experience.
Hadoop, Spark, Pig, Hive, MapReduce, Flume, Java, C++, Python, Go, JavaScript, Advanced SQL, ETL/ELT, NoSQL, AI technologies
Job PostingView all
1w
Save
Mark Applied
Hide
Senior Engineer, Data Platform Technology
New York, New York, United States
$175k-$225k/yr OnsiteFull Time
Balyasny Asset Management
Balyasny Asset Management: Global multi-strategy investment firm managing diverse alternative asset classes.
3+ YOE3+ years data engineering experience; strong Python, SQL, Spark; Snowflake and cloud (AWS/Azure/GCP) experience; pipeline orchestration and data quality expertise.
Python, SQL, Spark, NoSQL, Snowflake, Hive, Hadoop, Airflow, Luigi, Oozie, NiFi, AWS, Azure, Google Cloud, Go
Job PostingView all
5h
Save
Mark Applied
Hide
Senior Data Engineer, Big Data and Cloud
New York, New York, United States
$105k-$190k/yr HybridFull Time
Vistar Media
Vistar Media: Operates a programmatic marketplace for digital out-of-home advertising.
4+ YOE4+ years experience building scalable big-data pipelines using Python, Spark, SQL, cloud (GCP), Airflow and Kafka; strong software engineering, data architecture, and geospatial experience preferred.
Python, Spark, Scala, SQL, pandas, scikit-learn, scipy, numpy, GCP, Airflow, Kafka, Google BigQuery
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Data Engineer
New York City or Sunnyvale or Bellevue
$182k-$242k/yr OnsiteFull Time
CoreWeave
CoreWeaveNASDAQ: CRWV: Cloud platform providing GPU-accelerated infrastructure for AI workloads.
5+ YOE5+ years building analytical data models and production data systems; expertise in Python/Scala/Rust, advanced SQL, Spark/Flink, lakehouse technologies, and dimensional modeling for OLAP workloads.
Python, Scala, Rust, SQL, Spark, Flink, Iceberg, Delta, StarRocks, ClickHouse, Trino, Kafka, AutoMQ, Pulsar, Kubernetes
Job PostingView all
3w
Save
Mark Applied
Hide
Data Engineer, Clinical Operations
Princeton, New Jersey, United States
$88k-$106k/yr OnsiteFull Time
Bristol Myers Squibb
Bristol Myers SquibbNew York Stock Exchange: BMY: Develops and distributes innovative medicines for serious diseases.
5+ YOE5+ years data engineering experience with cloud platforms, Databricks (Delta Lake, Unity Catalog), Python, SQL, Spark/PySpark, GenAI/LLM (RAG, embeddings), and building production-grade ETL/ELT pipelines and data products.
Generative AI (GenAI), Databricks, Databricks Delta Lake, Databricks Unity Catalog, Databricks Workflows, Databricks Mosaic AI, MLflow, Python, SQL, Spark, PySpark, RAG, LLM
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Data Engineer - Infra
London or Tel Aviv or Singapore or New York City
HybridFull Time
Solidus Labs
Solidus Labs: Provides market integrity and risk monitoring software for crypto.
8+ YOEBSc in Computer Science; 8+ years in data engineering; 5+ years software engineering with Java, Rust, or Python; deep ClickHouse expertise; experience with Kafka, Spark, Airflow, Kubernetes, Redis, Snowflake, Prometheus/Grafana, and advanced SQL.
ClickHouse, ReplacingMergeTree, CollapsingMergeTree, Apache Kafka, Spark, Airflow, Kubernetes, Redis, Snowflake, Prometheus, Grafana, Java, Rust, Python, SQL
Job PostingView all

Explore Jobs

Expand Your Job Search