456 spark data engineer jobs at 173 companies in Secaucus, NJ
1mo
Save
Mark Applied
Hide
1mo
Lead Data Engineer (Python, AWS, Spark, Kafka, SQL, Snowflake, Databricks, GenAI)
McLean or New York City or Richmond
$179k-$246k/yrOnsiteFull Time
Capital OneNYSE: COF: A technology-driven bank providing diverse financial services.
4+ YOEBachelor's degree, 4+ years application development, 2+ years big data, 1+ year cloud (AWS/Azure/GCP); experience with Python, SQL, Spark, data modeling, and cloud data platforms.
Amalgamated Bank: Socially responsible commercial bank serving nonprofits, labor unions, advocacy groups, businesses, and individuals through banking and investment services.
2+ YOEBachelor's degree or equivalent experience; 2+ years of data engineering experience preferred, with Databricks, SQL, Python, Spark, Azure, ETL, and data architecture expertise.
Bedrock Robotics: Autonomous construction technology that retrofits heavy equipment into autonomous machines for general contractors.
5+ YOE5+ years data engineering experience in large-scale data lake/warehouse environments; strong SQL and distributed query engine experience; pipeline orchestration (Airflow/Prefect) and Spark/Databricks experience; data quality and observability expertise.
FanDuel: American sports-tech gaming offering sports betting, daily fantasy, horse racing, casino, and sports media to fans.
3+ YOE3+ years in data or software engineering with strong SQL, Python/Java/Scala, Databricks, Airflow, dbt, Spark, Kafka, and cloud (AWS/GCP/Azure) experience.
Sr Data Engineer, Python + Spark (Data Federation skillset - Data Lakehouse - Eg: Starburst) - New York
New York, New York, United States
$40k-$140k/yrOnsiteFull Time
Photon Interactive: Full-service digital agency driving AI-led digital transformation.
5+ YOESenior Data Engineer with 5+ years in Python, Spark; expertise in data federation, lakehouse architectures (Delta Lake/Iceberg/Hudi); Starburst/Trino/Dremio; cloud platforms (AWS/Azure/GCP); strong SQL and data modeling.
Bank of AmericaNYSE: BAC: Global financial services and banking institution.
5+ YOEBachelor's degree and 5+ years of data engineering experience required. Advanced SQL, Python, Spark, ETL, Airflow, data lake architecture, analytical, communication, and collaboration skills required.
Python, Spark, SQL, Apache Airflow, dbt, Git, Snowflake, Databricks, Delta Lake, HDFS, Hive, Oracle Exadata, SQL Server, Teradata, SSIS, Kafka, Tableau, Microsoft Power BI, SSRS, SSAS, CI/CD
United States or San Francisco or New York City or Washington or Austin
$118k-$179k/yrRemoteFull Time
SamsaraNYSE: IOT: Connected Operations Cloud platform for physical operations.
8+ YOEBachelor's in CS or equivalent, 8+ years as a software/data engineer, 5+ years building production data pipelines and Spark/PySpark experience, strong Python and SQL, cloud data warehouse and ETL tooling experience.
Versant Media GroupNasdaq: VSNT: Media and entertainment managing diverse content and digital brands.
5+ YOE5+ years building production data pipelines with Spark-based platforms, expertise in PySpark and SQL, Databricks experience preferred, bachelor's in CS/data engineering or equivalent, strong CI/CD, orchestration, and data governance skills.
Delta Lake, Databricks Auto Loader, Databricks, Structured Streaming, Change Data Capture (CDC), Unity Catalog, Spark, Photon, Databricks Workflows, Delta Live Tables, Airflow, MLflow, Presto, Flink, Git, Dagster, EMR, Dataproc, Lakeflow Spark Declarative Pipelines (SDP), ChatGPT
The Leading Hotels of the World: Member-owned luxury hotel marketing and distribution organization serving independent hotels worldwide.
7+ YOE7+ years in data engineering; Snowflake/BigQuery/Redshift/Databricks; ETL/ELT tools (Airflow, dbt, Spark); SQL and Python; large-scale data processing; data governance and security; strong cross-functional communication.
Belfast or Toronto or London or New York City or India
HybridFull Time
TD Securities: Securities is a private investment bank serving corporate, government, and institutional clients with capital-markets services.
10+ YOE10+ years in data engineering or related technology roles; hands-on Databricks, Spark/PySpark, Python, SQL, Delta Lake, Azure, and ADLS experience; expertise in scalable pipelines, governed data products, CI/CD, monitoring, and data quality.
United States or Canada or Toronto or New York City
$80k-$90k/yrRemoteFull Time
Fluent, Inc.NASDAQ: FLNT: Public commerce media helping brands acquire customers and partners monetize high-intent commerce moments.
4+ YOEBachelor's or Master's in computer science or related field, 4+ years of data engineering experience, 2+ years with Databricks, and expertise in SQL, Python, Spark, distributed processing, and database design.
Bristol Myers SquibbNYSE: BMY: Transforming patients' lives through science.
5+ YOE5+ years data engineering experience with Databricks, cloud-native data platforms, Python/SQL/Spark, GenAI/LLM experience, data pipeline and governance expertise for clinical/cross-study data.
IBMNYSE: IBM: Global technology and consulting focusing on cloud and AI.
Currently pursuing a quantitative degree; familiarity with Python or scripting, data integration, statistical analysis, databases, SQL, Spark, cloud platforms, and data engineering; willingness to travel.
Python, SQL, Spark, IBM Cloud, Microsoft Azure, Amazon Web Services (AWS), Snowflake, Databricks, JavaScript
Point72 Asset Management: Global alternative investment firm utilizing fundamental and systematic strategies.
3+ YOERequires 3+ years in data engineering or a related field, strong Python development, experience with Spark or Scala, big data technology knowledge, and innovative problem-solving skills.
Lead Data Engineer (Python, AWS, Spark, Kafka, SQL, Snowflake, Databricks, GenAI)
Richmond or McLean or New York City
$179k-$246k/yrOnsiteFull Time
Capital OneNYSE: COF: A technology-driven bank providing diverse financial services.
4+ YOEBachelor's degree, 4+ years of application development, 2+ years with big data technologies, and 1+ year with cloud computing. Preferred experience includes Python, SQL, Spark, AWS, streaming, data warehousing, and AI tools.
United States or Arlington or Tysons or Washington or New York City or Chicago or Austin or Atlanta or Boston or Boulder
$113k-$188k/yrRemoteFull Time
Guidehouse: Global consulting firm serving public and commercial sectors.
3+ YOEBachelor's degree,3+ years data engineering experience,proficiency with Python/PySpark/SQL,Databricks/Spark/Delta Lake experience,knowledge of data pipelines,governance,and cloud platforms.
United States or San Francisco or New York City or Chicago
$170k-$230k/yrHybridFull Time
Komodo Health: Privately held healthcare AI and real-world data analytics serving Life Sciences and healthcare organizations.
Experience building production data pipelines at scale with advanced Python, SQL, Airflow, Spark, and AWS; healthcare data expertise and strong data quality, reliability, troubleshooting, and collaboration skills required.
Linero: AI-native software building operational infrastructure for AI labs, defense primes, and semiconductor giants.
5+ YOE5+ years data engineering; Airflow, dbt, Spark; streaming and batch processing; ontology design; multi-tenant, high-security data environments; based in or relocate to New York City.
Mizuho Financial GroupTokyo Stock Exchange: 8411: Japanese publicly traded bank holding providing banking, securities, trust, asset-management, and research services.
0+ YOERequires 0–2 years in data engineering, analytics, or related technical work; SQL, Python, OOP, data concepts, and bachelor's degree in a related field. Experience with Databricks, Spark, cloud, ETL, and databases is valued.
Databricks, Microsoft Azure, Apache Spark, PySpark, SQL, Python, Git, Delta Lake, Amazon Web Services (AWS), Google Cloud Platform (GCP), Scala, SSIS, Azure Data Factory, Kafka