HiringCafe
Join our community

50 data lake engineer jobs at 34 companies in Wayne, NJ

1mo
Save
Mark Applied
Hide
Staff Data Engineer- Data Lake
New York, New York, United States
$170k-$190k/yr HybridFull Time
H1
H1: Data platform for healthcare professional insights and drug development.
8+ YOE8+ years building and scaling distributed data platforms; technical leadership and mentoring; strong Python (PySpark), Java/Scala, advanced SQL, Apache Spark, cloud-native big data (AWS EMR/Glue/S3/Athena/Redshift), orchestration (Argo/Airflow), containerization, observability, and experience with large-scale ingestion and data quality.
Apache Spark, Argo, Athena, Avro, CircleCI, Claude Code, Docker, EMR, Elastic MapReduce (EMR), Git, GitHub Copilot, Hudi, Java, JIRA, Kinesis, Kafka, Kubernetes, Ky, MAT, Microsoft Excel, Parquet, PySpark, Python, Redshift, S3, Scala, Spark, SQL, Delta, Glue, Airflow
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer
New York City or San Francisco
OnsiteFull Time
Bedrock Robotics
Bedrock Robotics: Automates heavy construction machinery with AI retrofit kits.
5+ YOE5+ years data engineering experience in large-scale data lake/warehouse environments; strong SQL and distributed query engine experience; pipeline orchestration (Airflow/Prefect) and Spark/Databricks experience; data quality and observability expertise.
SQL, Spark, BigQuery, Snowflake, Airflow, Prefect, Databricks
Job PostingView all
2mo
Save
Mark Applied
Hide
Data Engineer
Princeton, New Jersey, United States
$100k-$120k/yr HybridFull Time
CURE Auto Insurance
CURE Auto Insurance: Provides automobile insurance based primarily on individual driving records.
3+ YOEDesign, build, and maintain data pipelines; integrate core insurance data; ensure data quality and governance; develop data lake/warehouse.
Python, SQL, Snowflake, BigQuery, Redshift, Databricks, Spark, dbt, Great Expectations, Kafka, Kinesis, Debezium, Fivetran, HVR
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer
Bengaluru or San Francisco or Boston or New York City or Austin or Tokyo or London
HybridFull Time
Postman
Postman: Platform for building, testing, and managing software APIs.
3+ YOE3-5 years data engineering experience; advanced SQL; proficiency in Python/JavaScript/Golang; familiarity with cloud platforms (AWS preferred) and Redshift/Databricks/ClickHouse; data lake performance knowledge; strong problem-solving.
SQL, Python, JavaScript, Golang, AWS, Azure, Google Cloud, Redshift, Databricks, ClickHouse, dbt, singer-taps, ETL, BI tools
Job PostingView all
5h
Save
Mark Applied
Hide
Data Engineer
New York City, New York, United States
$106k-$150k/yr RemoteFull Time
Municipal Credit Union
Municipal Credit Union: Provides banking and financial services to members in New York.
6+ YOEBachelor's degree or equivalent with 6-8 years experience, strong SQL and data pipeline skills (Fabric, Azure Data Factory), cloud data lake/warehouse experience (Azure Synapse/Cosmos), .NET/C#, and data quality/ETL expertise.
SQL, Fabric, Azure Data Factory, Azure, Azure Synapse, Azure Cosmos DB, Azure DevOps, .NET, C#, Microsoft SQL Server, SSIS, Crystal Reports, Symitar, PowerOn, SymXchange, OpCon, ARCU, SharePoint
Job PostingView all
2mo
Save
Mark Applied
Hide
Staff Data Engineer
New York, New York, United States
OnsiteFull Time
Twenty
Twenty: Develops autonomous systems for offensive cyber operations.
8+ YOE8+ years in data engineering/architecture; expertise in ETL pipelines, data lakes, schema/index design, columnar databases; proven leadership; US citizenship.
Apache Iceberg, Delta Lake, Apache Hive, Trino, Presto, AWS Athena, Apache Spark, ClickHouse, Amazon Redshift, Google BigQuery, Airflow, AWS Glue, NiFi, ClickPipe, Kafka, RabbitMQ, NATS, AWS Kinesis, Neo4j, AWS Neptune, Memgraph, Apache AGE
Job PostingView all
2mo
Save
Mark Applied
Hide
Staff Data Engineer
New York City or Tarrytown or San Diego or United Kingdom or Argentina
RemoteFull Time
Exactera
Exactera: AI-powered corporate tax compliance and transfer pricing software.
5+ YOE5+ years in data engineering; SQL, Python, PySpark; Databricks (Delta Lake, Workflows, Unity Catalog); AWS; Terraform; data governance; onshore technical leadership.
SQL, Python, PySpark, Databricks, Delta Lake, Workflows, Unity Catalog, AWS, S3, IAM, VPC, Terraform, data governance
Job PostingView all
2mo
Save
Mark Applied
Hide
Senior Data Engineer
New York or New York
OnsiteFull Time
Polymarket
Polymarket: A decentralized platform for trading on real-world event outcomes.
5+ YOE5+ years data engineering; OLTP/OLAP split; columnar warehouses; data lake; streaming; PostgreSQL at scale; SQL fluency; distributed systems; DOM plus Rust/Python is a plus.
ClickHouse, Snowflake, BigQuery, Redshift, Apache Pinot, Parquet, Iceberg, Delta, Hudi, Kafka, S3, PostgreSQL, Python, Rust, Prometheus
Job PostingView all
2w
Save
Mark Applied
Hide
Data Engineer, Clinical Operations
Princeton, New Jersey, United States
$88k-$106k/yr OnsiteFull Time
Bristol Myers Squibb
Bristol Myers SquibbNew York Stock Exchange: BMY: Develops and distributes innovative medicines for serious diseases.
5+ YOE5+ years data engineering experience with cloud platforms, Databricks (Delta Lake, Unity Catalog), Python, SQL, Spark/PySpark, GenAI/LLM (RAG, embeddings), and building production-grade ETL/ELT pipelines and data products.
Generative AI (GenAI), Databricks, Databricks Delta Lake, Databricks Unity Catalog, Databricks Workflows, Databricks Mosaic AI, MLflow, Python, SQL, Spark, PySpark, RAG, LLM
Job PostingView all
2w
Save
Mark Applied
Hide
Data Engineer - AVP
Whippany, New Jersey, United States
$190k-$195k/yr OnsiteFull Time
Barclays
BarclaysLondon Stock Exchange: BARC: Global bank providing retail, corporate, and investment financial services.
Experience building Java-based data pipelines, data warehouses and lakes; strong skills in Java, Spark, Kafka, Kubernetes, OAuth2/JWT, JUnit, Mockito, GitLab/Bitbucket; experience leading technical teams and ensuring data governance and observability.
Java, Spark, Kafka, Kubernetes, OAuth2, JWT, JUnit, Mockito, GitLab, Bitbucket
Job PostingView all
2w
Save
Mark Applied
Hide
Databricks Data Engineer
New York, New York, United States
$59k-$75k/yr OnsiteFull Time, Temporary
Capgemini
CapgeminiEuronext Paris: CAP: Provides global IT consulting and digital transformation services.
Design and optimize scalable Databricks/Spark pipelines, build lakehouse solutions with Iceberg/Delta Lake, integrate backend data services, work in Agile, and communicate with technical and business stakeholders.
Databricks, Unity Catalog, Delta Live Tables, Workflows, Asset Bundles, Apache Spark, Scala, Apache Iceberg, Delta Lake
Job PostingView all
1mo
Save
Mark Applied
Hide
Staff / Principal Data Engineer
New York, New York, United States
$180k-$270k/yr HybridFull Time
Appgate
Appgate: Provides zero trust cybersecurity and AI-driven fraud prevention solutions.
Extensive experience building and operating large-scale data platforms and lakes; hands-on expertise with Apache Spark and Apache Flink; strong production engineering skills including Kubernetes and CI/CD; experience with batch and streaming pipelines.
Apache Spark, Apache Flink, Kubernetes, CI/CD
Job PostingView all
2w
Save
Mark Applied
Hide
Senior Data Engineer
Los Angeles or New York City or United States or India
$185k-$200k/yr HybridFull Time
Fuel Cycle
Fuel Cycle: Cloud platform for market research and customer feedback analysis.
5+ YOE5+ years building production Databricks lakehouses; strong PySpark, Python, SQL; experience with Unity Catalog, Delta Lake, dbt, orchestrators (Dagster/Prefect/Workflows), and AWS data services.
Databricks, Unity Catalog, Delta Live Tables, Databricks SQL, Workflows, Delta Lake, dbt, PySpark, Python, MySQL, PostgreSQL, Dagster, Prefect, Databricks Workflows, Databricks Vector Search, pgvector, Amazon OpenSearch, Amazon Bedrock, AgentCore, Strands, OpenMetadata, S3, IAM, Databricks Asset Bundles, Terraform, Apache Iceberg, AWS Glue, Athena, DynamoDB, SQL
Job PostingView all
1mo
Save
Mark Applied
Hide
Cloud Data Engineer
Jersey City or United States
OnsiteFull Time
EXL
EXLNASDAQ: EXLS: Provides data analytics and digital operations solutions to businesses.
6+ YOE6+ years data engineering experience with AWS (Glue, Redshift, S3, Lambda, EMR/Spark, Kinesis, Athena, RDS, API Gateway), Python and SQL proficiency, experience with data lakes/warehouses, ETL/ELT, DevOps/CI/CD, and leadership/mentoring skills.
AWS, Glue, Redshift, S3, Lambda, EMR/Spark, Kinesis, Athena, RDS, API Gateway, Python, SQL, Shell, Scala, CloudFormation, Terraform, CI/CD
Job PostingView all
2w
Save
Mark Applied
Hide
Senior Manager, Data Engineer, Clinical Operations
Princeton, New Jersey, United States
$154k-$186k/yr OnsiteFull Time
Bristol Myers Squibb
Bristol Myers SquibbNYSE: BMY: Develops and manufactures innovative prescription biopharmaceutical medicines.
7+ YOE7+ years in data engineering/analytics with cloud experience; hands-on Databricks, Delta Lake, Unity Catalog, Python, SQL, Spark/PySpark, GenAI/LLM experience; strong stakeholder and clinical operations domain knowledge preferred.
Generative AI (GenAI), Databricks, Databricks Delta Lake, Databricks Unity Catalog, Databricks Workflows, Mosaic AI, MLflow, Python, SQL, Spark, PySpark, LLM, RAG, Veeva Vault, Medidata Rave, IRT
Job PostingView all
2mo
Save
Mark Applied
Hide
Healthcare Data Integration Engineer - ITS40
New York, New York, United States
$115k-$130k/yr RemoteFull Time
WellLife Network
WellLife Network: Providing behavioral health and disability support services.
3+ YOE3+ years API integrations and data engineering; Bachelor's in CS/IS/Data Science/SE/Healthcare Informatics; SQL, JSON, JavaScript, Qlik scripting, Power Automate/Power Fx; data lakes and AWS data warehouse experience; HIPAA awareness.
API integrations, SQL, JSON, JavaScript, Qlik scripting, Power Automate, Power Fx, AWS
Job PostingView all
2mo
Save
Mark Applied
Hide
Sr Data Engineer, Python + Spark (Data Federation skillset - Data Lakehouse - Eg: Starburst) - New York
New York, New York, United States
$40k-$140k/yr OnsiteFull Time
Photon: Global technology services provider.
5+ YOESenior Data Engineer with 5+ years in Python, Spark; expertise in data federation, lakehouse architectures (Delta Lake/Iceberg/Hudi); Starburst/Trino/Dremio; cloud platforms (AWS/Azure/GCP); strong SQL and data modeling.
Python, Apache Spark, Starburst Enterprise, Trino (Presto), Dremio, Delta Lake, Iceberg, Hudi, AWS, S3, Glue, Azure Databricks, ADLS, GCP, SQL, Medallion Architecture, Starburst/Trino
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Data Engineer (Azure & Databricks)
New York, New York, United States
OnsiteFull Time
Socotec
Socotec: Provides testing, inspection, and certification services for building safety.
3+ YOE3+ years Databricks experience; hands-on with Databricks, Apache Spark, Delta Lake; strong SQL and Python; experience designing enterprise-scale ETL/ELT pipelines and data models; MDM and cloud platform experience preferred.
Databricks, Apache Spark, Delta Lake, Python, SQL, AWS, Azure, GCP, Deltek, SAP, Oracle
Job PostingView all
2mo
Save
Mark Applied
Hide
Data Engineer - Guidewire
Edison, New Jersey, United States
$62k-$110k/yr RemoteFull Time
Greater New York Mutual Insurance
Greater New York Mutual Insurance: Provides commercial property and casualty insurance for businesses.
5+ YOEBachelor's degree; 5+ years IT experience; 3+ years data engineering; 2+ years Guidewire experience; strong SQL/ETL; Azure Databricks, Data Factory; Spark; Delta Lake; Power BI; Guidewire data model; CI/CD; Agile; data governance and security.
Azure Databricks, Azure Data Factory, Apache Spark, Delta Lake, Azure SQL Database, Azure Data Lake Storage Gen2, Azure Event Grid, Azure Key Vault, Power BI, Guidewire, Oracle, SQL Server, MySQL, CI/CD, Generative AI frameworks
Job PostingView all
2w
Save
Mark Applied
Hide
Staff Engineer, Data & Analytics
Chemnitz or New York City or Berlin or London or Sydney or Tokyo or Prague or Minneapolis or Saint Paul
HybridFull Time
Staffbase
Staffbase: Provides an AI-powered internal communications platform for employees.
Proven Staff Engineer-level experience in data engineering; strong architecture skills for data lakes, foundations, governance and orchestration; hands-on with streaming (Kafka) and Python; data modeling, stakeholder management, and people leadership.
Kafka, Python
Job PostingView all

Explore Jobs

Expand Your Job Search