HiringCafe
Join our community

41 data lake engineer jobs at 34 companies in New York

2mo
Save
Mark Applied
Hide
Staff Data Engineer- Data Lake
New York, New York, United States
$170k-$190k/yr HybridFull Time
H1
H1: AI-powered healthcare data platform helping life sciences, payers, providers, and patients identify and engage doctors.
8+ YOE8+ years building and scaling distributed data platforms; technical leadership and mentoring; strong Python (PySpark), Java/Scala, advanced SQL, Apache Spark, cloud-native big data (AWS EMR/Glue/S3/Athena/Redshift), orchestration (Argo/Airflow), containerization, observability, and experience with large-scale ingestion and data quality.
Apache Spark, Argo, Athena, Avro, CircleCI, Claude Code, Docker, EMR, Elastic MapReduce (EMR), Git, GitHub Copilot, Hudi, Java, JIRA, Kinesis, Kafka, Kubernetes, Ky, MAT, Microsoft Excel, Parquet, PySpark, Python, Redshift, S3, Scala, Spark, SQL, Delta, Glue, Airflow
Job PostingView all
2mo
Save
Mark Applied
Hide
Data Engineer
New York City or San Francisco
OnsiteFull Time
Bedrock Robotics
Bedrock Robotics: Autonomous construction technology that retrofits heavy equipment into autonomous machines for general contractors.
5+ YOE5+ years data engineering experience in large-scale data lake/warehouse environments; strong SQL and distributed query engine experience; pipeline orchestration (Airflow/Prefect) and Spark/Databricks experience; data quality and observability expertise.
SQL, Spark, BigQuery, Snowflake, Airflow, Prefect, Databricks
Job PostingView all
1w
Save
Mark Applied
Hide
Senior Data Engineer
Chicago or Austin or Dallas or New York City or San Francisco or Seattle
$147k-$181k/yr RemoteFull Time
JLL Technologies
JLL TechnologiesNYSE: JLL: 's commercial real estate technology division provides software, consulting, and managed services to property owners and occupiers.
5+ YOERequires 5+ years of data engineering experience, Python, SQL, PySpark, cloud data pipelines, data contracts or quality governance, Delta Lake or sharing technologies, API services, and mentoring experience.
Python, SQL, Azure, Delta Lake, Delta Sharing, PySpark, Spark UI, Databricks, Unity Catalog, Azure Data Factory, Event Hubs, CI/CD
Job PostingView all
2w
Save
Mark Applied
Hide
Sr Data Engineer
Charlotte or New York City
$125k-$145k/yr HybridFull Time
Bank of America
Bank of AmericaNYSE: BAC: Global financial services and banking institution.
5+ YOEBachelor's degree and 5+ years of data engineering experience required. Advanced SQL, Python, Spark, ETL, Airflow, data lake architecture, analytical, communication, and collaboration skills required.
Python, Spark, SQL, Apache Airflow, dbt, Git, Snowflake, Databricks, Delta Lake, HDFS, Hive, Oracle Exadata, SQL Server, Teradata, SSIS, Kafka, Tableau, Microsoft Power BI, SSRS, SSAS, CI/CD
Job PostingView all
1w
Save
Mark Applied
Hide
Senior AWS Data Engineer
New York City or Toronto or Markham
HybridContract
Adastra
Adastra: Global IT consulting firm helping enterprise clients with data, cloud and AI transformations.
Strong AWS data engineering experience with Lake Formation, Glue Data Catalog, Athena, Iceberg, Python, PySpark, SQL, Terraform, data lakes, governance, security, and scalable enterprise platforms.
Amazon Web Services (AWS), AWS Lake Formation, AWS Glue Data Catalog, Apache Iceberg, Amazon Athena, Python, PySpark, SQL, Terraform, Infrastructure-as-Code
Job PostingView all
2w
Save
Mark Applied
Hide
Sr Data Engineer
Charlotte or New York
$125k-$145k/yr HybridFull Time
Bank of America
Bank of AmericaNYSE: BAC: Global financial services and banking institution.
5+ YOEBachelor's degree and 5+ years of data engineering experience required. Requires advanced SQL, Python, Spark, ETL, Airflow, data lake architecture, analytical problem-solving, and strong communication skills.
Python, Apache Spark, SQL, Apache Airflow, dbt, Git, Snowflake, Databricks, Delta Lake, HDFS, Hive, Oracle Exadata, SQL Server, Teradata, SSIS, Kafka, Tableau, Power BI, SSRS, SSAS
Job PostingView all
1w
Save
Mark Applied
Hide
Senior AWS Data Engineer
New York City or Toronto or Markham
HybridContract
Adastra
Adastra: Global IT consulting firm helping enterprise clients with data, cloud and AI transformations.
Strong AWS data engineering experience with Lake Formation, Glue Data Catalog, Athena, Iceberg, Python, PySpark, SQL, Terraform, data lakes, access controls, governance, and secure scalable platforms.
AWS, AWS Lake Formation, AWS Glue Data Catalog, Apache Iceberg, Amazon Athena, Python, PySpark, SQL, Terraform, Amazon Athena Workgroups, Infrastructure-as-Code
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer
New York City, New York, United States
$106k-$150k/yr RemoteFull Time
Municipal Credit Union
Municipal Credit Union: A member-owned nonprofit credit union providing banking, lending, and financial services to New York City members.
6+ YOEBachelor's degree or equivalent with 6-8 years experience, strong SQL and data pipeline skills (Fabric, Azure Data Factory), cloud data lake/warehouse experience (Azure Synapse/Cosmos), .NET/C#, and data quality/ETL expertise.
SQL, Fabric, Azure Data Factory, Azure, Azure Synapse, Azure Cosmos DB, Azure DevOps, .NET, C#, Microsoft SQL Server, SSIS, Crystal Reports, Symitar, PowerOn, SymXchange, OpCon, ARCU, SharePoint
Job PostingView all
1w
Save
Mark Applied
Hide
Senior Data Engineer
Belfast or Toronto or London or New York City or India
HybridFull Time
TD Securities
TD Securities: Securities is a private investment bank serving corporate, government, and institutional clients with capital-markets services.
10+ YOE10+ years in data engineering or related technology roles; hands-on Databricks, Spark/PySpark, Python, SQL, Delta Lake, Azure, and ADLS experience; expertise in scalable pipelines, governed data products, CI/CD, monitoring, and data quality.
Databricks, Python, SQL, Spark, PySpark, Azure, Delta Lake, ADLS, Unity Catalog, CI/CD, AI/ML
Job PostingView all
3w
Save
Mark Applied
Hide
Data Engineer
New York City, New York, United States
$73k-$98k/yr HybridFull Time
Sumitomo Mitsui Banking Corporation
Sumitomo Mitsui Banking Corporation: Global financial institution offering corporate, investment, and retail banking.
Experience designing Databricks solutions in AWS, building production ETL/ELT pipelines, and using Python, SQL, Spark, Delta Lake, CI/CD, Terraform, and data governance controls.
Databricks, Databricks Medallion Architecture, Databricks Jobs, Delta Live Tables (DLT), Amazon S3, AWS Glue, AWS IAM, Apache Spark, Delta Lake, Unity Catalog, Databricks Asset Bundles (DABs), Terraform, GitHub Actions, GitLab CI/CD, AWS CodePipeline, Python, PySpark, SQL, Amazon MSK, Kafka, ETL, ELT
Job PostingView all
2mo
Save
Mark Applied
Hide
Sr. Data Engineer
Chicago or California or Colorado or Florida or Georgia or Illinois or Indiana or Minnesota or Missouri or Montana or New Jersey or New York or North Carolina or Ohio or Oregon or Pennsylvania or South Carolina or Texas or Utah or Vermont or Virginia or Washington or District of Columbia or Wisconsin
$100k-$150k/yr HybridFull Time
NinjaTrader
NinjaTrader: Privately held futures trading platform and brokerage serving retail and professional futures traders.
5+ YOEBachelors in CS/Engineering, 5+ years data/platform engineering, strong SQL and Python, hands-on GCP (BigQuery, Cloud SQL, Cloud Storage) and AWS (S3, Glue, Athena, Kinesis), dbt, Airflow/Prefect, Terraform, CI/CD, data lake/file formats, streaming and observability experience.
SQL, Python, GCP, BigQuery, Cloud SQL, Cloud Storage, AWS, S3, Glue, Athena, Kinesis, EMR, Terraform, GitOps, dbt, Airflow, Prefect, Parquet, Avro, Apache Iceberg, Kubernetes, Kafka, Spark Streaming, Flink, Debezium, Kafka Connect, Looker Studio, QuickSight, Datadog, Grafana, Prometheus, CI/CD
Job PostingView all
1mo
Save
Mark Applied
Hide
Databricks Data Engineer
United States or Arlington or Tysons or Washington or New York City or Chicago or Austin or Atlanta or Boston or Boulder
$113k-$188k/yr RemoteFull Time
Guidehouse
Guidehouse: Global consulting firm serving public and commercial sectors.
3+ YOEBachelor's degree,3+ years data engineering experience,proficiency with Python/PySpark/SQL,Databricks/Spark/Delta Lake experience,knowledge of data pipelines,governance,and cloud platforms.
Databricks, PySpark, Python, SQL, Delta Lake, Unity Catalog, Spark, CI/CD, Terraform, Azure, AWS, GCP
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Data Engineer
New York City or San Francisco
$170k-$200k/yr HybridFull Time
Tatari
Tatari: Private ad-tech helping brands and agencies buy, measure, and optimize ads across linear and streaming TV.
5+ YOE5+ years building and operating production ETL pipelines; strong Python and SQL skills; Spark/PySpark, Databricks/Delta Lake, Airflow experience; strong data modeling and data quality practices.
Python, SQL, Spark, PySpark, Databricks, Delta Lake, Airflow, ClickHouse
Job PostingView all
4w
Save
Mark Applied
Hide
Senior Data Engineer (Azure & Databricks)
New York, New York, United States
$149k-$190k/yr HybridFull Time
SOCOTEC
SOCOTEC: Professional services firm specializing in testing, inspection, and certification.
7+ YOE7-10 years data engineering experience with Databricks, Spark, Delta Lake, strong SQL and Python skills, enterprise ETL/ELT, experience with MDM, cloud data platforms, and data architecture.
Databricks, Apache Spark, Delta Lake, Python, SQL, AWS, Azure, GCP, Deltek, SAP, Oracle
Job PostingView all
3w
Save
Mark Applied
Hide
10101 - Data Engineer
Long Island City or Queens or New York or New Jersey or Connecticut
$125k-$128k/yr HybridFull Time
Fund for Public Health in New York City
Fund for Public Health in New York City: Independent nonprofit public-health organization that incubates initiatives with New York City’s Health Department for all New Yorkers.
3+ YOERequires 3+ years with Python, SQL databases, models, and data lake platforms; 2+ years with cloud technologies; undergraduate degree or certificate in a relevant quantitative or computing field.
Python, SQL, Azure, Docker, Azure Container Apps, Azure App Service, Azure Synapse, Databricks, FastAPI, Django, Flask, Azure Data Factory, Airflow
Job PostingView all
2mo
Save
Mark Applied
Hide
Staff / Principal Data Engineer
New York, New York, United States
$180k-$270k/yr HybridFull Time
Appgate
Appgate: Cybersecurity providing Zero Trust Network Access, fraud protection, and advisory services to enterprises and government agencies.
Extensive experience building and operating large-scale data platforms and lakes; hands-on expertise with Apache Spark and Apache Flink; strong production engineering skills including Kubernetes and CI/CD; experience with batch and streaming pipelines.
Apache Spark, Apache Flink, Kubernetes, CI/CD
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Data Engineer
Newark or New York
$85k-$95k/yr OnsiteFull Time
Capgemini
CapgeminiEuronext Paris: CAP: Global leader in consulting, digital transformation, and engineering services.
Bachelor's in CS or equivalent; experience building AWS data lakes/warehouses and ingestion pipelines; Python, Shell, SQL; AWS services knowledge; CI/CD and streaming experience; AWS certs preferred.
Python, Shell, SQL, CloudFormation, Amazon S3, Amazon Athena, AWS Glue, Amazon EMR, Spark, Amazon RDS, Amazon Redshift, Amazon Aurora, Amazon DynamoDB, AWS Lambda, AWS Step Functions, AWS IAM, AWS KMS, AWS Secrets Manager (SM), Amazon API Gateway, Amazon SQS, Elasticsearch, Amazon Kinesis, Kafka
Job PostingView all
3w
Save
Mark Applied
Hide
Senior Data Engineer, AI Systems
New York City or Toronto
$165k-$215k/yr OnsiteFull Time
Movable Ink
Movable Ink: AI-powered marketing software helping marketers personalize customer experiences across email, mobile, and web.
5+ YOE5+ years data engineering experience with Apache Spark/PySpark, GCP Dataproc, Python, Parquet/Delta Lake, Kafka, and cloud/CI/CD tooling; strong optimization and collaboration skills.
Apache Spark, PySpark, GCP Dataproc, Parquet, Delta Lake, Kafka, Google Cloud Platform, Python, Docker, Kubernetes, GitHub Actions, Git
Job PostingView all
2mo
Save
Mark Applied
Hide
Data Engineer - Archimedes
St. Louis or Brentwood or Alaska or Arizona or Arkansas or California or Connecticut or Delaware or Hawaii or Idaho or Louisiana or Maine or Massachusetts or Michigan or Mississippi or Montana or Nebraska or Nevada or New Mexico or New York or North Carolina or North Dakota or Oregon or Rhode Island or South Carolina or South Dakota or Texas or Utah or Vermont or Washington or West Virginia or Wyoming or United States
HybridFull Time
Archimedes
Archimedes: Archimedes is a privately held specialty drug management serving employers, health plans, and health systems.
5+ YOEDesign, build, and operate cloud-native lake house platforms using Azure Databricks, Delta Lake, ADLS Gen2; 5+ years data engineering experience; Bachelor's in CS/IS/Data Engineering required; CI/CD, data governance, and HIPAA compliance experience.
Azure Databricks, Delta Lake, Unity Catalog, Azure Data Lake Storage Gen2, Databricks Workflows, Databricks Asset Bundles, Delta Live Tables (DLT), Microsoft Synapse Analytics, Azure Data Factory, Azure Functions, Azure Key Vault, Azure Monitor, Apache Spark, PySpark, SQL, Python, GitHub Actions, Azure DevOps, Jenkins, AWS Glue, AWS Lambda, EventBridge, Event Hub, Event Grid, Service Bus, REST APIs, GraphQL, Apache Airflow, MLflow, Databricks ML, Azure Machine Learning, CloudWatch, ELK Stack, Git, Terraform, Bash, PowerShell, AWS S3, AWS RDS, AWS Redshift
Job PostingView all
2mo
Save
Mark Applied
Hide
Staff Engineer, Data & Analytics
Chemnitz or New York City or Berlin or London or Sydney or Tokyo or Prague or Minneapolis or Saint Paul
HybridFull Time
Staffbase
Staffbase: AI-native employee experience software platform helping enterprises communicate with frontline, deskless, and office employees.
Proven Staff Engineer-level experience in data engineering; strong architecture skills for data lakes, foundations, governance and orchestration; hands-on with streaming (Kafka) and Python; data modeling, stakeholder management, and people leadership.
Kafka, Python
Job PostingView all

Explore Jobs

Expand Your Job Search