HiringCafe
Join our community

53 data lake engineer jobs at 37 companies in Queens, NY

2mo
Save
Mark Applied
Hide
Staff Data Engineer- Data Lake
New York, New York, United States
$170k-$190k/yr HybridFull Time
H1
H1: Data platform for healthcare professional insights and drug development.
8+ YOE8+ years building and scaling distributed data platforms; technical leadership and mentoring; strong Python (PySpark), Java/Scala, advanced SQL, Apache Spark, cloud-native big data (AWS EMR/Glue/S3/Athena/Redshift), orchestration (Argo/Airflow), containerization, observability, and experience with large-scale ingestion and data quality.
Apache Spark, Argo, Athena, Avro, CircleCI, Claude Code, Docker, EMR, Elastic MapReduce (EMR), Git, GitHub Copilot, Hudi, Java, JIRA, Kinesis, Kafka, Kubernetes, Ky, MAT, Microsoft Excel, Parquet, PySpark, Python, Redshift, S3, Scala, Spark, SQL, Delta, Glue, Airflow
Job PostingView all
2w
Save
Mark Applied
Hide
Data Engineer
New York City or Nashville or Los Angeles or Portland
$135k/yr RemoteFull Time
Downtown Music
Downtown MusicEuronext Amsterdam: UMG: Global music publishing, distribution, and rights management services.
3+ YOE3+ years of enterprise data engineering experience; bachelor's degree or equivalent; RDBMS, SQL, Python, AWS, ETL/ELT, REST APIs, data modeling, and data warehouse or lake experience.
PostgreSQL, MongoDB, Snowflake, Amazon Redshift, Amazon S3, Amazon EC2, Amazon ECS, Amazon RDS, Amazon DynamoDB, AWS Lambda, AWS Glue, Elasticsearch, Amazon Kinesis, SQL, Python, REST API, XML, JSON, DDEX, CWR
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer
New York City or San Francisco
OnsiteFull Time
Bedrock Robotics
Bedrock Robotics: Automates heavy construction machinery with AI retrofit kits.
5+ YOE5+ years data engineering experience in large-scale data lake/warehouse environments; strong SQL and distributed query engine experience; pipeline orchestration (Airflow/Prefect) and Spark/Databricks experience; data quality and observability expertise.
SQL, Spark, BigQuery, Snowflake, Airflow, Prefect, Databricks
Job PostingView all
2mo
Save
Mark Applied
Hide
Data Engineer
Princeton, New Jersey, United States
$100k-$120k/yr HybridFull Time
CURE Auto Insurance
CURE Auto Insurance: Provides automobile insurance based primarily on individual driving records.
3+ YOEDesign, build, and maintain data pipelines; integrate core insurance data; ensure data quality and governance; develop data lake/warehouse.
Python, SQL, Snowflake, BigQuery, Redshift, Databricks, Spark, dbt, Great Expectations, Kafka, Kinesis, Debezium, Fivetran, HVR
Job PostingView all
1w
Save
Mark Applied
Hide
Databricks Data Engineer
Jersey City or United States
$65k-$87k/yr HybridFull Time
EXL
EXLNASDAQ: EXLS: Provides data analytics and digital operations solutions to businesses.
10+ YOE10+ years data engineering experience with Databricks, Spark, Delta Lake and Azure Data Platform; strong Python/PySpark and SQL skills; experience with CI/CD, REST APIs, CDC/SCD, and data quality frameworks.
Databricks, Spark, Delta Lake, Unity Catalog, Databricks Workflows, SQL Warehouses, PySpark, Spark SQL, SQL, Python, Azure Data Lake Storage (ADLS Gen2), Azure Synapse, Azure Key Vault, Azure DevOps, Git, Ab Initio, REST APIs, JSON, XML
Job PostingView all
2w
Save
Mark Applied
Hide
Data Engineer
New York City, New York, United States
$106k-$150k/yr RemoteFull Time
Municipal Credit Union
Municipal Credit Union: Provides banking and financial services to members in New York.
6+ YOEBachelor's degree or equivalent with 6-8 years experience, strong SQL and data pipeline skills (Fabric, Azure Data Factory), cloud data lake/warehouse experience (Azure Synapse/Cosmos), .NET/C#, and data quality/ETL expertise.
SQL, Fabric, Azure Data Factory, Azure, Azure Synapse, Azure Cosmos DB, Azure DevOps, .NET, C#, Microsoft SQL Server, SSIS, Crystal Reports, Symitar, PowerOn, SymXchange, OpCon, ARCU, SharePoint
Job PostingView all
2mo
Save
Mark Applied
Hide
Staff Data Engineer
New York, New York, United States
OnsiteFull Time
Twenty
Twenty: Develops autonomous systems for offensive cyber operations.
8+ YOE8+ years in data engineering/architecture; expertise in ETL pipelines, data lakes, schema/index design, columnar databases; proven leadership; US citizenship.
Apache Iceberg, Delta Lake, Apache Hive, Trino, Presto, AWS Athena, Apache Spark, ClickHouse, Amazon Redshift, Google BigQuery, Airflow, AWS Glue, NiFi, ClickPipe, Kafka, RabbitMQ, NATS, AWS Kinesis, Neo4j, AWS Neptune, Memgraph, Apache AGE
Job PostingView all
1w
Save
Mark Applied
Hide
Databricks Data Engineer
United States or Arlington or Tysons or Washington or New York City or Chicago or Austin or Atlanta or Boston or Boulder
$113k-$188k/yr RemoteFull Time
Guidehouse
Guidehouse: Provides management and technology consulting services to diverse organizations.
3+ YOEBachelor's degree,3+ years data engineering experience,proficiency with Python/PySpark/SQL,Databricks/Spark/Delta Lake experience,knowledge of data pipelines,governance,and cloud platforms.
Databricks, PySpark, Python, SQL, Delta Lake, Unity Catalog, Spark, CI/CD, Terraform, Azure, AWS, GCP
Job PostingView all
4d
Save
Mark Applied
Hide
Senior Data Engineer (Azure & Databricks)
New York, New York, United States
$149k-$190k/yr HybridFull Time
Socotec
Socotec: Provides testing, inspection, and certification services for building safety.
7+ YOE7-10 years data engineering experience with Databricks, Spark, Delta Lake, strong SQL and Python skills, enterprise ETL/ELT, experience with MDM, cloud data platforms, and data architecture.
Databricks, Apache Spark, Delta Lake, Python, SQL, AWS, Azure, GCP, Deltek, SAP, Oracle
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer, Clinical Operations
Princeton, New Jersey, United States
$88k-$106k/yr OnsiteFull Time
Bristol Myers Squibb
Bristol Myers SquibbNew York Stock Exchange: BMY: Develops and distributes innovative medicines for serious diseases.
5+ YOE5+ years data engineering experience with cloud platforms, Databricks (Delta Lake, Unity Catalog), Python, SQL, Spark/PySpark, GenAI/LLM (RAG, embeddings), and building production-grade ETL/ELT pipelines and data products.
Generative AI (GenAI), Databricks, Databricks Delta Lake, Databricks Unity Catalog, Databricks Workflows, Databricks Mosaic AI, MLflow, Python, SQL, Spark, PySpark, RAG, LLM
Job PostingView all
2w
Save
Mark Applied
Hide
Senior Data Engineer
New York City or San Francisco
$170k-$200k/yr HybridFull Time
Tatari
Tatari: A platform for buying and measuring TV advertising campaigns.
5+ YOE5+ years building and operating production ETL pipelines; strong Python and SQL skills; Spark/PySpark, Databricks/Delta Lake, Airflow experience; strong data modeling and data quality practices.
Python, SQL, Spark, PySpark, Databricks, Delta Lake, Airflow, ClickHouse
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer - AVP
Whippany, New Jersey, United States
$190k-$195k/yr OnsiteFull Time
Barclays
BarclaysLondon Stock Exchange: BARC: Global bank providing retail, corporate, and investment financial services.
Experience building Java-based data pipelines, data warehouses and lakes; strong skills in Java, Spark, Kafka, Kubernetes, OAuth2/JWT, JUnit, Mockito, GitLab/Bitbucket; experience leading technical teams and ensuring data governance and observability.
Java, Spark, Kafka, Kubernetes, OAuth2, JWT, JUnit, Mockito, GitLab, Bitbucket
Job PostingView all
2d
Save
Mark Applied
Hide
10101 - Data Engineer
Long Island City or Queens or New York or New Jersey or Connecticut
$125k-$128k/yr HybridFull Time
The Fund for Public Health in New York City
The Fund for Public Health in New York City: Incubates and manages public health programs for New York City.
3+ YOERequires 3+ years with Python, SQL databases, models, and data lake platforms; 2+ years with cloud technologies; undergraduate degree or certificate in a relevant quantitative or computing field.
Python, SQL, Azure, Docker, Azure Container Apps, Azure App Service, Azure Synapse, Databricks, FastAPI, Django, Flask, Azure Data Factory, Airflow
Job PostingView all
1mo
Save
Mark Applied
Hide
Databricks Data Engineer
New York, New York, United States
$59k-$75k/yr OnsiteFull Time, Temporary
Capgemini
CapgeminiEuronext Paris: CAP: Provides global IT consulting and digital transformation services.
Design and optimize scalable Databricks/Spark pipelines, build lakehouse solutions with Iceberg/Delta Lake, integrate backend data services, work in Agile, and communicate with technical and business stakeholders.
Databricks, Unity Catalog, Delta Live Tables, Workflows, Asset Bundles, Apache Spark, Scala, Apache Iceberg, Delta Lake
Job PostingView all
1mo
Save
Mark Applied
Hide
Staff / Principal Data Engineer
New York, New York, United States
$180k-$270k/yr HybridFull Time
Appgate
Appgate: Provides zero trust cybersecurity and AI-driven fraud prevention solutions.
Extensive experience building and operating large-scale data platforms and lakes; hands-on expertise with Apache Spark and Apache Flink; strong production engineering skills including Kubernetes and CI/CD; experience with batch and streaming pipelines.
Apache Spark, Apache Flink, Kubernetes, CI/CD
Job PostingView all
3d
Save
Mark Applied
Hide
Senior Data Engineer, AI Systems
New York City or Toronto
$165k-$215k/yr OnsiteFull Time
Movable Ink
Movable Ink: Provides AI-powered content personalization for digital marketing campaigns.
5+ YOE5+ years data engineering experience with Apache Spark/PySpark, GCP Dataproc, Python, Parquet/Delta Lake, Kafka, and cloud/CI/CD tooling; strong optimization and collaboration skills.
Apache Spark, PySpark, GCP Dataproc, Parquet, Delta Lake, Kafka, Google Cloud Platform, Python, Docker, Kubernetes, GitHub Actions, Git
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Data Engineer
Los Angeles or New York City or United States or India
$185k-$200k/yr HybridFull Time
Fuel Cycle
Fuel Cycle: Cloud platform for market research and customer feedback analysis.
5+ YOE5+ years building production Databricks lakehouses; strong PySpark, Python, SQL; experience with Unity Catalog, Delta Lake, dbt, orchestrators (Dagster/Prefect/Workflows), and AWS data services.
Databricks, Unity Catalog, Delta Live Tables, Databricks SQL, Workflows, Delta Lake, dbt, PySpark, Python, MySQL, PostgreSQL, Dagster, Prefect, Databricks Workflows, Databricks Vector Search, pgvector, Amazon OpenSearch, Amazon Bedrock, AgentCore, Strands, OpenMetadata, S3, IAM, Databricks Asset Bundles, Terraform, Apache Iceberg, AWS Glue, Athena, DynamoDB, SQL
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Manager, Data Engineer, Clinical Operations
Princeton, New Jersey, United States
$154k-$186k/yr OnsiteFull Time
Bristol Myers Squibb
Bristol Myers SquibbNYSE: BMY: Develops and manufactures innovative prescription biopharmaceutical medicines.
7+ YOE7+ years in data engineering/analytics with cloud experience; hands-on Databricks, Delta Lake, Unity Catalog, Python, SQL, Spark/PySpark, GenAI/LLM experience; strong stakeholder and clinical operations domain knowledge preferred.
Generative AI (GenAI), Databricks, Databricks Delta Lake, Databricks Unity Catalog, Databricks Workflows, Mosaic AI, MLflow, Python, SQL, Spark, PySpark, LLM, RAG, Veeva Vault, Medidata Rave, IRT
Job PostingView all
3mo
Save
Mark Applied
Hide
Sr Data Engineer, Python + Spark (Data Federation skillset - Data Lakehouse - Eg: Starburst) - New York
New York, New York, United States
$40k-$140k/yr OnsiteFull Time
Photon: Global technology services provider.
5+ YOESenior Data Engineer with 5+ years in Python, Spark; expertise in data federation, lakehouse architectures (Delta Lake/Iceberg/Hudi); Starburst/Trino/Dremio; cloud platforms (AWS/Azure/GCP); strong SQL and data modeling.
Python, Apache Spark, Starburst Enterprise, Trino (Presto), Dremio, Delta Lake, Iceberg, Hudi, AWS, S3, Glue, Azure Databricks, ADLS, GCP, SQL, Medallion Architecture, Starburst/Trino
Job PostingView all
1mo
Save
Mark Applied
Hide
Staff Engineer, Data & Analytics
Chemnitz or New York City or Berlin or London or Sydney or Tokyo or Prague or Minneapolis or Saint Paul
HybridFull Time
Staffbase
Staffbase: Provides an AI-powered internal communications platform for employees.
Proven Staff Engineer-level experience in data engineering; strong architecture skills for data lakes, foundations, governance and orchestration; hands-on with streaming (Kafka) and Python; data modeling, stakeholder management, and people leadership.
Kafka, Python
Job PostingView all

Explore Jobs

Expand Your Job Search