HiringCafe
Join our community

36 data lake engineer jobs at 29 companies in Fairfield, CT

2mo
Save
Mark Applied
Hide
Staff Data Engineer- Data Lake
New York, New York, United States
$170k-$190k/yr HybridFull Time
H1
H1: Data platform for healthcare professional insights and drug development.
8+ YOE8+ years building and scaling distributed data platforms; technical leadership and mentoring; strong Python (PySpark), Java/Scala, advanced SQL, Apache Spark, cloud-native big data (AWS EMR/Glue/S3/Athena/Redshift), orchestration (Argo/Airflow), containerization, observability, and experience with large-scale ingestion and data quality.
Apache Spark, Argo, Athena, Avro, CircleCI, Claude Code, Docker, EMR, Elastic MapReduce (EMR), Git, GitHub Copilot, Hudi, Java, JIRA, Kinesis, Kafka, Kubernetes, Ky, MAT, Microsoft Excel, Parquet, PySpark, Python, Redshift, S3, Scala, Spark, SQL, Delta, Glue, Airflow
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer
New York City or San Francisco
OnsiteFull Time
Bedrock Robotics
Bedrock Robotics: Automates heavy construction machinery with AI retrofit kits.
5+ YOE5+ years data engineering experience in large-scale data lake/warehouse environments; strong SQL and distributed query engine experience; pipeline orchestration (Airflow/Prefect) and Spark/Databricks experience; data quality and observability expertise.
SQL, Spark, BigQuery, Snowflake, Airflow, Prefect, Databricks
Job PostingView all
3w
Save
Mark Applied
Hide
Data Engineer
New York City, New York, United States
$106k-$150k/yr RemoteFull Time
Municipal Credit Union
Municipal Credit Union: Provides banking and financial services to members in New York.
6+ YOEBachelor's degree or equivalent with 6-8 years experience, strong SQL and data pipeline skills (Fabric, Azure Data Factory), cloud data lake/warehouse experience (Azure Synapse/Cosmos), .NET/C#, and data quality/ETL expertise.
SQL, Fabric, Azure Data Factory, Azure, Azure Synapse, Azure Cosmos DB, Azure DevOps, .NET, C#, Microsoft SQL Server, SSIS, Crystal Reports, Symitar, PowerOn, SymXchange, OpCon, ARCU, SharePoint
Job PostingView all
2mo
Save
Mark Applied
Hide
Staff Data Engineer
New York, New York, United States
OnsiteFull Time
Twenty
Twenty: Develops autonomous systems for offensive cyber operations.
8+ YOE8+ years in data engineering/architecture; expertise in ETL pipelines, data lakes, schema/index design, columnar databases; proven leadership; US citizenship.
Apache Iceberg, Delta Lake, Apache Hive, Trino, Presto, AWS Athena, Apache Spark, ClickHouse, Amazon Redshift, Google BigQuery, Airflow, AWS Glue, NiFi, ClickPipe, Kafka, RabbitMQ, NATS, AWS Kinesis, Neo4j, AWS Neptune, Memgraph, Apache AGE
Job PostingView all
2d
Save
Mark Applied
Hide
Data Engineer
New York City, New York, United States
$73k-$98k/yr HybridFull Time
SMBC Group
SMBC GroupNew York Stock Exchange: SMFG: Provides global banking, investment, securities, and consumer finance services.
Experience designing Databricks solutions in AWS, building production ETL/ELT pipelines, and using Python, SQL, Spark, Delta Lake, CI/CD, Terraform, and data governance controls.
Databricks, Databricks Medallion Architecture, Databricks Jobs, Delta Live Tables (DLT), Amazon S3, AWS Glue, AWS IAM, Apache Spark, Delta Lake, Unity Catalog, Databricks Asset Bundles (DABs), Terraform, GitHub Actions, GitLab CI/CD, AWS CodePipeline, Python, PySpark, SQL, Amazon MSK, Kafka, ETL, ELT
Job PostingView all
1w
Save
Mark Applied
Hide
Senior Data Engineer (Azure & Databricks)
New York, New York, United States
$149k-$190k/yr HybridFull Time
Socotec
Socotec: Provides testing, inspection, and certification services for building safety.
7+ YOE7-10 years data engineering experience with Databricks, Spark, Delta Lake, strong SQL and Python skills, enterprise ETL/ELT, experience with MDM, cloud data platforms, and data architecture.
Databricks, Apache Spark, Delta Lake, Python, SQL, AWS, Azure, GCP, Deltek, SAP, Oracle
Job PostingView all
2w
Save
Mark Applied
Hide
Senior Data Engineer
New York City or San Francisco
$170k-$200k/yr HybridFull Time
Tatari
Tatari: A platform for buying and measuring TV advertising campaigns.
5+ YOE5+ years building and operating production ETL pipelines; strong Python and SQL skills; Spark/PySpark, Databricks/Delta Lake, Airflow experience; strong data modeling and data quality practices.
Python, SQL, Spark, PySpark, Databricks, Delta Lake, Airflow, ClickHouse
Job PostingView all
1w
Save
Mark Applied
Hide
10101 - Data Engineer
Long Island City or Queens or New York or New Jersey or Connecticut
$125k-$128k/yr HybridFull Time
The Fund for Public Health in New York City
The Fund for Public Health in New York City: Incubates and manages public health programs for New York City.
3+ YOERequires 3+ years with Python, SQL databases, models, and data lake platforms; 2+ years with cloud technologies; undergraduate degree or certificate in a relevant quantitative or computing field.
Python, SQL, Azure, Docker, Azure Container Apps, Azure App Service, Azure Synapse, Databricks, FastAPI, Django, Flask, Azure Data Factory, Airflow
Job PostingView all
2mo
Save
Mark Applied
Hide
Staff / Principal Data Engineer
New York, New York, United States
$180k-$270k/yr HybridFull Time
Appgate
Appgate: Provides zero trust cybersecurity and AI-driven fraud prevention solutions.
Extensive experience building and operating large-scale data platforms and lakes; hands-on expertise with Apache Spark and Apache Flink; strong production engineering skills including Kubernetes and CI/CD; experience with batch and streaming pipelines.
Apache Spark, Apache Flink, Kubernetes, CI/CD
Job PostingView all
3w
Save
Mark Applied
Hide
Senior Data Engineer
Newark or New York
$85k-$95k/yr OnsiteFull Time
Capgemini
CapgeminiEuronext Paris: CAP: Provides global IT consulting and digital transformation services.
Bachelor's in CS or equivalent; experience building AWS data lakes/warehouses and ingestion pipelines; Python, Shell, SQL; AWS services knowledge; CI/CD and streaming experience; AWS certs preferred.
Python, Shell, SQL, CloudFormation, Amazon S3, Amazon Athena, AWS Glue, Amazon EMR, Spark, Amazon RDS, Amazon Redshift, Amazon Aurora, Amazon DynamoDB, AWS Lambda, AWS Step Functions, AWS IAM, AWS KMS, AWS Secrets Manager (SM), Amazon API Gateway, Amazon SQS, Elasticsearch, Amazon Kinesis, Kafka
Job PostingView all
1w
Save
Mark Applied
Hide
Senior Data Engineer, AI Systems
New York City or Toronto
$165k-$215k/yr OnsiteFull Time
Movable Ink
Movable Ink: Provides AI-powered content personalization for digital marketing campaigns.
5+ YOE5+ years data engineering experience with Apache Spark/PySpark, GCP Dataproc, Python, Parquet/Delta Lake, Kafka, and cloud/CI/CD tooling; strong optimization and collaboration skills.
Apache Spark, PySpark, GCP Dataproc, Parquet, Delta Lake, Kafka, Google Cloud Platform, Python, Docker, Kubernetes, GitHub Actions, Git
Job PostingView all
3mo
Save
Mark Applied
Hide
Sr Data Engineer, Python + Spark (Data Federation skillset - Data Lakehouse - Eg: Starburst) - New York
New York, New York, United States
$40k-$140k/yr OnsiteFull Time
Photon: Global technology services provider.
5+ YOESenior Data Engineer with 5+ years in Python, Spark; expertise in data federation, lakehouse architectures (Delta Lake/Iceberg/Hudi); Starburst/Trino/Dremio; cloud platforms (AWS/Azure/GCP); strong SQL and data modeling.
Python, Apache Spark, Starburst Enterprise, Trino (Presto), Dremio, Delta Lake, Iceberg, Hudi, AWS, S3, Glue, Azure Databricks, ADLS, GCP, SQL, Medallion Architecture, Starburst/Trino
Job PostingView all
1mo
Save
Mark Applied
Hide
Staff Engineer, Data & Analytics
Chemnitz or New York City or Berlin or London or Sydney or Tokyo or Prague or Minneapolis or Saint Paul
HybridFull Time
Staffbase
Staffbase: Provides an AI-powered internal communications platform for employees.
Proven Staff Engineer-level experience in data engineering; strong architecture skills for data lakes, foundations, governance and orchestration; hands-on with streaming (Kafka) and Python; data modeling, stakeholder management, and people leadership.
Kafka, Python
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Software Engineer, Server Fleet Infrastructure
Livingston or New York or Sunnyvale or San Francisco or Bellevue
$153k-$204k/yr OnsiteFull Time
CoreWeave
CoreWeaveNASDAQ: CRWV: Cloud platform providing GPU-accelerated infrastructure for AI workloads.
4+ YOEBachelor's degree, 4+ years data engineering experience, strong SQL, Python/Java/Scala, experience with data lakes, ETL pipelines, orchestration and observability tools (Airflow, Spark), and cloud platforms.
Apache Iceberg, Trino, Apache Airflow, Apache Spark, Apache Superset, SQL, Python, Java, Scala, AWS, GCP, Azure
Job PostingView all
1w
Save
Mark Applied
Hide
Senior Software Engineer, Data Lake
Bellevue or Menlo Park or New York or Toronto
$196k-$230k/yr HybridFull Time
Robinhood
RobinhoodNASDAQ: HOOD: Provides a commission-free platform for investing and financial services.
5+ YOE5+ years building backend or distributed data systems; proficiency with Java/Scala/Python, Kafka/Flink/Spark, Postgres and CDC, AWS S3, and Kubernetes.
Java, Scala, Python, Postgres, Kafka, Flink, Spark, AWS S3, Kubernetes, Rocket CDC
Job PostingView all
1w
Save
Mark Applied
Hide
Data Engineering Manager
New York, New York, United States
$139k-$209k/yr RemoteFull Time
Paramount
ParamountNASDAQ: PSKY: Produces and distributes media content across global entertainment platforms.
Proven experience leading data engineering teams; expertise in data lake/warehouse/lakehouse architectures, ETL/ELT, streaming (Kafka), cloud-native systems, and production reliability.
Kafka, ETL, ELT, APIs
Job PostingView all
3w
Save
Mark Applied
Hide
Member of Technical Staff - Engineering Lead, Data Ingestion
San Francisco or London or New York City
OnsiteFull Time
Reflection AI
Reflection AI: Developing open-source frontier artificial intelligence models and coding agents.
Proven leadership of data/infra teams, deep experience building web-scale acquisition and ingestion systems, hands-on with distributed compute, orchestration, and data lake formats; familiarity with LLM training and experimentation.
Ray, Beam, Spark, Airflow, Prefect, Parquet, JSONL, WARC
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Manager, Data Engineering
San Francisco or Ottawa or Phoenix or Toronto or Los Angeles or Denver or Salt Lake City or Atlanta or Chicago or Houston or Portland or New York City or Vancouver or San Diego or Washington, D.C. or Sacramento or Jacksonville or Seattle or Mexico City or Austin or Miami or Boston or Dallas
$155k-$265k/yr HybridFull Time
Scribd
Scribd: Subscription-based digital library for e-books, audiobooks, and documents.
10+ YOE3+ Mgmt10+ years in data engineering, 3+ years managing engineering teams; advanced SQL and experience with Python/Scala, Spark, Databricks/Delta Lake/Snowflake/BigQuery; strong data architecture, dimensional modeling, and cross-functional leadership.
SQL, Python, Scala, Spark, Databricks, Delta Lake, Snowflake, BigQuery
Job PostingView all
3w
Save
Mark Applied
Hide
Data Architecture & Engineering — Market Risk Technology
New York City, New York, United States
$150k-$240k/yr HybridFull Time
Mizuho Financial Group
Mizuho Financial GroupTokyo Stock Exchange: 8411: Global financial group providing banking and investment services.
15+ YOE15+ years in data architecture/engineering within financial services; expertise in market risk domains; experience with Databricks, Spark, Delta Lake, SSIS, and SQL Server; leadership of large ETL migrations; strong communication skills.
Databricks, Delta Lake, SSIS, SQL Server, Spark
Job PostingView all
1mo
Save
Mark Applied
Hide
Platform Engineer - Databricks and Cloud
New York, New York, United States
HybridFull Time
EXL
EXLNASDAQ: EXLS: Provides data analytics and digital operations solutions to businesses.
6+ YOEHands-on AWS and Terraform experience, Databricks on AWS administration, CI/CD automation, data engineering concepts (ETL/ELT, data lakes), and DevOps/cloud architecture expertise.
AWS, Terraform, AWS CDK, Databricks, GitHub, GitHub Actions, CodeBuild, CodeDeploy, ArgoCD, AWS Glue, Redshift, DynamoDB, EC2, EKS, Lambda, API Gateway, VPC, IAM, Security Groups, Load Balancers, Unity Catalog, Kubernetes, Control Tower, Organizations, Landing Zone, CloudWatch, Grafana, Prometheus, ELK, AWS Well-Architected Framework
Job PostingView all

Explore Jobs

Expand Your Job Search