HiringCafe
Join our community

27 spark data engineer jobs at 16 companies in Danbury, CT

1mo
Save
Mark Applied
Hide
Data Engineer
Charlotte or Chicago or Hartford or Columbus
$101k-$151k/yr HybridFull Time
The Hartford
The HartfordNYSE: HIG: Provides business and personal insurance, group benefits, and investments.
2+ YOE2+ years relevant experience; Bachelor’s in CS/Engineering/IT/MIS required; experience with R/Python/SQL, Hadoop/Spark, ETL, Linux, Git; familiarity with automation tools and AWS services; strong communication skills.
R, Python, SQL, Hadoop, Spark, XML, JSON, ETL, Linux, Git, GitHub, Autosys, Cron, Airflow, Amazon S3, Amazon EMR, MLOps, Agile
Job PostingView all
2d
Save
Mark Applied
Hide
Senior Data Engineer
White Plains or Greensboro or Charleston or Greenville or Maitland or Harrisonburg or Clearwater or Louisville or Birmingham or Huntsville or Alpharetta or Clayton or Honolulu or Lake Oswego or Gainesville or Fayetteville or Naples or Hibbing or Miami or Myrtle Beach or Houston or Denver or Piscataway or Irvine or Key Largo or Columbia or Little Rock or Austin or Pensacola or Lexington or Bloomington or Fort Myers or Panama City or San Antonio or Rochester or Mobile or Salt Lake City or Bend or Charlotte or Glen Allen or Raleigh or Abilene or Tallahassee or San Ramon or Dallas or Pittsburgh or Boston or Missoula or Cincinnati or Boise or Eugene or McMinnville or Knoxville or Dakota Dunes or Kissimmee or Fort Worth or Grand Forks or Canonsburg or Buffalo or Eastland or Philadelphia or Chicago or Phoenix or Dublin or Jacksonville or St. Louis or Los Angeles or Atlanta or Norwalk or Colchester or Grand Rapids or Richmond or Hoboken or Indianapolis or Kansas City or Chagrin Falls or Orland Park or Anchorage or High Point or Bonita Springs or Rancho Cordova or Las Vegas or Irving or Brandenburg or Minneapolis or Fort Lauderdale or Shreveport or Fargo or Sarasota or Kennesaw or Dayton or Sacramento or Princeton or Durham or Conshohocken or Baton Rouge or Asheville or Chattanooga or Memphis or Nashville or United States
$96k-$168k/yr RemoteFull Time
Marsh McLennan
Marsh McLennanNYSE: MRSH: Global professional services firm providing risk, strategy, and people solutions.
10+ YOERequires 10+ years of enterprise data engineering experience and advanced Azure, Databricks, Spark, Python, SQL, ETL, data modeling, streaming, and cloud architecture expertise.
Microsoft Azure, Azure Databricks, Azure Functions, Azure Data Factory, Databricks, Apache Spark, PySpark, Python, SQL, Scala, Unity Catalog, Microsoft SQL Server, Kafka, Event Hub, Azure DevOps, Git, Terraform, ARM templates, Databricks Genie
Job PostingView all
2mo
Save
Mark Applied
Hide
Senior GCP Data Engineer
Hartford, Connecticut, United States
HybridFull Time
EXL
EXLNASDAQ: EXLS: Provides data analytics and digital operations solutions to businesses.
9+ YOE8+ years in Data Engineering with leadership; strong GCP, SQL, Python; ETL and Spark; data modeling; cross-functional collaboration; leadership.
BigQuery, Cloud Composer (Airflow), Cloud Storage, Dataproc, Apache Spark, SQL, Python, Scala
Job PostingView all
4w
Save
Mark Applied
Hide
Data Engineer
Charlotte or Chicago or Columbus or Hartford
$101k-$151k/yr HybridFull Time
The Hartford
The HartfordNYSE: HIG: Provides property and casualty insurance and financial products.
2+ YOEBachelor’s degree or equivalent experience; 2+ years in data engineering or related roles, Python and SQL; cloud, ETL/ELT, CI/CD, IaC, modern data platforms, and U.S. work authorization.
SQL, Python, AWS, GCP, GitHub, GitHub Actions, Jenkins, Terraform, CloudFormation, Apache Airflow, Cloud Composer, Snowflake, Redshift, BigQuery, Docker, Kubernetes, dbt, Spark, Hadoop
Job PostingView all
3mo
Save
Mark Applied
Hide
Senior Data Engineer
Poughkeepsie, New York, United States
$100k-$126k/yr OnsiteFull Time
Hudson Valley Credit Union
Hudson Valley Credit Union: Provides consumer and commercial banking and lending services.
5+ YOEBachelor’s degree in CS or related; Master’s preferred. 5+ years of Data Engineer experience; Databricks Certifications preferred; Azure Data Engineer certification preferred; strong Python, Databricks, and data warehousing experience.
Databricks, Spark, PySpark, Scala, Delta Lake, Azure Data Lake Storage Gen2, CI/CD, ITSM, SDLC, MLOps
Job PostingView all
2w
Save
Mark Applied
Hide
Sr. Engineer, Data & Analytics
Stamford or United States
RemoteFull Time
Lovesac
LovesacNASDAQ: LOVE: Designs and sells modular furniture including sectionals and beanbags.
5+ YOEBachelor's in CS/Data/Engineering,5+ years in data engineering and analytics,expertise in Microsoft Power BI and Microsoft Fabric,SQL,Python/PySpark,DAX,Data modeling,CI/CD and stakeholder partnership.
Microsoft Power BI, Microsoft Fabric, OneLake, Microsoft Data Factory, Dataflows Gen2, Spark, SQL, Python, PySpark, Direct Lake, Git, Microsoft Purview, Databricks, Snowflake, Redshift, BigQuery, DAX, Delta Lake, Parquet
Job PostingView all
2mo
Save
Mark Applied
Hide
AVP, Lead Data Engineer
Philadelphia or Jersey City or Simsbury
$153k-$221k/yr OnsiteFull Time
Chubb
ChubbNYSE: CB: Provides property, casualty, and life insurance and reinsurance services globally.
12+ YOEBachelor's degree required; 12+ years data engineering with ETL/ELT, data warehouse design, and automated pipelines. Expertise in Informatica/IICS, Azure (Synapse, ADF, Databricks), Snowflake, Databricks, Autosys, Python/Shell. Must be based in NJ or Greater Philadelphia.
Informatica, IICS, Azure, Synapse Analytics, Azure Data Factory, Azure Databricks, Databricks, Delta Lake, Spark, Snowflake, Snowpark, Autosys, Python, Shell
Job PostingView all
2mo
Save
Mark Applied
Hide
Senior Data Engineer (AWS, Databricks)
Hartford, Connecticut, United States
$139k-$230k/yr HybridFull Time
Travelers
TravelersNYSE: TRV: Provide property and casualty insurance for individuals and businesses.
6+ YOEBachelor's in STEM or equivalent, 6+ years data engineering experience, strong experience with AWS, Databricks, Snowflake, Ab>Initio, CI/CD, Terraform, AI coding assistants, and mentoring/technical leadership.
AWS, Databricks, Snowflake, Ab>Initio, GDE, Co>Operating System, EME, Iceberg, Delta Lake, Unity Catalog, Spark, pySpark, SQL, Claude Code, Codex, Copilot, Cursor, GitHub Actions, GitLab CI, Jenkins, Terraform
Job PostingView all
2mo
Save
Mark Applied
Hide
Senior Data Engineer (AWS, Databricks)
Hartford, Connecticut, United States
$139k-$230k/yr OnsiteFull Time
Travelers
TravelersNew York Stock Exchange: TRV: Provider of commercial and personal property casualty insurance.
10+ YOE10+ years building production data pipelines with AWS, Databricks, Snowflake and AbInitio; bachelor’s in STEM or equivalent; strong mentoring, SDLC, CI/CD, and AI-assistant experience.
AWS, Snowflake, Databricks, AbInitio, Spark, pySpark, SQL, Iceberg, Delta Lake, Unity Catalog, Claude Code, Codex, Copilot, Cursor, GDE, Co>Operating System, EME, GitHub Actions, GitLab CI, Jenkins, Terraform
Job PostingView all
4w
Save
Mark Applied
Hide
Head of Data Engineering
Fort Lee, New Jersey, United States
$200k/yr OnsiteFull Time
TRANZACT
TRANZACT: Distributes health and life insurance policies directly to consumers.
10+ YOE4+ Mgmt10+ years data engineering, 4+ years leading teams, hands-on Databricks/PostgreSQL, Python and SQL expertise, experience with data governance/security and AI-assisted engineering; BS in CS required.
Databricks, PostgreSQL, Python, SQL, Unity Catalog, Delta Lake, Spark, Apache Airflow, SQL Server, Azure, AWS, Terraform, Bicep, CloudFormation
Job PostingView all
3mo
Save
Mark Applied
Hide
Senior Data Engineer
Poughkeepsie, New York, United States
$100k-$126k/yr OnsiteFull Time
Hudson Valley Credit Union
Hudson Valley Credit Union: Provides personal and business banking services to members.
5+ YOEFive+ years data engineering experience; Databricks and Azure data stack expertise; Python; strong data warehousing/lakehouse skills.
Databricks, Spark, Delta Lake, Azure Data Lake Storage Gen2, Databricks Workflows, CI/CD, MLOps, Python
Job PostingView all
2mo
Save
Mark Applied
Hide
Analytics Engineer, Data Science
Chicago or Austin or Baltimore or Denver or Boulder or Hartford or New Haven or Philadelphia or Providence or Miami
$118k-$173k/yr HybridFull Time
DoorDash
DoorDashNASDAQ: DASH: On-demand delivery platform connecting consumers with local merchants.
2+ YOE2-6+ years in BI/analytics/data engineering; SQL; Python/Scala; Looker/Tableau/Sigma; database fundamentals; data quality checks; strong communication; fast-paced; self-starter.
SQL, Python, Scala, Looker, Tableau, Sigma, S3, Hive, Spark, Pydeequ, Great Expectations
Job PostingView all
2w
Save
Mark Applied
Hide
Staff Data Scientist
Erlanger or Miami or White Plains
$174k-$235k/yr OnsiteFull Time
Atlas Air
Atlas Air: Global provider of outsourced aviation and logistics services.
5+ YOEMaster's or PhD in a quantitative field, 5+ years data science experience, expertise in Python/R, SQL, machine learning, optimization, and production-grade software engineering practices.
Python, R, SQL, Pandas, Spark, scikit-learn, PyTorch, TensorFlow, git, Databricks, AWS, GCP, Azure, OR-Tools, Gurobi, CPLEX
Job PostingView all
4w
Save
Mark Applied
Hide
Data Engineer I-Pathology Molecular and Cell Based Medicine
New York, New York, United States
$85k-$109k/yr OnsiteFull Time
Mount Sinai Health System
Mount Sinai Health System: Integrated academic medical system providing patient care and research.
2+ YOEBachelor's in computer science or related,2+ years development experience (Linux preferred),strong SQL/NoSQL and big‑data stack knowledge,proficiency with 2+ languages and RESTful services.
LINUX, Oracle, PostgreSQL, MYSQL, Mongo DB, Scala, Python, Java, Node JS, Django, PHP, Hadoop, Spark, Kafka, Azure, AWS, JIRA, Microsoft Office Suite
Job PostingView all
4w
Save
Mark Applied
Hide
Data Engineer I-Pathology Molecular and Cell Based Medicine
New York, New York, United States
$85k-$109k/yr OnsiteFull Time
Mount Sinai Health System
Mount Sinai Health System: Provides comprehensive hospital, clinical, and medical research services.
2+ YOEBachelor's in Computer Science or related; 2+ years development experience (Linux preferred); strong SQL/NoSQL knowledge; proficiency in 2+ languages (Scala, Python, Java); experience with REST, microservices, big-data stacks, cloud (Azure/AWS).
LINUX, Oracle, PostgreSQL, MySQL, Mongo DB, Scala, Python, Java, Node JS, Django, PHP, Hadoop, Spark, Kafka, JIRA, Azure, AWS
Job PostingView all
1mo
Save
Mark Applied
Hide
Sr Data Scientist
Stamford or Irving
$113k-$147k/yr HybridFull Time
Gartner
GartnerNYSE: IT: Provides research and advisory services for business leaders.
6+ YOE6+ years in ML engineering and product development, 2+ years deploying LLMs, experience designing agents, proficiency in Python and deep learning frameworks, strong communication and leadership skills.
Python, PyTorch, TensorFlow, Hugging Face, LangChain, LangGraph, LlamaIndex, SQL, Oracle, MongoDB, Pinecone, Weaviate, Spark, AWS, Azure ML, Model Context Protocol (MCP)
Job PostingView all
3w
Save
Mark Applied
Hide
Sr Data Scientist
Stamford or Irving
$113k-$147k/yr HybridFull Time
Gartner
GartnerNYSE: IT: Provides business research and advisory services to organizations.
6+ YOERequires 6–8 years of advanced ML engineering and enterprise product development, 2+ years deploying LLMs, 1+ year building agent systems, and a bachelor's degree; Python, AI frameworks, databases, and cloud experience required.
Python, PyTorch, TensorFlow, Hugging Face, LangChain, LangGraph, LlamaIndex, SQL, Oracle, MongoDB, Pinecone, Weaviate, Spark, AWS, Azure ML, Model Context Protocol (MCP)
Job PostingView all
1w
Save
Mark Applied
Hide
DataOps Engineer  
Englewood Cliffs or Plano
$10k/mo OnsiteContract, Full Time
SBT Global
SBT Global: Provides integrated IT consulting and global logistics management services.
5+ YOEBachelor's in CS/IT/data field, ~5 years building and operating large-scale data platforms, production Apache Iceberg and Docker experience, Spark/Flink/Presto, Python/Ansible automation, CI/CD and observability, on-call participation, willingness to relocate from NJ to TX.
Apache Iceberg, Docker, Docker-Compose, Spark, Flink, Presto, Trino, Trivy, Snyk, Kafka, Pulsar, Kinesis, GitHub Actions, GitLab CI, Microsoft Azure DevOps, Ansible, Python, OpenTelemetry, Prometheus, Grafana, Loki, Hive Metastore, AWS Glue, Nessie, EMR, Dataproc, Synapse
Job PostingView all
3w
Save
Mark Applied
Hide
AI/LLM Engineer
Hartford, Connecticut, United States
$102k-$204k/yr HybridFull Time
CVS Health
CVS HealthNYSE: CVS: Provides retail pharmacy, health insurance, and pharmacy benefit management services.
5+ YOE5+ years experience building production AI/ML systems, strong Python and software engineering skills, hands-on LLM, RAG, embeddings and vector search experience, and degree in CS/Engineering/Data Science or equivalent experience.
Python, SQL, OpenAI, Anthropic, Google Vertex AI, LangChain, LlamaIndex, Semantic Kernel, Pinecone, Weaviate, FAISS, MongoDB Atlas Vector Search, Spark, Pandas, FastAPI, Flask, REST/gRPC, AWS, Azure, Google Cloud Platform (GCP), Docker, Kubernetes, CI/CD
Job PostingView all
1w
Save
Mark Applied
Hide
Lead AI / ML Engineer
New York City or Milwaukee or Dallas or Columbus or Kirkland or Cincinnati or Cleveland or Oklahoma City or Austin or Albany or Chicago or St. Petersburg or Hartford or Pittsburgh or St. Louis or Miami or Sacramento or Raleigh or Minneapolis or Mountain View or Scottsdale or San Francisco or Morristown or Denver or Boston or Philadelphia or Des Moines or Overland Park or Los Angeles or Charlotte or Walnut Creek or Carmel or Seattle or Houston or Arlington or Atlanta or Redmond or Bentonville or Beaverton or Nashville or Detroit or San Diego
$80k-$294k/yr HybridFull Time
Accenture
AccentureNYSE: ACN: Global provider of management consulting and technology services.
6+ YOEBachelor's degree or equivalent experience, 6+ years developing and deploying AI/ML solutions, programming proficiency, experience with ML frameworks, big data, databases, and cloud platforms.
Python, R, Java, TensorFlow, PyTorch, Hadoop, Spark, AWS, Microsoft Azure, Google Cloud, D3.js, ggplot
Job PostingView all

Explore Jobs

Expand Your Job Search