25 spark data engineer jobs at 19 companies in Connecticut

PromotedHiringCafe
Founding Machine Learning / AI Search Engineer
Cupertino, CA, US
$160k-$310k/yr On-SiteFull Time
HiringCafe
HiringCafe: Building a 100× better job search engine to take on Indeed and LinkedIn.
Build the ML and AI search behind HiringCafe — ranking, recommenders, retrieval, and LLM agents that surface jobs people would never find on their own.
Python, PyTorch, Elasticsearch, LLMs
3w
Save
Mark Applied
Hide
Principal Data Engineer
Chicago or Downers Grove or Alabama or Connecticut or Florida or Georgia or Ohio or Pennsylvania
$112k-$187k/yr HybridFull Time
Kemper
KemperNYSE: KMPR: Provides specialized auto, life, and health insurance services.
10+ YOE10+ years in data engineering/architecture; expert SQL, Python, Snowflake; experience with ETL/ELT, Spark, Kafka, Airflow, DBT, and cloud-native tools (AWS/Azure); proven technical leadership and mentoring; experience with data governance, security, and regulated industries; bachelor’s or master’s in related field preferred.
SQL, Python, Snowflake, Spark, Kafka, Airflow, AWS Glue, S3, AWS, Azure, Informatica, IICS, DBT, IDMC, Git, Guidewire, Life/400, Data Vault 2.0, CI/CD
1mo
Save
Mark Applied
Hide
Data Engineer
Charlotte or Chicago or Hartford or Columbus
$101k-$151k/yr HybridFull Time
The Hartford
The HartfordNYSE: HIG: Provides business and personal insurance, group benefits, and investments.
2+ YOE2+ years relevant experience; Bachelor’s in CS/Engineering/IT/MIS required; experience with R/Python/SQL, Hadoop/Spark, ETL, Linux, Git; familiarity with automation tools and AWS services; strong communication skills.
R, Python, SQL, Hadoop, Spark, XML, JSON, ETL, Linux, Git, GitHub, Autosys, Cron, Airflow, Amazon S3, Amazon EMR, MLOps, Agile
1mo
Save
Mark Applied
Hide
Staff Data Engineer
Arizona or California or Colorado or Connecticut or District of Columbia or Delaware or Florida or Georgia or Illinois or Indiana or Kentucky or Louisiana or Massachusetts or Maine or Maryland or Michigan or Minnesota or Missouri or North Carolina or New Jersey or New York or Oregon or Pennsylvania or South Carolina or Tennessee or Texas or Virginia or Wisconsin
$130k-$150k/yr RemoteFull Time
MissionWired
MissionWired: Providing digital fundraising and data-driven marketing for nonprofit organizations.
5+ YOE5+ years professional software engineering experience; hands-on Apache Spark and distributed data pipelines; experience managing data warehouses or lakes; mentoring and guiding technical decisions; strong data modeling and production skills.
Apache Spark, AWS, GitHub Actions, Terraform, Docker
1mo
Save
Mark Applied
Hide
Senior GCP Data Engineer
Hartford, Connecticut, United States
HybridFull Time
EXL
EXLNASDAQ: EXLS: Provides data analytics and digital operations solutions to businesses.
9+ YOE8+ years in Data Engineering with leadership; strong GCP, SQL, Python; ETL and Spark; data modeling; cross-functional collaboration; leadership.
BigQuery, Cloud Composer (Airflow), Cloud Storage, Dataproc, Apache Spark, SQL, Python, Scala
1mo
Save
Mark Applied
Hide
Sr. Engineer, Data - Archimedes
St. Louis or Brentwood or United States or Alaska or Arizona or Arkansas or California or Connecticut or Delaware or Hawaii or Idaho or Louisiana or Maine or Massachusetts or Michigan or Mississippi or Montana or Nebraska or Nevada or New Mexico or New York or North Carolina or North Dakota or Oregon or Rhode Island or South Carolina or South Dakota or Texas or Utah or Vermont or Washington or West Virginia or Wyoming
HybridFull Time
Navitus Health Solutions
Navitus Health Solutions: Transparent pharmacy benefit management and specialty pharmacy provider.
8+ YOEBachelor's in CS or related (Master's preferred); AWS/Azure/CDMP certifications; 8+ years data engineering experience, 5+ years building lakehouse solutions on Azure Databricks; expertise in Spark, PySpark, SQL, Python, DataOps, CI/CD, and cloud data services.
Azure Databricks, Delta Lake, Unity Catalog, Azure Data Lake Storage Gen2, Databricks Workflows, Databricks Asset Bundles, Delta Live Tables (DLT), Synapse Analytics, Azure Data Factory (ADF), Azure Functions, Azure Key Vault, Azure Monitor, Managed Identities, Event Hub, Event Grid, Service Bus, Apache Spark, PySpark, SQL, Python, Azure DevOps, GitHub Actions, Jenkins, AWS Glue, AWS Lambda, Amazon S3, Amazon RDS, Amazon Redshift, Apache Airflow, Git, Terraform, PowerShell, MLflow, Azure Machine Learning, Databricks ML, REST APIs, GraphQL, CloudWatch, ELK Stack
1mo
Save
Mark Applied
Hide
AVP, Lead Data Engineer
Philadelphia or Jersey City or Simsbury
$153k-$221k/yr OnsiteFull Time
Chubb
ChubbNYSE: CB: Provides property, casualty, and life insurance and reinsurance services globally.
12+ YOEBachelor's degree required; 12+ years data engineering with ETL/ELT, data warehouse design, and automated pipelines. Expertise in Informatica/IICS, Azure (Synapse, ADF, Databricks), Snowflake, Databricks, Autosys, Python/Shell. Must be based in NJ or Greater Philadelphia.
Informatica, IICS, Azure, Synapse Analytics, Azure Data Factory, Azure Databricks, Databricks, Delta Lake, Spark, Snowflake, Snowpark, Autosys, Python, Shell
1mo
Save
Mark Applied
Hide
Senior Data Engineer, Growth, Insights & Analytics (Shelton, CT, US)
Shelton or New York City
$96k-$144k/yr HybridFull Time
Edgewell Personal Care
Edgewell Personal CareNYSE: EPC: Manufacturer of personal care, grooming, and hygiene consumer products.
6+ YOEBachelor's required; 6+ years data engineering experience. Strong SQL and Python; cloud platform experience (AWS/Azure/GCP); Snowflake/Databricks/Redshift/BigQuery; Airflow, dbt, Fivetran; experience with retail media, API-based ingestion, streaming (Kafka/Spark).
SQL, Python, Scala, Java, AWS, Azure, GCP, Snowflake, Databricks, Redshift, BigQuery, Airflow, dbt, Fivetran, Kafka, Spark, Spark Streaming, Microsoft Power BI, Amazon Marketing Cloud (AMC), Amazon Ads, DSP, Walmart Luminate, Kroger Precision Marketing, CitrusAd, Google, Meta, TikTok, IRI, Nielsen, Circana
1mo
Save
Mark Applied
Hide
Senior Data Engineer (AWS, Databricks)
Hartford, Connecticut, United States
$139k-$230k/yr HybridFull Time
Travelers
TravelersNYSE: TRV: Provide property and casualty insurance for individuals and businesses.
6+ YOEBachelor's in STEM or equivalent, 6+ years data engineering experience, strong experience with AWS, Databricks, Snowflake, Ab>Initio, CI/CD, Terraform, AI coding assistants, and mentoring/technical leadership.
AWS, Databricks, Snowflake, Ab>Initio, GDE, Co>Operating System, EME, Iceberg, Delta Lake, Unity Catalog, Spark, pySpark, SQL, Claude Code, Codex, Copilot, Cursor, GitHub Actions, GitLab CI, Jenkins, Terraform
3mo
Save
Mark Applied
Hide
Data Engineer
Greenwich, Connecticut, United States
OnsiteFull Time
W. R. Berkley
W. R. BerkleyNYSE: WRB: Provides commercial property, casualty, and specialty insurance and reinsurance.
4+ YOEData Engineer with strong engineering, coding, and problem-solving skills to design, build, and operate data platforms that support actuaries, analytics, modeling, and AI-enabled workflows.
Python, SQL, PySpark, Databricks, Spark, Snowflake
4w
Save
Mark Applied
Hide
Data Engineer - AWS
New York or New York or New Jersey or Connecticut
$118k-$133k/yr HybridFull Time
VillageCare
VillageCare: Provides managed long-term care and community-based health services.
5+ YOEExperience building ELT/ETL pipelines in AWS; AWS (2+ yrs), SQL (5+ yrs), Python (2+ yrs), Postgres/MySQL (2+ yrs), Redshift (2+ yrs); healthcare data experience (2+ yrs); familiarity with AWS Glue, Spark, Lambda/API Gateway, containers, Git, and Jira. Bachelor's degree required; Master's preferred.
AWS, AWS Glue, Lambda, API Gateway, Spark, Redshift, Postgres, MySQL, Python, SQL, containers, Git, GitHub, Jira
1mo
Save
Mark Applied
Hide
Analytics Engineer, Data Science
Chicago or Austin or Baltimore or Denver or Boulder or Hartford or New Haven or Philadelphia or Providence or Miami
$118k-$173k/yr HybridFull Time
DoorDash
DoorDashNASDAQ: DASH: On-demand delivery platform connecting consumers with local merchants.
2+ YOE2-6+ years in BI/analytics/data engineering; SQL; Python/Scala; Looker/Tableau/Sigma; database fundamentals; data quality checks; strong communication; fast-paced; self-starter.
SQL, Python, Scala, Looker, Tableau, Sigma, S3, Hive, Spark, Pydeequ, Great Expectations
3d
Save
Mark Applied
Hide
Data Architect
Alabama or Arizona or California or Colorado or Connecticut or Florida or Georgia or Illinois or Iowa or Kentucky or Maryland or Massachusetts or Michigan or Minnesota or Missouri or New Jersey or New York or North Carolina or Ohio or Pennsylvania or South Carolina or Tennessee or Texas or Utah
$100k-$200k/yr RemoteFull Time
RegEd
RegEd: Enterprise software for regulatory compliance and risk management.
10+ YOEBachelor's in CS/Data Science,10+ years data engineering/development experience,expertise in data modeling,warehousing,and integrations,experience with Databricks,Azure/AWS,Big Data and governance tools.
Databricks, Azure Data Lake Storage Gen2, Unity Catalog, Azure Data Factory, Microsoft Purview, Hadoop, Spark, AWS, Azure, Phyton, R, SQL
3mo
Save
Mark Applied
Hide
Staff Software Engineer (L4) Data Platform
United States or California or Washington or New York or New Jersey or Pennsylvania or Connecticut
$171k-$214k/yr RemoteFull Time
Twilio
TwilioNYSE: TWLO: Cloud communications platform for building customer engagement applications.
8+ YOEBachelor's degree in CS/Engineering, 8+ years software development experience, expertise in big data technologies (Hadoop, Spark, Kafka), AWS, Python/Java/Scala, data lakehouse formats (Hudi/Iceberg/Delta), and leadership/mentoring skills.
Hadoop, Spark, Kafka, AWS, Python, Java, Scala, Hudi, Iceberg, Delta
4w
Save
Mark Applied
Hide
Data Architect
Indianapolis or Alaska or Alabama or Arkansas or Arizona or California or Colorado or Connecticut or District of Columbia or Delaware or Florida or Georgia or Hawaii or Iowa or Idaho or Illinois or Indiana or Kansas or Kentucky or Louisiana or Massachusetts or Maryland or Maine or Michigan or Minnesota or Missouri or Mississippi or Montana or North Carolina or North Dakota or Nebraska or New Hampshire or New Jersey or New Mexico or Nevada or New York or Ohio or Oklahoma or Oregon or Pennsylvania or Rhode Island or South Carolina or South Dakota or Tennessee or Texas or Utah or Virginia or Vermont or Washington or West Virginia or Wisconsin or Wyoming or United States
$123k-$150k/yr RemoteFull Time
Cummins
CumminsNYSE: CMI: Manufacturer of diesel engines and power generation systems.
College degree or equivalent experience; intermediate data engineering experience with Spark/Scala/Java, Map-Reduce, Hive, HBase, Kafka, SQL, cloud data platforms (Azure preferred), Snowflake, Neo4j, Microsoft Fabric, ETL/ELT, data governance, and dimensional modeling.
Spark, Scala, Java, Map-Reduce, Hive, HBase, Kafka, SQL, Snowflake, Snowpipe, Neo4j, Microsoft Fabric, Delta Lake, Microsoft Data Factory, KQL, Power BI, OneLake, SAP S/4HANA, CDS views, OData, SLT, SDI, ODP, Event Hub, Hadoop, NoSQL
3mo
Save
Mark Applied
Hide
Databricks Engineer
Atlanta or Austin or Boston or Charlotte or Chicago or Dallas or Denver or Detroit or Hartford or Houston or Los Angeles or Miami or Nashville or New Brunswick or New York or Raleigh or Seattle or Tampa or Washington
$90k-$147k/yr OnsiteFull Time
Slalom
Slalom: Provides business and technology consulting and software engineering services.
5+ YOE5+ years data engineering experience, 2+ years building Databricks pipelines and platform features; proficiency with Spark, SQL, Python/Java, EMR/Redshift/Snowflake/BigQuery, orchestration (Airflow/dbt), and data quality tools.
Databricks, Delta Lake, Uniform (Iceberg), Delta Live Tables (Lakeflow Declarative Pipelines), Unity Catalog, Auto Loader, Airflow, dbt, Great Expectations, Collibra, Apache Spark, Presto, Amazon EMR, Amazon Redshift, Snowflake, Google BigQuery, SQL, Stored Procedures, Java, Python, PySpark, Databricks Asset Bundles, Terraform, NoSQL Databases, Container Management Systems, GitHub Copilot, Codex, Claude, Cursor, Windsurf
2mo
Save
Mark Applied
Hide
Senior Data Architect (USA)
Stamford or New York City
$175k-$200k/yr HybridFull Time
Trexquant
Trexquant: Quantitative hedge fund developing systematic trading strategies.
7+ YOE7+ years in data architecture or large-scale data engineering in finance or research; strong Python; experience with data storage and time-series; cloud familiarity; excellent collaboration and documentation.
Python, Parquet, Arrow, Spark, SQL/NoSQL, Distributed file systems, AWS, GCP, Azure, Data lakes, Time-series databases
1mo
Save
Mark Applied
Hide
Senior Data Scientist - ML/AI Digital Workplace Experience
Massachusetts or Connecticut or Texas or Illinois or United States
$93k-$204k/yr RemoteFull Time
CVS Health
CVS HealthNYSE: CVS: Provides retail pharmacy, health insurance, and pharmacy benefit management services.
5+ YOE5+ years delivering production ML/AI solutions; expertise in Generative AI, LLMs, RAG, prompt engineering; advanced Python, scikit-learn, TensorFlow, PyTorch, Hugging Face, LangChain, SQL; Databricks/Spark/BigQuery; MLOps and cloud (Azure/AWS/GCP).
Python, scikit-learn, TensorFlow, PyTorch, Hugging Face, LangChain, LlamaIndex, Semantic Kernel, Pinecone, Weaviate, FAISS, SQL, Databricks, Spark, BigQuery, Azure, AWS, GCP, Azure OpenAI Service, Azure Machine Learning, Microsoft 365, ServiceNow, SHAP, LIME, NLP
3w
Save
Mark Applied
Hide
Sr Data Scientist
Stamford or Irving
$113k-$147k/yr HybridFull Time
Gartner
GartnerNYSE: IT: Provides research and advisory services for business leaders.
6+ YOE6+ years in ML engineering and product development, 2+ years deploying LLMs, experience designing agents, proficiency in Python and deep learning frameworks, strong communication and leadership skills.
Python, PyTorch, TensorFlow, Hugging Face, LangChain, LangGraph, LlamaIndex, SQL, Oracle, MongoDB, Pinecone, Weaviate, Spark, AWS, Azure ML, Model Context Protocol (MCP)
1w
Save
Mark Applied
Hide
Data Scientist, Principal
Oakland or Washington or Ohio or District of Columbia or California or Long Beach or Arizona or Colorado or Connecticut or Florida or Georgia or Maryland or Minnesota or Nevada or Oregon or El Dorado Hills or San Diego or Woodland Hills or Alabama or Illinois or Virginia or Wisconsin or Texas or New York
$182k-$273k/yr HybridFull Time
Ascendiun
Ascendiun: Nonprofit parent overseeing health insurance and clinical service organizations.
8+ YOEAdvanced experience in applied AI/ML and software development, strong Python engineering, hands-on with deep learning and LLM frameworks, experience building production AI applications and leading ML design.
Python, PyTorch, TensorFlow, LangChain, LangGraph, SQL, Spark, Azure, Google Cloud, AWS