25 spark data engineer jobs at 19 companies in Connecticut
🚀PromotedHiringCafe
Founding Machine Learning / AI Search Engineer
Cupertino, CA, US
$160k-$310k/yrOn-SiteFull Time
HiringCafe: Building a 100× better job search engine to take on Indeed and LinkedIn.
Build the ML and AI search behind HiringCafe — ranking, recommenders, retrieval, and LLM agents that surface jobs people would never find on their own.
Chicago or Downers Grove or Alabama or Connecticut or Florida or Georgia or Ohio or Pennsylvania
$112k-$187k/yrHybridFull Time
KemperNYSE: KMPR: Provides specialized auto, life, and health insurance services.
10+ YOE10+ years in data engineering/architecture; expert SQL, Python, Snowflake; experience with ETL/ELT, Spark, Kafka, Airflow, DBT, and cloud-native tools (AWS/Azure); proven technical leadership and mentoring; experience with data governance, security, and regulated industries; bachelor’s or master’s in related field preferred.
The HartfordNYSE: HIG: Provides business and personal insurance, group benefits, and investments.
2+ YOE2+ years relevant experience; Bachelor’s in CS/Engineering/IT/MIS required; experience with R/Python/SQL, Hadoop/Spark, ETL, Linux, Git; familiarity with automation tools and AWS services; strong communication skills.
Arizona or California or Colorado or Connecticut or District of Columbia or Delaware or Florida or Georgia or Illinois or Indiana or Kentucky or Louisiana or Massachusetts or Maine or Maryland or Michigan or Minnesota or Missouri or North Carolina or New Jersey or New York or Oregon or Pennsylvania or South Carolina or Tennessee or Texas or Virginia or Wisconsin
$130k-$150k/yrRemoteFull Time
MissionWired: Providing digital fundraising and data-driven marketing for nonprofit organizations.
5+ YOE5+ years professional software engineering experience; hands-on Apache Spark and distributed data pipelines; experience managing data warehouses or lakes; mentoring and guiding technical decisions; strong data modeling and production skills.
St. Louis or Brentwood or United States or Alaska or Arizona or Arkansas or California or Connecticut or Delaware or Hawaii or Idaho or Louisiana or Maine or Massachusetts or Michigan or Mississippi or Montana or Nebraska or Nevada or New Mexico or New York or North Carolina or North Dakota or Oregon or Rhode Island or South Carolina or South Dakota or Texas or Utah or Vermont or Washington or West Virginia or Wyoming
HybridFull Time
Navitus Health Solutions: Transparent pharmacy benefit management and specialty pharmacy provider.
8+ YOEBachelor's in CS or related (Master's preferred); AWS/Azure/CDMP certifications; 8+ years data engineering experience, 5+ years building lakehouse solutions on Azure Databricks; expertise in Spark, PySpark, SQL, Python, DataOps, CI/CD, and cloud data services.
ChubbNYSE: CB: Provides property, casualty, and life insurance and reinsurance services globally.
12+ YOEBachelor's degree required; 12+ years data engineering with ETL/ELT, data warehouse design, and automated pipelines. Expertise in Informatica/IICS, Azure (Synapse, ADF, Databricks), Snowflake, Databricks, Autosys, Python/Shell. Must be based in NJ or Greater Philadelphia.
Informatica, IICS, Azure, Synapse Analytics, Azure Data Factory, Azure Databricks, Databricks, Delta Lake, Spark, Snowflake, Snowpark, Autosys, Python, Shell
TravelersNYSE: TRV: Provide property and casualty insurance for individuals and businesses.
6+ YOEBachelor's in STEM or equivalent, 6+ years data engineering experience, strong experience with AWS, Databricks, Snowflake, Ab>Initio, CI/CD, Terraform, AI coding assistants, and mentoring/technical leadership.
W. R. BerkleyNYSE: WRB: Provides commercial property, casualty, and specialty insurance and reinsurance.
4+ YOEData Engineer with strong engineering, coding, and problem-solving skills to design, build, and operate data platforms that support actuaries, analytics, modeling, and AI-enabled workflows.
Alabama or Arizona or California or Colorado or Connecticut or Florida or Georgia or Illinois or Iowa or Kentucky or Maryland or Massachusetts or Michigan or Minnesota or Missouri or New Jersey or New York or North Carolina or Ohio or Pennsylvania or South Carolina or Tennessee or Texas or Utah
$100k-$200k/yrRemoteFull Time
RegEd: Enterprise software for regulatory compliance and risk management.
10+ YOEBachelor's in CS/Data Science,10+ years data engineering/development experience,expertise in data modeling,warehousing,and integrations,experience with Databricks,Azure/AWS,Big Data and governance tools.
Databricks, Azure Data Lake Storage Gen2, Unity Catalog, Azure Data Factory, Microsoft Purview, Hadoop, Spark, AWS, Azure, Phyton, R, SQL
United States or California or Washington or New York or New Jersey or Pennsylvania or Connecticut
$171k-$214k/yrRemoteFull Time
TwilioNYSE: TWLO: Cloud communications platform for building customer engagement applications.
8+ YOEBachelor's degree in CS/Engineering, 8+ years software development experience, expertise in big data technologies (Hadoop, Spark, Kafka), AWS, Python/Java/Scala, data lakehouse formats (Hudi/Iceberg/Delta), and leadership/mentoring skills.
Indianapolis or Alaska or Alabama or Arkansas or Arizona or California or Colorado or Connecticut or District of Columbia or Delaware or Florida or Georgia or Hawaii or Iowa or Idaho or Illinois or Indiana or Kansas or Kentucky or Louisiana or Massachusetts or Maryland or Maine or Michigan or Minnesota or Missouri or Mississippi or Montana or North Carolina or North Dakota or Nebraska or New Hampshire or New Jersey or New Mexico or Nevada or New York or Ohio or Oklahoma or Oregon or Pennsylvania or Rhode Island or South Carolina or South Dakota or Tennessee or Texas or Utah or Virginia or Vermont or Washington or West Virginia or Wisconsin or Wyoming or United States
$123k-$150k/yrRemoteFull Time
CumminsNYSE: CMI: Manufacturer of diesel engines and power generation systems.
College degree or equivalent experience; intermediate data engineering experience with Spark/Scala/Java, Map-Reduce, Hive, HBase, Kafka, SQL, cloud data platforms (Azure preferred), Snowflake, Neo4j, Microsoft Fabric, ETL/ELT, data governance, and dimensional modeling.
Spark, Scala, Java, Map-Reduce, Hive, HBase, Kafka, SQL, Snowflake, Snowpipe, Neo4j, Microsoft Fabric, Delta Lake, Microsoft Data Factory, KQL, Power BI, OneLake, SAP S/4HANA, CDS views, OData, SLT, SDI, ODP, Event Hub, Hadoop, NoSQL
Atlanta or Austin or Boston or Charlotte or Chicago or Dallas or Denver or Detroit or Hartford or Houston or Los Angeles or Miami or Nashville or New Brunswick or New York or Raleigh or Seattle or Tampa or Washington
$90k-$147k/yrOnsiteFull Time
Slalom: Provides business and technology consulting and software engineering services.
5+ YOE5+ years data engineering experience, 2+ years building Databricks pipelines and platform features; proficiency with Spark, SQL, Python/Java, EMR/Redshift/Snowflake/BigQuery, orchestration (Airflow/dbt), and data quality tools.
Trexquant: Quantitative hedge fund developing systematic trading strategies.
7+ YOE7+ years in data architecture or large-scale data engineering in finance or research; strong Python; experience with data storage and time-series; cloud familiarity; excellent collaboration and documentation.
GartnerNYSE: IT: Provides research and advisory services for business leaders.
6+ YOE6+ years in ML engineering and product development, 2+ years deploying LLMs, experience designing agents, proficiency in Python and deep learning frameworks, strong communication and leadership skills.
Oakland or Washington or Ohio or District of Columbia or California or Long Beach or Arizona or Colorado or Connecticut or Florida or Georgia or Maryland or Minnesota or Nevada or Oregon or El Dorado Hills or San Diego or Woodland Hills or Alabama or Illinois or Virginia or Wisconsin or Texas or New York
$182k-$273k/yrHybridFull Time
Ascendiun: Nonprofit parent overseeing health insurance and clinical service organizations.
8+ YOEAdvanced experience in applied AI/ML and software development, strong Python engineering, hands-on with deep learning and LLM frameworks, experience building production AI applications and leading ML design.