17 spark data engineer jobs at 10 companies in Agawam, MA
2mo
Save
Mark Applied
Hide
2mo
Sr. Staff Data Engineer
Hartford, Connecticut, United States
$150k-$185k/yrRemoteFull Time
The HartfordNYSE: HIG: Provides business and personal insurance, group benefits, and investments.
5+ YOEBachelor's in CS/Engineering, 5+ years in software development or data engineering, 5 years in programming/SDLC/distributed systems/data warehousing/ETL, 3 years in CICD/big data/cloud (AWS/Azure)/Python or Spark/Snowflake/datamesh/datalake.
Associate Data Engineer / Data Engineer II / Senior Data Engineer (REMOTE)
Worcester, Massachusetts, United States
$60k-$130k/yrRemoteFull Time
The Hanover Insurance GroupNYSE: THG: Provides property and casualty insurance products and services.
0+ YOEDegree in data-related field, experience with data engineering/ETL, proficiency in SQL and Python, experience with Azure and Databricks, strong problem-solving and communication; must be eligible to work in the US without sponsorship.
Azure Synapse, Data Factory, ADLS, Databricks, Delta Tables, Spark, PySpark, SQL, T-SQL, Python, Java, Scala, Power BI, GitHub, Azure DevOps
Associate Data Engineer / Data Engineer II / Senior Data Engineer (REMOTE)
Worcester, Massachusetts, United States
$60k-$130k/yrRemoteFull Time
The Hanover Insurance GroupNYSE: THG: Provides property and casualty insurance products to individuals and businesses.
0+ YOEDegree in Data Science/Computer Science or related, experience in data engineering/ETL/data modeling (levels 0–5+ years), proficiency in SQL and Python, experience with Azure cloud platforms preferred, strong problem-solving and communication, US work authorization required.
Azure Synapse, Data Factory, ADLS, Data Lake, Databricks, Delta Tables, Spark, PySpark, SQL, T-SQL, Python, Java, Scala, Microsoft Power BI, GitHub, Azure DevOps, Azure
ChubbNYSE: CB: Provides property, casualty, and life insurance and reinsurance services globally.
12+ YOEBachelor's degree required; 12+ years data engineering with ETL/ELT, data warehouse design, and automated pipelines. Expertise in Informatica/IICS, Azure (Synapse, ADF, Databricks), Snowflake, Databricks, Autosys, Python/Shell. Must be based in NJ or Greater Philadelphia.
Informatica, IICS, Azure, Synapse Analytics, Azure Data Factory, Azure Databricks, Databricks, Delta Lake, Spark, Snowflake, Snowpark, Autosys, Python, Shell
TravelersNYSE: TRV: Provide property and casualty insurance for individuals and businesses.
6+ YOEBachelor's in STEM or equivalent, 6+ years data engineering experience, strong experience with AWS, Databricks, Snowflake, Ab>Initio, CI/CD, Terraform, AI coding assistants, and mentoring/technical leadership.
The HartfordNYSE: HIG: Provides business and personal insurance, group benefits, and investments.
12+ YOE12+ years leading enterprise data platform engineering and modernization; hands-on with Snowflake, Spark, BigQuery, Dataproc, Dataflow, Informatica IDMC; experience with analytics, third-party data, AI-ready data solutions; Bachelor's degree required.
TravelersNew York Stock Exchange: TRV: Provider of commercial and personal property casualty insurance.
10+ YOE10+ years building production data pipelines with AWS, Databricks, Snowflake and AbInitio; bachelor’s in STEM or equivalent; strong mentoring, SDLC, CI/CD, and AI-assistant experience.
Data Engineer II (Tech Lead) – AWS, Databricks, Snowflake
Hartford or Colorado
$127k-$209k/yrHybridFull Time
TravelersNew York Stock Exchange: TRV: Provider of commercial and personal property casualty insurance.
8+ YOEBachelor's degree in computer science or STEM or equivalent, 8 years related experience, and expertise building scalable data solutions with AWS, Databricks, Snowflake, and AbInitio or similar platforms.
Berkshire Health Systems: Provides comprehensive medical, surgical, and emergency healthcare services.
Proven data architecture experience with NoSQL, SQL, Hadoop, Spark, Oracle, Microsoft SQL Server and Microsoft Fabric Data Lake; cloud (AWS/Azure); data modeling, ETL, data warehouse; bachelor's degree in CS/data science/engineering or related.
NoSQL, SQL, Hadoop, Spark, Oracle, Microsoft SQL Server, Microsoft Fabric Data Lake, AWS, Azure, Java, Python, Bash (Unix shell)
HCLTechNational Stock Exchange of India: HCLTECH: Global technology providing digital, engineering, and cloud services.
11+ YOEUS citizenship and 11+ years of experience designing enterprise data platforms, Lakehouse architectures, scalable pipelines, ETL/ELT frameworks, and Azure cloud data solutions using Python, Spark, Databricks, and related technologies.
Python, SQL, PySpark, Scala, Azure Databricks, Azure Synapse Analytics, Azure Data Factory (ADF), ADLS Gen2, Event Hubs, Azure Functions, Azure Machine Learning, Microsoft Purview, Apache Iceberg, Delta Lake, Hudi, Terraform, GitHub Actions, Azure DevOps, Jenkins, Airflow, dbt, Great Expectations, Power BI, REST APIs, Flask, Spark, Kafka, Kinesis, Flink, Spark Streaming, SageMaker, MLflow, Microsoft Excel
InfosysNYSE: INFY: Provides IT consulting, software development, and business outsourcing services.
Bachelor's degree or equivalent experience; requires Informatica, Python, AWS, SQL, Oracle, GitLab, ETL and data testing, automation, data validation, and software development lifecycle experience.
Charlotte or Hartford or Columbus or Chicago or United States
$153k-$229k/yrHybridFull Time
The HartfordNYSE: HIG: Provides property and casualty insurance and financial products.
10+ YOE10+ years in data, cloud, platform, reliability engineering, or distributed systems; expertise in Snowflake, EMR, Hadoop/Spark, AWS/GCP, automation, observability, IaC, CI/CD, and technical leadership.
Associate Scientific Technical Engineer II, PDS&T CMC
Worcester or North Chicago
$66k-$126k/yrHybridFull Time
AbbVieNYSE: ABBV: Develops and sells innovative pharmaceutical and biopharmaceutical medicines.
2+ YOEBachelor's degree plus 2 years or master's degree; expertise in Python, SQL, data pipelines, cloud platforms, ETL/ELT, data modeling, governance, APIs, and AI/ML data infrastructure.
The HartfordNYSE: HIG: Provides property and casualty insurance and financial products.
4+ YOERequires a master's degree or equivalent experience, 4+ years of ML engineering and Python development, cloud experience with AWS and GCP, IaC, CI/CD, SQL, and model lifecycle expertise.
New York City or Milwaukee or Dallas or Columbus or Kirkland or Cincinnati or Cleveland or Oklahoma City or Austin or Albany or Chicago or St. Petersburg or Hartford or Pittsburgh or St. Louis or Miami or Sacramento or Raleigh or Minneapolis or Mountain View or Scottsdale or San Francisco or Morristown or Denver or Boston or Philadelphia or Des Moines or Overland Park or Los Angeles or Charlotte or Walnut Creek or Carmel or Seattle or Houston or Arlington or Atlanta or Redmond or Bentonville or Beaverton or Nashville or Detroit or San Diego
$80k-$294k/yrHybridFull Time
AccentureNYSE: ACN: Global provider of management consulting and technology services.
6+ YOEBachelor's degree or equivalent experience, 6+ years developing and deploying AI/ML solutions, programming proficiency, experience with ML frameworks, big data, databases, and cloud platforms.
Python, R, Java, TensorFlow, PyTorch, Hadoop, Spark, AWS, Microsoft Azure, Google Cloud, D3.js, ggplot
Albany or Arlington or Atlanta or Austin or Beaverton or Bentonville or Boston or Carmel or Charlotte or Chicago or Cincinnati or Cleveland or Columbus or Culver City or Denver or Des Moines or Detroit or Hartford or Houston or Irving or Kirkland or Miami or Milwaukee or Minneapolis or Morristown or Mountain View or Nashville or New York City or Oklahoma City or Overland Park or Philadelphia or Pittsburgh or Raleigh or Redmond or Sacramento or San Diego or San Francisco or Scottsdale or Seattle or St. Louis or St. Petersburg or Walnut Creek or United States
$80k-$294k/yrHybridFull Time
AccentureNYSE: ACN: Global professional services firm providing consulting and technology solutions.
6+ YOERequires 6+ years developing AI/ML solutions, programming in Python, R, or Java, machine learning frameworks, data analysis, cloud platforms, and strong communication skills.