HiringCafe
Join our community

20 spark data engineer jobs at 14 companies in Springfield, MA

PromotedHiringCafe
Founding Machine Learning / AI Search Engineer
Cupertino, CA, US
$160k-$310k/yr On-SiteFull Time
HiringCafe
HiringCafe: Building a 100× better job search engine to take on Indeed and LinkedIn.
Build the ML and AI search behind HiringCafe — ranking, recommenders, retrieval, and LLM agents that surface jobs people would never find on their own.
Python, PyTorch, Elasticsearch, LLMs
Help us #BeatIndeed & #BeatLinkedIn
1mo
Save
Mark Applied
Hide
Data Engineer
Charlotte or Chicago or Hartford or Columbus
$101k-$151k/yr HybridFull Time
The Hartford
The HartfordNYSE: HIG: Provides business and personal insurance, group benefits, and investments.
2+ YOE2+ years relevant experience; Bachelor’s in CS/Engineering/IT/MIS required; experience with R/Python/SQL, Hadoop/Spark, ETL, Linux, Git; familiarity with automation tools and AWS services; strong communication skills.
R, Python, SQL, Hadoop, Spark, XML, JSON, ETL, Linux, Git, GitHub, Autosys, Cron, Airflow, Amazon S3, Amazon EMR, MLOps, Agile
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior GCP Data Engineer
Hartford, Connecticut, United States
HybridFull Time
EXL
EXLNASDAQ: EXLS: Provides data analytics and digital operations solutions to businesses.
9+ YOE8+ years in Data Engineering with leadership; strong GCP, SQL, Python; ETL and Spark; data modeling; cross-functional collaboration; leadership.
BigQuery, Cloud Composer (Airflow), Cloud Storage, Dataproc, Apache Spark, SQL, Python, Scala
Job PostingView all
2w
Save
Mark Applied
Hide
Associate Data Engineer / Data Engineer II / Senior Data Engineer (REMOTE)
Worcester, Massachusetts, United States
$60k-$130k/yr RemoteFull Time
The Hanover Insurance Group
The Hanover Insurance GroupNYSE: THG: Provides property and casualty insurance products and services.
0+ YOEDegree in data-related field, experience with data engineering/ETL, proficiency in SQL and Python, experience with Azure and Databricks, strong problem-solving and communication; must be eligible to work in the US without sponsorship.
Azure Synapse, Data Factory, ADLS, Databricks, Delta Tables, Spark, PySpark, SQL, T-SQL, Python, Java, Scala, Power BI, GitHub, Azure DevOps
Job PostingView all
2w
Save
Mark Applied
Hide
Associate Data Engineer / Data Engineer II / Senior Data Engineer (REMOTE)
Worcester, Massachusetts, United States
$60k-$130k/yr RemoteFull Time
The Hanover Insurance Group
The Hanover Insurance GroupNYSE: THG: Provides property and casualty insurance products to individuals and businesses.
0+ YOEDegree in Data Science/Computer Science or related, experience in data engineering/ETL/data modeling (levels 0–5+ years), proficiency in SQL and Python, experience with Azure cloud platforms preferred, strong problem-solving and communication, US work authorization required.
Azure Synapse, Data Factory, ADLS, Data Lake, Databricks, Delta Tables, Spark, PySpark, SQL, T-SQL, Python, Java, Scala, Microsoft Power BI, GitHub, Azure DevOps, Azure
Job PostingView all
1mo
Save
Mark Applied
Hide
AVP, Lead Data Engineer
Philadelphia or Jersey City or Simsbury
$153k-$221k/yr OnsiteFull Time
Chubb
ChubbNYSE: CB: Provides property, casualty, and life insurance and reinsurance services globally.
12+ YOEBachelor's degree required; 12+ years data engineering with ETL/ELT, data warehouse design, and automated pipelines. Expertise in Informatica/IICS, Azure (Synapse, ADF, Databricks), Snowflake, Databricks, Autosys, Python/Shell. Must be based in NJ or Greater Philadelphia.
Informatica, IICS, Azure, Synapse Analytics, Azure Data Factory, Azure Databricks, Databricks, Delta Lake, Spark, Snowflake, Snowpark, Autosys, Python, Shell
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Data Engineer (AWS, Databricks)
Hartford, Connecticut, United States
$139k-$230k/yr HybridFull Time
Travelers
TravelersNYSE: TRV: Provide property and casualty insurance for individuals and businesses.
6+ YOEBachelor's in STEM or equivalent, 6+ years data engineering experience, strong experience with AWS, Databricks, Snowflake, Ab>Initio, CI/CD, Terraform, AI coding assistants, and mentoring/technical leadership.
AWS, Databricks, Snowflake, Ab>Initio, GDE, Co>Operating System, EME, Iceberg, Delta Lake, Unity Catalog, Spark, pySpark, SQL, Claude Code, Codex, Copilot, Cursor, GitHub Actions, GitLab CI, Jenkins, Terraform
Job PostingView all
2mo
Save
Mark Applied
Hide
Specialist, Actuarial Data Engineer (Charlotte, NC, US)
Charlotte or Fort Wayne or Greensboro or Hartford or Omaha or Radnor
$56k-$100k/yr HybridFull Time
Lincoln Financial
Lincoln FinancialNew York Stock Exchange: LNC: Provides life insurance, annuities, and retirement planning services.
1+ YOEUndergraduate degree in a quantitative field; 1-3+ years of relevant experience; experience with data analytics and data engineering tools.
Dataiku, Tableau, AWS, Spark, SQL, Hive, Python, R, SAS, VBA
Job PostingView all
1mo
Save
Mark Applied
Hide
Analytics Engineer, Data Science
Chicago or Austin or Baltimore or Denver or Boulder or Hartford or New Haven or Philadelphia or Providence or Miami
$118k-$173k/yr HybridFull Time
DoorDash
DoorDashNASDAQ: DASH: On-demand delivery platform connecting consumers with local merchants.
2+ YOE2-6+ years in BI/analytics/data engineering; SQL; Python/Scala; Looker/Tableau/Sigma; database fundamentals; data quality checks; strong communication; fast-paced; self-starter.
SQL, Python, Scala, Looker, Tableau, Sigma, S3, Hive, Spark, Pydeequ, Great Expectations
Job PostingView all
1w
Save
Mark Applied
Hide
Data & Analytics Lead Architech
Pittsfield, Massachusetts, United States
$40-$60/hr OnsiteFull Time
Berkshire Health Systems
Berkshire Health Systems: Provides comprehensive medical, surgical, and emergency healthcare services.
Proven data architecture experience with NoSQL, SQL, Hadoop, Spark, Oracle, Microsoft SQL Server and Microsoft Fabric Data Lake; cloud (AWS/Azure); data modeling, ETL, data warehouse; bachelor's degree in CS/data science/engineering or related.
NoSQL, SQL, Hadoop, Spark, Oracle, Microsoft SQL Server, Microsoft Fabric Data Lake, AWS, Azure, Java, Python, Bash (Unix shell)
Job PostingView all
3mo
Save
Mark Applied
Hide
Data Architect
Springfield or United States
$120k-$160k/yr RemoteFull Time
Farm Credit Financial Partners
Farm Credit Financial Partners: Provider of technology products and services to Farm Credit.
5+ YOEFive or more years in data architecture or data engineering with cloud platforms.
Azure Data Lake, Azure Synapse, Databricks, Snowflake, AWS Redshift, BigQuery, SQL, Python, Scala, Spark, Kafka, Kinesis, Event Hubs, Pub/Sub, ETL, ELT, Data Governance, Data Catalogs, Metadata Management, Knowledge Graphs, Vector Databases, Embeddings, Graph Databases
Job PostingView all
2mo
Save
Mark Applied
Hide
Databricks Engineer
Atlanta or Austin or Boston or Charlotte or Chicago or Dallas or Denver or Detroit or Hartford or Houston or Los Angeles or Miami or Nashville or New Brunswick or New York or Raleigh or Seattle or Tampa or Washington
$90k-$147k/yr OnsiteFull Time
Slalom
Slalom: Provides business and technology consulting and software engineering services.
5+ YOE5+ years data engineering experience, 2+ years building Databricks pipelines and platform features; proficiency with Spark, SQL, Python/Java, EMR/Redshift/Snowflake/BigQuery, orchestration (Airflow/dbt), and data quality tools.
Databricks, Delta Lake, Uniform (Iceberg), Delta Live Tables (Lakeflow Declarative Pipelines), Unity Catalog, Auto Loader, Airflow, dbt, Great Expectations, Collibra, Apache Spark, Presto, Amazon EMR, Amazon Redshift, Snowflake, Google BigQuery, SQL, Stored Procedures, Java, Python, PySpark, Databricks Asset Bundles, Terraform, NoSQL Databases, Container Management Systems, GitHub Copilot, Codex, Claude, Cursor, Windsurf
Job PostingView all
3w
Save
Mark Applied
Hide
Senior AI Platform Engineer
San Francisco or Boston or Jacksonville or New York or Windsor
$140k-$180k/yr HybridFull Time
SS&C Technologies
SS&C TechnologiesNasdaq: SSNC: Provides software and technology for financial and healthcare sectors.
5+ YOE5+ years Python experience; data engineering/distributed systems (Spark, Hive, Trino, StarRocks, DBT, Airflow, Kubernetes); LLM and agent frameworks (LangChain, LlamaIndex, DSPy, OpenAI MCP, A2A); API design (REST, GraphQL, gRPC); cloud/containerization and enterprise security.
Python, Spark, Hive, Trino, StarRocks, DBT, Airflow, Kubernetes, Docker, LangChain, LlamaIndex, DSPy, OpenAI MCP, A2A, REST, GraphQL, gRPC, pgvector, Pinecone, Weaviate, Milvus, Vespa, Kafka, Pulsar, OpenTelemetry, DataHub, MLflow, Prometheus, Hugging Face
Job PostingView all
4d
Save
Mark Applied
Hide
Data Scientist, Principal
Oakland or Washington or Ohio or District of Columbia or California or Long Beach or Arizona or Colorado or Connecticut or Florida or Georgia or Maryland or Minnesota or Nevada or Oregon or El Dorado Hills or San Diego or Woodland Hills or Alabama or Illinois or Virginia or Wisconsin or Texas or New York
$182k-$273k/yr HybridFull Time
Ascendiun
Ascendiun: Nonprofit parent overseeing health insurance and clinical service organizations.
8+ YOEAdvanced experience in applied AI/ML and software development, strong Python engineering, hands-on with deep learning and LLM frameworks, experience building production AI applications and leading ML design.
Python, PyTorch, TensorFlow, LangChain, LangGraph, SQL, Spark, Azure, Google Cloud, AWS
Job PostingView all
1w
Save
Mark Applied
Hide
Technology Consultant 2
Bentonville or Hartford or Indianapolis or Phoenix or Raleigh or Richardson
OnsiteFull Time
Infosys
InfosysNYSE: INFY: Provides IT consulting, software development, and business outsourcing services.
Hands-on GCP, BigQuery, GCS, Apache Spark, Scala/Python, Airflow, and advanced SQL skills; experience implementing CI/CD; bachelor’s degree or equivalent experience; U.S. work authorization required.
GCP, BigQuery, Google Cloud Storage (GCS), Scala, Python, Apache Spark, Apache Airflow, SQL, CI/CD, Power BI
Job PostingView all
3mo
Save
Mark Applied
Hide
AI Integrator #1744026
Chicopee, Massachusetts, United States
$168k-$197k/yr OnsiteFull Time
Network Designs, Inc.
Network Designs, Inc.: Provides IT, network, and cybersecurity solutions to government agencies.
12+ YOEBachelor's in Engineering/CS; 12+ years software/architecture/data; 5+ years AI/ML; TensorFlow/PyTorch/scikit-learn/Keras; Spark/Databricks/Hadoop; Python/Django; REST/GraphQL; Docker/Kubernetes; DevSecOps; CAC eligibility; US citizenship.
TensorFlow, PyTorch, scikit-learn, Keras, Apache Spark, Databricks, Hadoop, PostgreSQL, Python, Django, Celery, Linux, REST, GraphQL, MQTT, Docker, Kubernetes, CI/CD, DevSecOps
Job PostingView all

Explore Jobs

Expand Your Job Search