HiringCafe
Join our community

19 pyspark developer jobs at 10 companies in Springfield, MA

1mo
Save
Mark Applied
Hide
Palantir Forward Deployed Engineer
Chicago or Milwaukee or Dallas or Columbus or Kirkland or Cincinnati or New York or Cleveland or Oklahoma City or Austin or Albany or St. Petersburg or Hartford or Pittsburgh or St. Louis or Miami or Sacramento or Raleigh or Minneapolis or Mountain View or Scottsdale or San Francisco or Morristown or Denver or Boston or Philadelphia or Des Moines or Overland Park or Los Angeles or Charlotte or Walnut Creek or Carmel or Seattle or Houston or Arlington or Atlanta or Redmond or Bentonville or Beaverton or Nashville or Detroit or San Diego
$54k-$235k/yr HybridFull Time
Accenture
AccentureNYSE: ACN: Global provider of management consulting and technology services.
3+ YOE3+ years data engineering; 1+ year Palantir Foundry experience; 1+ year prompt engineering/AIP; 3+ years cloud (AWS/Azure/GCP); 3+ years Python/PySpark/Java; Bachelor's in CS/Engineering or equivalent; strong communication.
Palantir Foundry, Palantir Gotham, Artificial Intelligence Platform (AIP), Python, TypeScript, PySpark, Java, AWS, Azure, GCP, Git, GitHub, GitLab, Jenkins
Job PostingView all
1mo
Save
Mark Applied
Hide
Palantir Forward Deployed Senior Engineer
Chicago or Milwaukee or Dallas or Columbus or Kirkland or Cincinnati or New York City or Cleveland or Oklahoma City or Austin or Albany or St. Petersburg or Hartford or Pittsburgh or St. Louis or Miami or Sacramento or Raleigh or Minneapolis or Mountain View or Scottsdale or San Francisco or Morristown or Denver or Boston or Philadelphia or Des Moines or Overland Park or Los Angeles or Charlotte or Walnut Creek or Carmel or Seattle or Houston or Arlington or Atlanta or Redmond or Bentonville or Beaverton or Nashville or Detroit or San Diego
$80k-$305k/yr HybridFull Time
Accenture
AccentureNYSE: ACN: Global provider of management consulting and technology services.
5+ YOE5+ years data engineering; 3+ years Palantir Foundry/Gotham/AIP experience; 5+ years cloud (AWS/Azure/GCP); 5+ years Python/PySpark/Java; Bachelor’s in CS/Engineering or equivalent; strong client-facing and communication skills.
Palantir Foundry, Palantir Gotham, Palantir AIP, Python, PySpark, Java, TypeScript, AWS, Azure, GCP, Git, GitHub, GitLab, Jenkins
Job PostingView all
1w
Save
Mark Applied
Hide
Data Engineer II (AWS, Databricks, AI)
Hartford or St. Paul
$127k-$209k/yr HybridFull Time
Travelers
TravelersNYSE: TRV: Provide property and casualty insurance for individuals and businesses.
8+ YOEBachelor's in a STEM field, ~8 years related experience, strong hands-on AWS, Databricks, PySpark, AI/ML platform experience, data governance and leadership experience.
AWS, Databricks, PySpark, Bedrock, Databricks Unity Catalog, Snowflake, Azure
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Data Engineer, Underwriting Technical Lead
Hartford or St. Paul
$139k-$230k/yr HybridFull Time
Travelers
TravelersNYSE: TRV: Provide property and casualty insurance for individuals and businesses.
10+ YOEBachelor's in STEM or equivalent; ~10 years related experience with 6+ years in data engineering; expertise with AWS (S3, Glue, Redshift, Lambda, EMR), Databricks, dbt, PySpark; AI/ML knowledge; technical leadership and mentoring experience.
AWS, S3, Glue, Redshift, Lambda, EMR, Databricks, dbt, PySpark, Azure Data Factory, Synapse Analytics, Azure Databricks
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Staff Data Engineer
Hartford or Chicago or Columbus or Charlotte
$135k-$203k/yr HybridFull Time
The Hartford
The HartfordNYSE: HIG: Provides business and personal insurance, group benefits, and investments.
8+ YOE8+ years data engineering experience; hands-on with Snowflake, Oracle, Informatica, GitHub, Qlik, SharePlex, DMS; AWS/Azure, EMR, S3, Lambda; Python/PySpark, SQL/NoSQL, CI/CD, ETL; authorized to work in the US without sponsorship.
AWS, Azure, Amazon EMR, Amazon S3, AWS Lambda, Hadoop, Apache Spark, Apache Kafka, Snowflake, Oracle, Informatica Cloud, Informatica PowerCenter, GitHub, Qlik, SharePlex, OpenFlow, DMS, PySpark, Python, SQL, NoSQL, CI/CD, Google Cloud Platform (GCP), AWS Bedrock, Vertex AI
Job PostingView all
3w
Save
Mark Applied
Hide
Retail Actuarial Data Engineer
Charlotte or Hartford
$100k-$130k/yr HybridFull Time
Talcott Financial Group
Talcott Financial Group: International life insurance group providing risk and retirement solutions.
3+ YOEBachelor's in a quantitative field, minimum 3 years actuarial/data engineering/data science experience in insurance, strong SQL, ETL knowledge, experience with Python/PySpark and Power BI preferred, experience using AI tools, strong problem-solving and communication.
SQL, Python, PySpark, Power BI, ETL, AI tools and models
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer I (AWS, Python, GenAI)
Hartford or Richardson or St. Paul
$109k-$180k/yr HybridFull Time
Travelers
TravelersNYSE: TRV: Provide property and casualty insurance for individuals and businesses.
6+ YOEBachelor's in computer science or related STEM (or equivalent), 6+ years related experience including 3+ as a data engineer, 2+ years ETL with Python or PySpark, AWS cloud experience (S3, IAM, Lambda, Secrets Manager, EC2), Generative AI/LLM experience, data governance and strong communication.
Python, PySpark, ETL, AWS, Azure, Google, S3, IAM, Lambda, Secrets Manager, EC2, Generative AI, large language models
Job PostingView all
3mo
Save
Mark Applied
Hide
Databricks Engineer
Atlanta or Austin or Boston or Charlotte or Chicago or Dallas or Denver or Detroit or Hartford or Houston or Los Angeles or Miami or Nashville or New Brunswick or New York or Raleigh or Seattle or Tampa or Washington
$90k-$147k/yr OnsiteFull Time
Slalom
Slalom: Provides business and technology consulting and software engineering services.
5+ YOE5+ years data engineering experience, 2+ years building Databricks pipelines and platform features; proficiency with Spark, SQL, Python/Java, EMR/Redshift/Snowflake/BigQuery, orchestration (Airflow/dbt), and data quality tools.
Databricks, Delta Lake, Uniform (Iceberg), Delta Live Tables (Lakeflow Declarative Pipelines), Unity Catalog, Auto Loader, Airflow, dbt, Great Expectations, Collibra, Apache Spark, Presto, Amazon EMR, Amazon Redshift, Snowflake, Google BigQuery, SQL, Stored Procedures, Java, Python, PySpark, Databricks Asset Bundles, Terraform, NoSQL Databases, Container Management Systems, GitHub Copilot, Codex, Claude, Cursor, Windsurf
Job PostingView all
1w
Save
Mark Applied
Hide
Data Engineer
Atlanta or Baltimore or Boston or Charlotte or Columbus or Detroit or Hartford or Miami or New York or Philadelphia or Raleigh or Tampa or Washington
$91k-$122k/yr OnsiteFull Time
Slalom
Slalom: Provides business and technology consulting and software engineering services.
4+ YOE4+ years building production data engineering solutions; experience with cloud data platforms, streaming, orchestration, Python/Java; strong communication and critical thinking.
Amazon Redshift, Snowflake, Google BigQuery, Azure Synapse Analytics, Amazon EMR, Apache Spark, Presto, Databricks, Amazon Kinesis, Apache Kafka, Apache Airflow, dbt, Dagster, Azure Data Factory, DynamoDB, Cosmos DB, MongoDB, Kubernetes, Amazon ECS, Amazon SageMaker, Azure ML Studio, Python, Java
Job PostingView all
3w
Save
Mark Applied
Hide
Associate Data Engineer / Data Engineer II / Senior Data Engineer (REMOTE)
Worcester, Massachusetts, United States
$60k-$130k/yr RemoteFull Time
The Hanover Insurance Group
The Hanover Insurance GroupNYSE: THG: Provides property and casualty insurance products to individuals and businesses.
0+ YOEDegree in Data Science/Computer Science or related, experience in data engineering/ETL/data modeling (levels 0–5+ years), proficiency in SQL and Python, experience with Azure cloud platforms preferred, strong problem-solving and communication, US work authorization required.
Azure Synapse, Data Factory, ADLS, Data Lake, Databricks, Delta Tables, Spark, PySpark, SQL, T-SQL, Python, Java, Scala, Microsoft Power BI, GitHub, Azure DevOps, Azure
Job PostingView all
3w
Save
Mark Applied
Hide
Associate Data Engineer / Data Engineer II / Senior Data Engineer (REMOTE)
Worcester, Massachusetts, United States
$60k-$130k/yr RemoteFull Time
The Hanover Insurance Group
The Hanover Insurance GroupNYSE: THG: Provides property and casualty insurance products and services.
0+ YOEDegree in data-related field, experience with data engineering/ETL, proficiency in SQL and Python, experience with Azure and Databricks, strong problem-solving and communication; must be eligible to work in the US without sponsorship.
Azure Synapse, Data Factory, ADLS, Databricks, Delta Tables, Spark, PySpark, SQL, T-SQL, Python, Java, Scala, Power BI, GitHub, Azure DevOps
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior GCP Data Engineer
Hartford, Connecticut, United States
HybridFull Time
EXL
EXLNASDAQ: EXLS: Provides data analytics and digital operations solutions to businesses.
9+ YOE8+ years in Data Engineering with leadership; strong GCP, SQL, Python; ETL and Spark; data modeling; cross-functional collaboration; leadership.
BigQuery, Cloud Composer (Airflow), Cloud Storage, Dataproc, Apache Spark, SQL, Python, Scala
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer (CT, Newington)
Newington, Connecticut, United States
OnsiteFull Time
Applied Aerospace & Defense
Applied Aerospace & Defense: Manufactures precision flight-critical hardware for aerospace and defense.
Bachelor's in a technical field (or equivalent), extensive data engineering experience with SQL and Python, BI and ETL tool proficiency, experience deploying ML models, and familiarity with CMMC/NIST SP 800-171 and ITAR eligibility requirements.
SQL, Python, Microsoft SQL Server, Oracle, PostgreSQL, Microsoft Power BI, SSRS, PowerShell, C#, Perl, Microsoft SharePoint, ASP.NET Core, PHP, Bootstrap, HTML5, React.js, Node.js, Django, Microsoft Graph API, Microsoft Power Platform, Power Apps, Power Automate, Tableau, Qlik, Looker, MicroStrategy, Oracle Analytics, Microsoft Power Query, SSIS, Talend, Boomi, Apache Airflow, Prefect, Dagster, Apache Spark, Databricks, MLOps
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Data Engineer (AWS, Databricks)
Hartford, Connecticut, United States
$139k-$230k/yr HybridFull Time
Travelers
TravelersNYSE: TRV: Provide property and casualty insurance for individuals and businesses.
6+ YOEBachelor's in STEM or equivalent, 6+ years data engineering experience, strong experience with AWS, Databricks, Snowflake, Ab>Initio, CI/CD, Terraform, AI coding assistants, and mentoring/technical leadership.
AWS, Databricks, Snowflake, Ab>Initio, GDE, Co>Operating System, EME, Iceberg, Delta Lake, Unity Catalog, Spark, pySpark, SQL, Claude Code, Codex, Copilot, Cursor, GitHub Actions, GitLab CI, Jenkins, Terraform
Job PostingView all
2d
Save
Mark Applied
Hide
Data Engineer I (Databricks, SQL)
Hartford or St. Paul
$109k-$180k/yr HybridFull Time
Travelers
TravelersNYSE: TRV: Provide property and casualty insurance for individuals and businesses.
6+ YOEExperience designing and building data solutions using SQL and Databricks; BI tool experience (Qlik or MicroStrategy); Bachelor's in STEM; 6+ years related experience; authorized to work in the U.S.
SQL, Databricks, Qlik, MicroStrategy, GitHub, Python, PySpark
Job PostingView all
3w
Save
Mark Applied
Hide
Senior Technologist
Arizona or Connecticut or North Carolina or Texas or Charlotte or Hartford or Raleigh or Richardson or Tempe or United States
OnsiteFull Time
Infosys
InfosysNYSE: INFY: Provides IT consulting, software development, and business outsourcing services.
Expertise in big data architecture and development (Scala/Python/Spark/Hadoop), cloud platforms (Azure, Google, Snowflake), data integration and governance, experience with Kafka/Elasticsearch/PySpark, strong communication and leadership; U.S. work authorization required; bachelor’s degree or equivalent.
Python, Scala, PySpark, Spark, Hadoop, Cloudera, Hive, HBase, Sqoop, Kafka, Elasticsearch, Grafana, ELK, Snowflake, Azure, Google Big Data platforms, LangGraph, LangChain, Ranger, Atlas, Tez, Hive LLAP, Neo4J, NiFi, Airflow, Kubernetes, OpenShift, Docker
Job PostingView all
2w
Save
Mark Applied
Hide
DE II - Databricks Platform
Hartford or St. Paul or Hunt Valley
$127k-$209k/yr HybridFull Time
Travelers
TravelersNYSE: TRV: Provide property and casualty insurance for individuals and businesses.
8+ YOEBachelor's in STEM or equivalent, ~8 years related experience with at least 4 years in data engineering, advanced experience with Databricks, Unity Catalog, PySpark and AWS, strong communication and stakeholder management.
Databricks, AWS, Unity Catalog, PySpark, Genie
Job PostingView all
1mo
Save
Mark Applied
Hide
Domain Project Lead 1
Hartford or Indianapolis or Phoenix or Raleigh or Richardson or Rosemead or Arizona or California or Connecticut or Indiana or North Carolina or Texas or United States
$97k-$133k/yr OnsiteFull Time
Infosys
InfosysNYSE: INFY: Provides IT consulting, software development, and business outsourcing services.
Experience with Palantir Foundry, PySpark, TypeScripting, Spark, Snowflake, or Hadoop; domain experience in Transmission & Distribution/Utilities preferred; ability to manage project timelines, liaise with stakeholders, design analytics solutions, and monitor deliverables. Bachelor's degree required (or equivalent progressive experience). Must be a...
Palantir Foundry, Palantir Data Foundry, Ontology, PySpark, Typescripting, Spark, Snowflake, Hadoop
Job PostingView all
3mo
Save
Mark Applied
Hide
AI Integrator #1744026
Chicopee, Massachusetts, United States
$168k-$197k/yr OnsiteFull Time
Network Designs, Inc.
Network Designs, Inc.: Provides IT, network, and cybersecurity solutions to government agencies.
12+ YOEBachelor's in Engineering/CS; 12+ years software/architecture/data; 5+ years AI/ML; TensorFlow/PyTorch/scikit-learn/Keras; Spark/Databricks/Hadoop; Python/Django; REST/GraphQL; Docker/Kubernetes; DevSecOps; CAC eligibility; US citizenship.
TensorFlow, PyTorch, scikit-learn, Keras, Apache Spark, Databricks, Hadoop, PostgreSQL, Python, Django, Celery, Linux, REST, GraphQL, MQTT, Docker, Kubernetes, CI/CD, DevSecOps
Job PostingView all

Explore Jobs

Expand Your Job Search