HiringCafe
Join our community

62 pyspark data engineer jobs at 38 companies in Massachusetts

1mo
Save
Mark Applied
Hide
Principal Data Engineer
Boston, Massachusetts, United States
$175k-$200k/yr HybridFull Time
CodaMetrix
CodaMetrix: Private AI medical coding platform that helps health systems automate revenue-cycle coding.
8+ YOEDegree in CS or related,8+ years data engineering,5+ years Databricks,expert PySpark/Python,Terraform,AWS,Kafka,CI/CD,HIPAA experience and disaster recovery expertise.
Databricks, PySpark, Unity Catalog, Delta Lake, Structured Streaming, Terraform, Apache Kafka, AWS MSK, Jenkins, GitHub Actions, Python, SQL, CloudZero, AWS Cost Explorer, Tableau, S3, IAM, Secrets Manager, VPC/Private Link, HL7, FHIR, EHR, Claude, Gemini, Codex
Job PostingView all
1mo
Save
Mark Applied
Hide
Databricks Data Engineer
United States or Arlington or Tysons or Washington or New York City or Chicago or Austin or Atlanta or Boston or Boulder
$113k-$188k/yr RemoteFull Time
Guidehouse
Guidehouse: Global consulting firm serving public and commercial sectors.
3+ YOEBachelor's degree,3+ years data engineering experience,proficiency with Python/PySpark/SQL,Databricks/Spark/Delta Lake experience,knowledge of data pipelines,governance,and cloud platforms.
Databricks, PySpark, Python, SQL, Delta Lake, Unity Catalog, Spark, CI/CD, Terraform, Azure, AWS, GCP
Job PostingView all
2mo
Save
Mark Applied
Hide
Sr. Engineer, Data - Archimedes
St. Louis or Brentwood or United States or Alaska or Arizona or Arkansas or California or Connecticut or Delaware or Hawaii or Idaho or Louisiana or Maine or Massachusetts or Michigan or Mississippi or Montana or Nebraska or Nevada or New Mexico or New York or North Carolina or North Dakota or Oregon or Rhode Island or South Carolina or South Dakota or Texas or Utah or Vermont or Washington or West Virginia or Wyoming
HybridFull Time
Archimedes
Archimedes: Privately held specialty drug management serving employers, health plans, and health systems.
8+ YOEBachelor's in CS or related (Master's preferred); AWS/Azure/CDMP certifications; 8+ years data engineering experience, 5+ years building lakehouse solutions on Azure Databricks; expertise in Spark, PySpark, SQL, Python, DataOps, CI/CD, and cloud data services.
Azure Databricks, Delta Lake, Unity Catalog, Azure Data Lake Storage Gen2, Databricks Workflows, Databricks Asset Bundles, Delta Live Tables (DLT), Synapse Analytics, Azure Data Factory (ADF), Azure Functions, Azure Key Vault, Azure Monitor, Managed Identities, Event Hub, Event Grid, Service Bus, Apache Spark, PySpark, SQL, Python, Azure DevOps, GitHub Actions, Jenkins, AWS Glue, AWS Lambda, Amazon S3, Amazon RDS, Amazon Redshift, Apache Airflow, Git, Terraform, PowerShell, MLflow, Azure Machine Learning, Databricks ML, REST APIs, GraphQL, CloudWatch, ELK Stack
Job PostingView all
2mo
Save
Mark Applied
Hide
Principal Commercial Data Engineer
Texas or New Jersey or Michigan or Florida or Massachusetts or Maryland or Mississippi or Nevada
$126k-$168k/yr RemoteFull Time
MGM Resorts International
MGM Resorts InternationalNYSE: MGM: Global hospitality and entertainment operating iconic destination resorts.
10+ YOEBachelor's in CS/IT, 10+ years data engineering experience, 5+ years Databricks/Spark architecture, advanced Python/PySpark/SQL, Unity Catalog and Lakehouse expertise, data governance and observability experience.
Databricks, Delta Live Tables, Unity Catalog, Python, PySpark, SQL
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer
Atlanta or Baltimore or Boston or Charlotte or Columbus or Detroit or Hartford or Miami or New York or Philadelphia or Raleigh or Tampa or Washington
$91k-$122k/yr OnsiteFull Time
Slalom
Slalom: Business and technology consulting firm.
4+ YOE4+ years building production data engineering solutions; experience with cloud data platforms, streaming, orchestration, Python/Java; strong communication and critical thinking.
Amazon Redshift, Snowflake, Google BigQuery, Azure Synapse Analytics, Amazon EMR, Apache Spark, Presto, Databricks, Amazon Kinesis, Apache Kafka, Apache Airflow, dbt, Dagster, Azure Data Factory, DynamoDB, Cosmos DB, MongoDB, Kubernetes, Amazon ECS, Amazon SageMaker, Azure ML Studio, Python, Java
Job PostingView all
2mo
Save
Mark Applied
Hide
Associate Data Engineer / Data Engineer II / Senior Data Engineer (REMOTE)
Worcester, Massachusetts, United States
$60k-$130k/yr RemoteFull Time
The Hanover Insurance Group
The Hanover Insurance GroupNew York Stock Exchange: THG: Public U.S. property-and-casualty insurer serving individuals, families, and businesses through independent agents and brokers.
0+ YOEDegree in data-related field, experience with data engineering/ETL, proficiency in SQL and Python, experience with Azure and Databricks, strong problem-solving and communication; must be eligible to work in the US without sponsorship.
Azure Synapse, Data Factory, ADLS, Databricks, Delta Tables, Spark, PySpark, SQL, T-SQL, Python, Java, Scala, Power BI, GitHub, Azure DevOps
Job PostingView all
2mo
Save
Mark Applied
Hide
Associate Data Engineer / Data Engineer II / Senior Data Engineer (REMOTE)
Worcester, Massachusetts, United States
$60k-$130k/yr RemoteFull Time
The Hanover Insurance Group
The Hanover Insurance GroupNew York Stock Exchange: THG: Public U.S. property-and-casualty insurer serving individuals, families, and businesses through independent agents and brokers.
0+ YOEDegree in Data Science/Computer Science or related, experience in data engineering/ETL/data modeling (levels 0–5+ years), proficiency in SQL and Python, experience with Azure cloud platforms preferred, strong problem-solving and communication, US work authorization required.
Azure Synapse, Data Factory, ADLS, Data Lake, Databricks, Delta Tables, Spark, PySpark, SQL, T-SQL, Python, Java, Scala, Microsoft Power BI, GitHub, Azure DevOps, Azure
Job PostingView all
4w
Save
Mark Applied
Hide
Data Engineer, Officer - State Street Investment Management
Boston, Massachusetts, United States
$70k-$119k/yr OnsiteFull Time
State Street Global Advisors
State Street Global Advisors: State Street Investment Management is a private asset manager serving institutions, financial professionals, and individual investors.
6+ YOEMaster's in CS or related, 6+ years data engineering experience, strong Python/PySpark/SQL skills, Databricks and Snowflake on cloud, CI/CD and Git proficiency, experience with Lakehouse and data platform architecture.
Python, PySpark, SQL, Databricks, Snowflake, AWS, Azure, Jenkins, Artifactory, GitHub, Git, Docker, Iceberg, Unity Catalog, Codex, Anthropic Code, GitHub Copilot, Claude Code Assistant, Collibra, Alation
Job PostingView all
6d
Save
Mark Applied
Hide
Data Engineer
Woburn, Massachusetts, United States
$88k-$112k/yr HybridFull Time
American Tower
American TowerNYSE: AMT: Public U.S. REIT that owns, operates, and leases wireless towers, communications sites, and data centers to connectivity providers.
2+ YOEBachelor's degree required; 2–4 years of data or related technical experience; SQL, Python, cloud, data platforms, pipelines, Git, and Agile knowledge required or preferred.
Structured Query Language, Python, Azure, Amazon Web Services, Google Cloud, Databricks, Snowflake, Spark, PySpark, Azure Data Factory, Airflow, Git
Job PostingView all
1w
Save
Mark Applied
Hide
Senior Data Engineer - NBA
Nashville or Boston
$118k-$162k/yr RemoteFull Time
Humana
HumanaNYSE: HUM: Health insurance and care services provider.
5+ YOERequires 5+ years of data engineering experience, strong SQL and Python, Spark-based pipelines, Databricks or lakehouse experience, batch and streaming processing, data modeling, quality controls, and operational support.
Databricks, Databricks Lakehouse, SQL, Python, Apache Spark, Delta Lake, Databricks Feature Store, Unity Catalog, Delta Live Tables, Databricks Workflows, Apache Kafka, Azure Data Factory, Azure Data Lake Storage, Azure Event Hubs, Great Expectations, Monte Carlo, Claude, GitHub Copilot, HireVue, Microsoft Workday
Job PostingView all
2w
Save
Mark Applied
Hide
Principal Data Engineer / Solution Architect Fabric
New York City or Boston
FieldFull Time, Contract
Fusemachines
FusemachinesThe Nasdaq Stock Market LLC: FUSE: Public enterprise AI serving organizations with AI products, implementation services, and talent development programs.
8+ YOE8+ years in data engineering or architecture; advanced Microsoft Fabric, Azure, SQL, Python/PySpark, ADLS Gen2, and Databricks Unity Catalog expertise; regulated life sciences experience required.
Microsoft Fabric, Microsoft Fabric Data Factory, Azure Data Factory (ADF), Microsoft SQL, Python, PySpark, Databricks Unity Catalog, Azure Data Lake Storage Gen2 (ADLS Gen2)
Job PostingView all
2w
Save
Mark Applied
Hide
Senior Data Engineer II, Finance
United States or Canada or California or New York or Connecticut or New Jersey or Washington or Oregon or Delaware or Maine or Massachusetts or Maryland or New Hampshire or Rhode Island or Vermont or District of Columbia or Pennsylvania or Virginia or Colorado or Texas or Illinois or Hawaii
$183k-$232k/yr RemoteFull Time
Instacart
InstacartNasdaq Global Select Market: CART: Public grocery technology serving retailers, shoppers, consumers, and brands through marketplace, enterprise, advertising, and delivery platforms.
8+ YOERequires 8+ years in data or software engineering, financial data pipeline expertise, Python, Airflow, Spark, SQL, dbt, cloud warehouses, ETL/ELT, data modeling, and cross-functional communication.
Snowflake, Amazon Redshift, Google BigQuery, Python, Apache Airflow, Apache Spark, Apache Iceberg, Delta Lake, SQL, dbt, Electronic Data Interchange (ETL), Electronic Data Loading (ELT)
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Data Engineer | Emerging Products
United States or California or Colorado or Connecticut or Florida or Georgia or Illinois or Kansas or Massachusetts or Maryland or Maine or New Jersey or North Carolina or New York or Oregon or Tennessee or Texas or Virginia or Washington
HybridFull Time
NinjaOne
NinjaOne: Privately held NinjaOne provides endpoint management, patching, backup, and remote access software for IT teams and MSPs.
10+ YOE10+ years in data engineering focused on data platforms and distributed systems; expertise in Kafka, Spark, Airflow, lakehouses, table formats, Databricks, Python, and SQL.
Apache Kafka, Apache Spark, Apache Airflow, Iceberg, Delta Lake, Hudi, Databricks, Trino, Starburst, Python, SQL
Job PostingView all
3w
Save
Mark Applied
Hide
Senior Data Engineer
Boston, Massachusetts, United States
$150k-$215k/yr OnsiteFull Time
WHOOP
WHOOP: Wearable technology developing health and fitness tracking devices.
5+ YOERequires 5+ years building production data systems, strong Python, SQL, ELT, Snowflake, dbt, distributed processing, initiative leadership, communication, and mentoring experience.
Python, PySpark, SQL, Snowflake, dbt, Spark, Kafka
Job PostingView all
3w
Save
Mark Applied
Hide
Director, Data Engineering
Florida or Montana or Michigan or Massachusetts or Rhode Island or West Virginia or Oregon or Oklahoma or Minnesota or New York or South Carolina or Kentucky or Virginia or Colorado or New Jersey or Wisconsin or Utah or Pennsylvania or Ohio or North Carolina or Nebraska or Mississippi or South Dakota or Maryland or Louisiana or Kansas or Iowa or Illinois or Tennessee or Delaware or Connecticut or California or Hawaii or Arkansas or District of Columbia or Georgia or Missouri or Arizona or Alabama or New Hampshire or Texas or Vermont or Indiana or Washington or Nevada or Idaho or New Mexico or Maine
$195k-$210k/yr RemoteFull Time
AmeriLife
AmeriLife: National leader in developing, marketing and distributing insurance solutions.
10+ YOE5+ MgmtBachelor's degree,10+ years data engineering,5+ years leading teams,expert Databricks/Spark/Python/PySpark/SQL,Databricks platform and Unity Catalog experience,CI/CD and IaC familiarity,strong leadership and stakeholder skills.
Databricks Lakehouse Platform, Databricks, Unity Catalog, Delta Live Tables (Lakeflow), Delta Lake, Apache Spark, SQL, Python, PySpark, Databricks Workflows, Git, Azure
Job PostingView all
2mo
Save
Mark Applied
Hide
Staff Software Engineer Data - DC Tech Lead
United States or Alabama or Arkansas or California or Colorado or Florida or Georgia or Illinois or Kentucky or Massachusetts or Michigan or Montana or Missouri or Nevada or New Jersey or New York or North Carolina or Oregon or Pennsylvania or Texas or Washington or Utah or Virginia or Wisconsin
$168k-$273k/yr RemoteFull Time
Afresh
Afresh: Private AI software helping grocery retailers order, manage, and sell food with less waste.
Design and maintain large-scale ETLs; proficiency with Python, PySpark, SQL, Databricks/Snowflake/DBT; 2+ years technical lead experience; strong problem-solving, mentoring, and communication skills; experience with messy datasets.
PySpark, DBT, Python, SQL, Databricks, Snowflake
Job PostingView all
2mo
Save
Mark Applied
Hide
Data Platform Engineer
Ohio or New York or New Jersey or Missouri or Minnesota or Michigan or Massachusetts or Indiana or Illinois or Georgia or Florida or Colorado or California or Arizona or Pennsylvania or Wisconsin or Texas or United States
$120k-$160k/yr RemoteFull Time
Clinician Nexus
Clinician Nexus: Healthcare workforce software helping health systems manage clinical compensation, productivity, education, and student rotations.
5+ YOE5+ years experience; degree in CS/Software Engineering/Information Systems/IT or equivalent; proficiency in Python/Scala/Java/SQL, Apache Spark, Databricks, ELT/ETL, streaming, RESTful/gRPC, SDLC, testing and CI/CD tooling; strong design and mentoring skills.
Python, Scala, Java, SQL, Apache Spark, Databricks, Pytest, GitHub Actions, Poetry, Git, RESTful, gRPC
Job PostingView all
1w
Save
Mark Applied
Hide
Data Architect
Southfield or Grand Rapids or Chicago or Colorado or Illinois or Ohio or Massachusetts
$110k-$181k/yr OnsiteFull Time
Plante Moran
Plante Moran: Private audit, tax, consulting, and wealth-management firm serving businesses, organizations, and individuals.
5+ YOEBachelor's degree in a related technical field and 5–8 years in data architecture, engineering, analytics engineering, or business intelligence. Requires enterprise data solution design and modern data platform expertise.
Microsoft Fabric, Azure Data Services, Databricks, Power BI, Lakehouse, Data Engineering, Data Factory, OneLake, Azure Data Factory, Azure Data Lake Storage, Azure SQL, SQL/T-SQL, PySpark, Spark, GitHub, GitHub Actions, API, Informatica, SSIS
Job PostingView all
2w
Save
Mark Applied
Hide
Data Engineering and Development VP
Quincy, Massachusetts, United States
$120k-$218k/yr OnsiteFull Time
State Street
State StreetNYSE: STT: Global financial services and bank holding.
12+ YOE12+ years in IT delivery, including 3+ years in AI/ML and data engineering; expertise in Python, Spark, PySpark, Databricks, AI models, data architecture, governance, and regulated financial services.
Python, FastAPI, PyTorch, TensorFlow, Pandas, Java, Fiddler, Postman, Apache Spark, PySpark, Databricks, OpenAI, Hugging Face, Azure OpenAI, LangChain
Job PostingView all
1d
Save
Mark Applied
Hide
Palantir Forward Deployed Engineer
Chicago or Milwaukee or Dallas or Columbus or Kirkland or Cincinnati or New York City or Cleveland or Oklahoma City or Austin or Albany or St. Petersburg or Hartford or Pittsburgh or St. Louis or Miami or Sacramento or Raleigh or Minneapolis or Mountain View or Scottsdale or San Francisco or Morristown or Denver or Boston or Philadelphia or Des Moines or Overland Park or Los Angeles or Charlotte or Walnut Creek or Carmel or Seattle or Houston or Arlington or Atlanta or Redmond or Bentonville or Beaverton or Nashville or Detroit or San Diego
$54k-$235k/yr HybridFull Time
Accenture
AccentureNYSE: ACN: Global professional services delivering 360° value.
3+ YOERequires 3+ years in data engineering, cloud platforms, and Python, PySpark, or Java; 1+ year with Palantir Foundry, prompt engineering, and applied AI; bachelor's degree or equivalent experience.
Palantir Foundry, Palantir Artificial Intelligence Platform (AIP), Palantir Gotham, Python, TypeScript, PySpark, Java, AWS, Azure, GCP, Microsoft GitHub, GitLab, Jenkins, JavaScript
Job PostingView all

Explore Jobs

Expand Your Job Search