37 pyspark data engineer jobs at 27 companies in Douglas, MA

3w
Save
Mark Applied
Hide
Principal Data Engineer
Boston, Massachusetts, United States
$175k-$200k/yr HybridFull Time
CodaMetrix
CodaMetrix: AI platform for autonomous medical coding and revenue management.
8+ YOEDegree in CS or related,8+ years data engineering,5+ years Databricks,expert PySpark/Python,Terraform,AWS,Kafka,CI/CD,HIPAA experience and disaster recovery expertise.
Databricks, PySpark, Unity Catalog, Delta Lake, Structured Streaming, Terraform, Apache Kafka, AWS MSK, Jenkins, GitHub Actions, Python, SQL, CloudZero, AWS Cost Explorer, Tableau, S3, IAM, Secrets Manager, VPC/Private Link, HL7, FHIR, EHR, Claude, Gemini, Codex
2w
Save
Mark Applied
Hide
Data Engineer Senior Developer, AVP
Quincy or Boston
$90k-$158k/yr OnsiteFull Time
State Street
State StreetNYSE: STT: Provides investment servicing and management to institutional investors.
5+ YOEExperience designing and building cloud data lake solutions using AWS/Databricks, ETL/ELT with Spark/Scala/PySpark, data modeling, and CI/CD; 5+ years software/data engineering experience.
Apache Spark, Scala, Hadoop, Hive, AWS, Databricks, Terraform, CloudFormation, Amazon S3, Glue, Lambda, EMR, Redshift, Athena, Kinesis, PL/SQL, Python, PERL, Delta Lake, Unity Catalog, Databricks Workflows, Git, CI/CD, DevOps
1mo
Save
Mark Applied
Hide
Data Engineer
Atlanta or Baltimore or Boston or Charlotte or Columbus or Detroit or Hartford or Miami or New York or Philadelphia or Raleigh or Tampa or Washington
$91k-$122k/yr OnsiteFull Time
Slalom
Slalom: Provides business and technology consulting and software engineering services.
4+ YOE4+ years building production data engineering solutions; experience with cloud data platforms, streaming, orchestration, Python/Java; strong communication and critical thinking.
Amazon Redshift, Snowflake, Google BigQuery, Azure Synapse Analytics, Amazon EMR, Apache Spark, Presto, Databricks, Amazon Kinesis, Apache Kafka, Apache Airflow, dbt, Dagster, Azure Data Factory, DynamoDB, Cosmos DB, MongoDB, Kubernetes, Amazon ECS, Amazon SageMaker, Azure ML Studio, Python, Java
1mo
Save
Mark Applied
Hide
Associate Data Engineer / Data Engineer II / Senior Data Engineer (REMOTE)
Worcester, Massachusetts, United States
$60k-$130k/yr RemoteFull Time
The Hanover Insurance Group
The Hanover Insurance GroupNYSE: THG: Provides property and casualty insurance products and services.
0+ YOEDegree in data-related field, experience with data engineering/ETL, proficiency in SQL and Python, experience with Azure and Databricks, strong problem-solving and communication; must be eligible to work in the US without sponsorship.
Azure Synapse, Data Factory, ADLS, Databricks, Delta Tables, Spark, PySpark, SQL, T-SQL, Python, Java, Scala, Power BI, GitHub, Azure DevOps
1mo
Save
Mark Applied
Hide
Associate Data Engineer / Data Engineer II / Senior Data Engineer (REMOTE)
Worcester, Massachusetts, United States
$60k-$130k/yr RemoteFull Time
The Hanover Insurance Group
The Hanover Insurance GroupNYSE: THG: Provides property and casualty insurance products to individuals and businesses.
0+ YOEDegree in Data Science/Computer Science or related, experience in data engineering/ETL/data modeling (levels 0–5+ years), proficiency in SQL and Python, experience with Azure cloud platforms preferred, strong problem-solving and communication, US work authorization required.
Azure Synapse, Data Factory, ADLS, Data Lake, Databricks, Delta Tables, Spark, PySpark, SQL, T-SQL, Python, Java, Scala, Microsoft Power BI, GitHub, Azure DevOps, Azure
3d
Save
Mark Applied
Hide
Senior Data Engineer
White Plains or Greensboro or Charleston or Greenville or Maitland or Harrisonburg or Clearwater or Louisville or Birmingham or Huntsville or Alpharetta or Clayton or Honolulu or Lake Oswego or Gainesville or Fayetteville or Naples or Hibbing or Miami or Myrtle Beach or Houston or Denver or Piscataway or Irvine or Key Largo or Columbia or Little Rock or Austin or Pensacola or Lexington or Bloomington or Fort Myers or Panama City or San Antonio or Rochester or Mobile or Salt Lake City or Bend or Charlotte or Glen Allen or Raleigh or Abilene or Tallahassee or San Ramon or Dallas or Pittsburgh or Boston or Missoula or Cincinnati or Boise or Eugene or McMinnville or Knoxville or Dakota Dunes or Kissimmee or Fort Worth or Grand Forks or Canonsburg or Buffalo or Eastland or Philadelphia or Chicago or Phoenix or Dublin or Jacksonville or St. Louis or Los Angeles or Atlanta or Norwalk or Colchester or Grand Rapids or Richmond or Hoboken or Indianapolis or Kansas City or Chagrin Falls or Orland Park or Anchorage or High Point or Bonita Springs or Rancho Cordova or Las Vegas or Irving or Brandenburg or Minneapolis or Fort Lauderdale or Shreveport or Fargo or Sarasota or Kennesaw or Dayton or Sacramento or Princeton or Durham or Conshohocken or Baton Rouge or Asheville or Chattanooga or Memphis or Nashville or United States
$96k-$168k/yr RemoteFull Time
Marsh McLennan
Marsh McLennanNYSE: MRSH: Global professional services firm providing risk, strategy, and people solutions.
10+ YOERequires 10+ years of enterprise data engineering experience and advanced Azure, Databricks, Spark, Python, SQL, ETL, data modeling, streaming, and cloud architecture expertise.
Microsoft Azure, Azure Databricks, Azure Functions, Azure Data Factory, Databricks, Apache Spark, PySpark, Python, SQL, Scala, Unity Catalog, Microsoft SQL Server, Kafka, Event Hub, Azure DevOps, Git, Terraform, ARM templates, Databricks Genie
1d
Save
Mark Applied
Hide
Principal Data Engineer / Solution Architect Fabric
New York City or Boston
FieldFull Time, Contract
Fusemachines
FusemachinesNASDAQ: FUSE: Provides enterprise AI products, consulting, and talent development services.
8+ YOE8+ years in data engineering or architecture; advanced Microsoft Fabric, Azure, SQL, Python/PySpark, ADLS Gen2, and Databricks Unity Catalog expertise; regulated life sciences experience required.
Microsoft Fabric, Microsoft Fabric Data Factory, Azure Data Factory (ADF), Microsoft SQL, Python, PySpark, Databricks Unity Catalog, Azure Data Lake Storage Gen2 (ADLS Gen2)
3mo
Save
Mark Applied
Hide
Principal, Data Engineer
Woburn, Massachusetts, United States
HybridFull Time
American Tower
American TowerNYSE: AMT: Leases space on wireless and broadcast towers for communications.
8+ YOE8+ years data engineering; CS/Math degree; expert SQL/Python; cloud platforms; Spark; Kafka; Airflow; governance; leadership.
SQL, Python, Apache Spark, PySpark, AWS, Azure, Google Cloud, Databricks, Snowflake, Kafka, Kinesis, Airflow, dbt, CI/CD, Infrastructure as Code, Data Quality, Data Governance
1d
Save
Mark Applied
Hide
Senior Data Science Engineer
Boston or United States
$121k-$151k/yr RemoteFull Time
DraftKings
DraftKingsNASDAQ: DKNG: Provide online sports betting, fantasy sports, and casino gaming.
3+ YOEBachelor’s degree in a quantitative field, 3+ years building production machine learning or analytics solutions, and strong Python, pandas, NumPy, and PySpark proficiency.
Python, pandas, NumPy, PySpark
5d
Save
Mark Applied
Hide
Senior Data Engineer
Boston, Massachusetts, United States
$150k-$215k/yr OnsiteFull Time
WHOOP
WHOOP: Wearable technology for personalized health and performance tracking.
5+ YOERequires 5+ years building production data systems, strong Python, SQL, ELT, Snowflake, dbt, distributed processing, initiative leadership, communication, and mentoring experience.
Python, PySpark, SQL, Snowflake, dbt, Spark, Kafka
2mo
Save
Mark Applied
Hide
Sr Data Engineer- Data Platform & AI Enablement
Johnston or United States
OnsiteFull Time
Citizens Financial Group
Citizens Financial GroupNYSE: CFG: Provides retail, commercial, and private banking services to customers.
6+ YOE6+ years data engineering experience; hands-on with streaming (Apache Spark, Beam, Flink) and Kafka; Java/Scala/Python; strong SQL; experience with Redshift, PostgreSQL, Snowflake, MongoDB; CI/CD (Bitbucket/Git); AWS/Azure; AI/GenAI/LLM pipelines.
Apache Spark, Beam, Flink, Apache Kafka, Java, Scala, Python, SQL, Redshift, PostgreSQL, Snowflake, MongoDB, Bitbucket, Git, Talend, DataStage, Java Spring Boot, React, TypeScript, Angular, AWS, Azure
2mo
Save
Mark Applied
Hide
Data Solution Engineer
Boston, Massachusetts, United States
$120k-$180k/yr HybridFull Time
RA Capital Management
RA Capital Management: Invests in and builds life science and sustainability companies.
2+ YOEBachelor’s or Master’s in CS/Data Eng; 2-5 years BI/data solutions; SQL/Python; Databricks/Snowflake/AWS; healthcare/biotech/finance exp; Boston hybrid; US work eligibility.
Databricks, Snowflake, AWS, SQL, Python, PySpark, Sigma Computing, Dash Enterprise
1d
Save
Mark Applied
Hide
Data Engineer (Hybrid)
Cedar Rapids or Charlotte or Windsor Locks or Richardson
$87k-$165k/yr HybridFull Time
RTX
RTXNYSE: RTX: Provides advanced aerospace and defense systems and services.
5+ YOEUniversity degree and 5 years of relevant experience, or advanced degree and 3 years. Requires U.S. citizenship, Python, SQL, data frameworks, cloud platforms, ETL/ELT, distributed systems, and secure data architecture.
Python, SQL, Spark, PySpark, Databricks, EMR, Glue, AWS, Microsoft Azure, GCP, SharePoint, Terraform, CloudFormation, GitHub Actions, Jenkins
2w
Save
Mark Applied
Hide
Senior Data Quality & Active Learning AI Engineer (Plymouth)
Plymouth or Bedford
$156k-$187k/yr HybridFull Time
Philips
PhilipsEuronext Amsterdam: PHIA: Manufactures medical imaging systems and personal care appliances.
5+ YOE5+ years data-quality or data-engineering experience, bachelor's degree, expertise with medical imaging data, DICOM/PACS, HIPAA/GDPR, active-learning methods, Python and SQL, cloud data pipelines and validation.
Python, Structured Query Language (SQL), Amazon Web Services (AWS), Apache Spark, Ray, Digital Imaging and Communications in Medicine (DICOM), Picture Archiving and Communication System (PACS), HL7, Fast Healthcare Interoperability Resources (FHIR), OpenAI Codex, Claude Code, PyTorch, TensorFlow
1mo
Save
Mark Applied
Hide
Senior Business Intelligence Engineer
Boston, Massachusetts, United States
$150k-$185k/yr HybridFull Time
WilmerHale
WilmerHale: Global law firm providing comprehensive legal representation services.
3+ YOE3+ years in data analysis/warehousing, hands-on Microsoft Fabric, Power BI, T-SQL, DAX, Azure Data Factory and notebook transformations (Python/PySpark); CI/CD and DevOps experience; strong analytical and communication skills.
Microsoft Fabric, Power BI, DAX, SQL, T-SQL, Python, PySpark, Azure Data Factory, MSSQL, Microsoft SharePoint, Microsoft Excel, Microsoft Dev Ops, SSIS, SSAS, SSRS, Azure Keyvault, Azure Logic Apps, Azure Storage Accounts, SQL Server, CI/CD, ITIL
1w
Save
Mark Applied
Hide
Forward Deployed Engineer
Boston or New York City
OnsiteFull Time
OnCorps
OnCorps: Automating financial fund operations with domain-specific AI agents.
7+ YOERequires 7+ years in solutions or forward-deployed engineering, JSON/YAML, REST APIs, Python or TypeScript, SQL, databases, data pipelines, Databricks, CI/CD, and strong communication skills.
JSON, YAML, REST API, Python, TypeScript, SQL, Databricks, Pandas, PySpark, AWS, Docker, Kubernetes
2mo
Save
Mark Applied
Hide
Senior Software Engineer
Wakefield or Boston
$102k-$190k/yr OnsiteFull Time
Publicis Groupe
Publicis GroupeEuronext Paris: PUB: Global advertising and digital transformation agency holding.
5+ YOE5-8 years software engineering, strong data engineering and distributed systems experience; AWS, Databricks, Python, PySpark; Databricks, Spark, Kafka/RabbitMQ; SQL/NoSQL databases; CI/CD and DevOps; mentoring.
AWS, Databricks, Python, PySpark, Apache Spark, Kafka, RabbitMQ, SQL Server, MongoDB, Jenkins, GitHub, GitLab, Bitbucket, CI/CD, DevOps
2w
Save
Mark Applied
Hide
ML Data Scientist III ( Seattle/Provo)
Provo or Seattle or Chicago or Boston or South Bend
$100k-$140k/yr HybridFull Time
Press Ganey
Press Ganey: Provides patient experience measurement and healthcare performance analytics.
5+ YOEMaster's in CS/AI or related,5+ years in applied research or software engineering,proven conversational AI and generative AI experience,knowledge of ML/NLP and collaboration skills.
LangChain, LangGraph, MCP, ADK, A2A, Apache Spark, Databricks, Docker, Kubernetes, Azure, AWS, GCP
3w
Save
Mark Applied
Hide
Principal Decision Intelligence Engineer
Boston or Massachusetts
$188k-$259k/yr HybridFull Time
Humana
HumanaNYSE: HUM: Provides health insurance plans and clinical healthcare services.
10+ YOE2+ MgmtBachelor's in CS or related,10+ years software engineering with data/AI/decision systems,2+ years product people leadership,optimization and sequential decision expertise,Python and cloud data platform experience,Databricks/Snowflake familiarity,AI tool fluency.
Python, Claude, GitHub Copilot, PyTorch, MLflow, PySpark, Databricks, Snowflake, Kafka, Hire Vue, Workday
1mo
Save
Mark Applied
Hide
Sr. Forward Deployed Engineer - Financial Services
Boston or San Francisco or California
$181k-$248k/yr OnsiteFull Time
Databricks
Databricks: A unified platform for data analytics and artificial intelligence.
6+ YOE6+ years in data engineering or software engineering; strong Python/Scala/JS/TypeScript coding; Apache Spark expertise; experience with cloud (AWS/Azure/GCP), CI/CD, MLOps; Databricks certification preferred; customer-facing delivery experience.
Python, Scala, JavaScript, TypeScript, AWS, Azure, GCP, Apache Spark, Databricks, MLflow, Delta Lake, CI/CD, MLOps