43 pyspark data engineer jobs at 29 companies in Dedham, MA

1w
Save
Mark Applied
Hide
Data Engineer
Durham or Boston or Princeton or Emeryville or Evanston or Evanston or New York City or Rockville
$85k-$105k/yr HybridFull Time
Beghou Consulting
Beghou Consulting: Strategic consulting and data analytics for life sciences companies.
3+ YOEBachelor's degree,3+ years data engineering experience,proficient with Python/PySpark,Databricks,AWS/Azure,relational databases,Git,CI/CD,and cloud security/IAM.
Databricks, Python, PySpark, AWS, Azure, PostgreSQL, Oracle, MySQL, Amazon Redshift, Snowflake, Git, Azure AD, Okta, OAuth, SAML, Azure Data Factory, Informatica, SnapLogic, Boomi, Docker, Kubernetes, AWS ECS, Flask, Django, JavaScript, HTML, CSS, Ajax
1mo
Save
Mark Applied
Hide
Data Engineer
Nashua, New Hampshire, United States
OnsiteFull Time
Amphenol
AmphenolNYSE: APH: Designs and manufactures electrical connectors and interconnect systems.
3+ YOEBS in a computing field required, 3+ years data engineering experience; strong SQL, Python/PySpark, ETL/ELT, cloud data platform experience (Microsoft Fabric, Azure, Databricks, Snowflake); data modeling, data quality, orchestration, and collaboration skills; travel as required.
SQL, Python, PySpark, notebooks, Microsoft Fabric, Azure Data Lake, Azure Data Factory, Synapse, Databricks, Snowflake, Azure SQL, Power BI, DAX, Git, SharePoint, ERP, MES, PLM, QMS
1mo
Save
Mark Applied
Hide
Data Engineer
Nashua, New Hampshire, United States
OnsiteFull Time
Amphenol
AmphenolNYSE: APH: Manufactures electronic and fiber optic connectors and interconnect systems.
3+ YOEBS in a relevant field, 3+ years data engineering experience, strong SQL, Python/PySpark, ETL/ELT, cloud data platform experience (Microsoft Fabric/Azure/Databricks/Snowflake), data modeling, data quality, orchestration, and ability to work with stakeholders; travel as required.
SQL, Python, PySpark, notebooks, Microsoft Fabric, Azure Data Lake, Azure Data Factory, Azure SQL, Synapse, Databricks, Snowflake, Power BI, DAX, Git, SharePoint, MES, PLM, QMS
2w
Save
Mark Applied
Hide
Principal Data Engineer
Boston, Massachusetts, United States
$175k-$200k/yr HybridFull Time
CodaMetrix
CodaMetrix: AI platform for autonomous medical coding and revenue management.
8+ YOEDegree in CS or related,8+ years data engineering,5+ years Databricks,expert PySpark/Python,Terraform,AWS,Kafka,CI/CD,HIPAA experience and disaster recovery expertise.
Databricks, PySpark, Unity Catalog, Delta Lake, Structured Streaming, Terraform, Apache Kafka, AWS MSK, Jenkins, GitHub Actions, Python, SQL, CloudZero, AWS Cost Explorer, Tableau, S3, IAM, Secrets Manager, VPC/Private Link, HL7, FHIR, EHR, Claude, Gemini, Codex
1w
Save
Mark Applied
Hide
Data Engineer Senior Developer, AVP
Quincy or Boston
$90k-$158k/yr OnsiteFull Time
State Street
State StreetNYSE: STT: Provides investment servicing and management to institutional investors.
5+ YOEExperience designing and building cloud data lake solutions using AWS/Databricks, ETL/ELT with Spark/Scala/PySpark, data modeling, and CI/CD; 5+ years software/data engineering experience.
Apache Spark, Scala, Hadoop, Hive, AWS, Databricks, Terraform, CloudFormation, Amazon S3, Glue, Lambda, EMR, Redshift, Athena, Kinesis, PL/SQL, Python, PERL, Delta Lake, Unity Catalog, Databricks Workflows, Git, CI/CD, DevOps
1w
Save
Mark Applied
Hide
Databricks Data Engineer
United States or Arlington or Tysons or Washington or New York City or Chicago or Austin or Atlanta or Boston or Boulder
$113k-$188k/yr RemoteFull Time
Guidehouse
Guidehouse: Provides management and technology consulting services to diverse organizations.
3+ YOEBachelor's degree,3+ years data engineering experience,proficiency with Python/PySpark/SQL,Databricks/Spark/Delta Lake experience,knowledge of data pipelines,governance,and cloud platforms.
Databricks, PySpark, Python, SQL, Delta Lake, Unity Catalog, Spark, CI/CD, Terraform, Azure, AWS, GCP
3w
Save
Mark Applied
Hide
Data Engineer
Atlanta or Baltimore or Boston or Charlotte or Columbus or Detroit or Hartford or Miami or New York or Philadelphia or Raleigh or Tampa or Washington
$91k-$122k/yr OnsiteFull Time
Slalom
Slalom: Provides business and technology consulting and software engineering services.
4+ YOE4+ years building production data engineering solutions; experience with cloud data platforms, streaming, orchestration, Python/Java; strong communication and critical thinking.
Amazon Redshift, Snowflake, Google BigQuery, Azure Synapse Analytics, Amazon EMR, Apache Spark, Presto, Databricks, Amazon Kinesis, Apache Kafka, Apache Airflow, dbt, Dagster, Azure Data Factory, DynamoDB, Cosmos DB, MongoDB, Kubernetes, Amazon ECS, Amazon SageMaker, Azure ML Studio, Python, Java
1mo
Save
Mark Applied
Hide
Associate Data Engineer / Data Engineer II / Senior Data Engineer (REMOTE)
Worcester, Massachusetts, United States
$60k-$130k/yr RemoteFull Time
The Hanover Insurance Group
The Hanover Insurance GroupNYSE: THG: Provides property and casualty insurance products and services.
0+ YOEDegree in data-related field, experience with data engineering/ETL, proficiency in SQL and Python, experience with Azure and Databricks, strong problem-solving and communication; must be eligible to work in the US without sponsorship.
Azure Synapse, Data Factory, ADLS, Databricks, Delta Tables, Spark, PySpark, SQL, T-SQL, Python, Java, Scala, Power BI, GitHub, Azure DevOps
1mo
Save
Mark Applied
Hide
Associate Data Engineer / Data Engineer II / Senior Data Engineer (REMOTE)
Worcester, Massachusetts, United States
$60k-$130k/yr RemoteFull Time
The Hanover Insurance Group
The Hanover Insurance GroupNYSE: THG: Provides property and casualty insurance products to individuals and businesses.
0+ YOEDegree in Data Science/Computer Science or related, experience in data engineering/ETL/data modeling (levels 0–5+ years), proficiency in SQL and Python, experience with Azure cloud platforms preferred, strong problem-solving and communication, US work authorization required.
Azure Synapse, Data Factory, ADLS, Data Lake, Databricks, Delta Tables, Spark, PySpark, SQL, T-SQL, Python, Java, Scala, Microsoft Power BI, GitHub, Azure DevOps, Azure
3w
Save
Mark Applied
Hide
Data Engineer II
Providence, Rhode Island, United States
$104k/yr OnsiteFull Time
International Game Technology
International Game Technology: Global provider of gaming, digital entertainment, and fintech solutions.
3+ YOEBachelor's or equivalent, 3+ years data engineering, strong SQL and Python, Databricks/Spark experience, cloud (AWS) familiarity, data modeling and ETL/ELT experience.
Databricks, Apache Spark, Delta Lake, Python, SQL, Amazon S3, Git, REST APIs, Apache Airflow, Databricks Workflows, CI/CD pipelines
2mo
Save
Mark Applied
Hide
Principal, Data Engineer
Woburn, Massachusetts, United States
HybridFull Time
American Tower
American TowerNYSE: AMT: Leases space on wireless and broadcast towers for communications.
8+ YOE8+ years data engineering; CS/Math degree; expert SQL/Python; cloud platforms; Spark; Kafka; Airflow; governance; leadership.
SQL, Python, Apache Spark, PySpark, AWS, Azure, Google Cloud, Databricks, Snowflake, Kafka, Kinesis, Airflow, dbt, CI/CD, Infrastructure as Code, Data Quality, Data Governance
2mo
Save
Mark Applied
Hide
Data Solution Engineer
Boston, Massachusetts, United States
$120k-$180k/yr HybridFull Time
RA Capital Management
RA Capital Management: Invests in and builds life science and sustainability companies.
2+ YOEBachelor’s or Master’s in CS/Data Eng; 2-5 years BI/data solutions; SQL/Python; Databricks/Snowflake/AWS; healthcare/biotech/finance exp; Boston hybrid; US work eligibility.
Databricks, Snowflake, AWS, SQL, Python, PySpark, Sigma Computing, Dash Enterprise
1w
Save
Mark Applied
Hide
Senior Data Engineer
Indianapolis or Woodland Hills or Ashburn or Costa Mesa or Miami or Richmond or Chicago or New York City or Seattle or Grand Prairie or Chicago or Atlanta or Iselin or Overland Park or Tampa or Woburn
$127k-$229k/yr HybridFull Time
Elevance Health
Elevance HealthNYSE: ELV: Provides health insurance plans and integrated healthcare services.
8+ YOEBS/BA and 8+ years technical experience in systems administration/security, data platform architecture, Microsoft Fabric/Azure, data pipelines, SQL/Python, and regulatory compliance (HIPAA,NIST,SOC2).
Microsoft Fabric, Apache Spark, SQL, Python, PySpark, Spark, Delta Lake, Parquet, REST APIs, JSON, Git, Azure DevOps, CI/CD
2mo
Save
Mark Applied
Hide
Junior Data Engineer
London or Boston or Victoria
$70k-$85k/yr HybridFull Time
Opensignal
Opensignal: Provides independent data on global mobile and broadband experiences.
1+ YOE1+ years in building big data pipelines; Spark/Scala/SQL experience; AWS; Bachelor’s degree.
Apache Spark, Scala, SQL, Amazon Redshift, Amazon Athena, Amazon S3, Apache Airflow, Amazon EMR, AWS
1w
Save
Mark Applied
Hide
Senior Data Quality & Active Learning AI Engineer (Plymouth)
Plymouth or Bedford
$156k-$187k/yr HybridFull Time
Philips
PhilipsEuronext Amsterdam: PHIA: Manufactures medical imaging systems and personal care appliances.
5+ YOE5+ years data-quality or data-engineering experience, bachelor's degree, expertise with medical imaging data, DICOM/PACS, HIPAA/GDPR, active-learning methods, Python and SQL, cloud data pipelines and validation.
Python, Structured Query Language (SQL), Amazon Web Services (AWS), Apache Spark, Ray, Digital Imaging and Communications in Medicine (DICOM), Picture Archiving and Communication System (PACS), HL7, Fast Healthcare Interoperability Resources (FHIR), OpenAI Codex, Claude Code, PyTorch, TensorFlow
2mo
Save
Mark Applied
Hide
Senior Analytics Engineer
Andover, Massachusetts, United States
$130k-$165k/yr OnsiteFull Time
Rockstar Games
Rockstar Games: Creates and publishes world-class open-world video games.
5+ YOE5+ years in analytics/data engineering; strong SQL, Python, PySpark; Databricks/Azure; CI/CD; data pipelines.
Python, PySpark, SQL, Databricks, Azure, Airflow, Astronomer, TeamCity, Terraform, Github, Octopus
2mo
Save
Mark Applied
Hide
Senior Analytics Engineer
Andover or Manhattan
$130k-$165k/yr OnsiteFull Time
Rockstar Games
Rockstar GamesNASDAQ: TTWO: Developer and publisher of world-class interactive entertainment and games.
5+ YOE5+ years analytics/data engineering experience with Python, PySpark, advanced SQL; Databricks/Azure and pipeline, CI/CD, monitoring experience; BS in CS/math/stat or equivalent.
Python, PySpark, SQL, Databricks, Azure, Airflow, Astronomer, TeamCity, Terraform, Github, Octopus
4d
Save
Mark Applied
Hide
Data Engineering Quality Engineer
Dallas or Merrimack or Jersey City
$69k-$153k/yr OnsiteFull Time
CGI
CGINYSE: GIB: Provides information technology and business consulting services.
6+ YOE6+ years quality engineering experience; strong SQL, Python, and API testing; ETL/ELT and BI validation; automation and CI/CD experience; Bachelor's degree in computer science or related field.
Playwright, RestAssured, Karate, Cucumber, TestNG, Oracle, PostgreSQL, DB2, SQL, PL/SQL, Python, GitHub, Jenkins, Maven, Docker, SonarQube, AWS, Azure, Google Cloud, Snowflake, Databricks, Apache Spark, Hadoop, Jira
1mo
Save
Mark Applied
Hide
Senior Business Intelligence Engineer
Boston, Massachusetts, United States
$150k-$185k/yr HybridFull Time
WilmerHale
WilmerHale: Global law firm providing comprehensive legal representation services.
3+ YOE3+ years in data analysis/warehousing, hands-on Microsoft Fabric, Power BI, T-SQL, DAX, Azure Data Factory and notebook transformations (Python/PySpark); CI/CD and DevOps experience; strong analytical and communication skills.
Microsoft Fabric, Power BI, DAX, SQL, T-SQL, Python, PySpark, Azure Data Factory, MSSQL, Microsoft SharePoint, Microsoft Excel, Microsoft Dev Ops, SSIS, SSAS, SSRS, Azure Keyvault, Azure Logic Apps, Azure Storage Accounts, SQL Server, CI/CD, ITIL
1d
Save
Mark Applied
Hide
Senior Decision Intelligence Engineer (NBA)
Kentucky or Boston
$107k-$147k/yr RemoteFull Time
Humana
HumanaNYSE: HUM: Provides health insurance plans and clinical healthcare services.
5+ YOE5+ years ML/MLOps or related engineering experience; strong Python, PySpark, SQL; Databricks/MLflow/Airflow experience; CI/CD, monitoring, cloud platforms; optimization and production troubleshooting skills.
Python, PySpark, SQL, Databricks, Delta Lake, Unity Catalog, MLflow, Airflow, Snowflake, AWS, Azure, GCP, Kafka, OpenTelemetry, Terraform, GitHub Copilot, Claude, OR-Tools, SciPy Optimize, PuLP, Pyomo, Gurobi, Hire Vue