52 pyspark data engineer jobs at 30 companies in Weymouth, MA

1mo
Save
Mark Applied
Hide
Data Engineer
Nashua, New Hampshire, United States
OnsiteFull Time
Amphenol
AmphenolNYSE: APH: Designs and manufactures electrical connectors and interconnect systems.
3+ YOEBS in a computing field required, 3+ years data engineering experience; strong SQL, Python/PySpark, ETL/ELT, cloud data platform experience (Microsoft Fabric, Azure, Databricks, Snowflake); data modeling, data quality, orchestration, and collaboration skills; travel as required.
SQL, Python, PySpark, notebooks, Microsoft Fabric, Azure Data Lake, Azure Data Factory, Synapse, Databricks, Snowflake, Azure SQL, Power BI, DAX, Git, SharePoint, ERP, MES, PLM, QMS
1mo
Save
Mark Applied
Hide
Data Engineer
Nashua, New Hampshire, United States
OnsiteFull Time
Amphenol
AmphenolNYSE: APH: Manufactures electronic and fiber optic connectors and interconnect systems.
3+ YOEBS in a relevant field, 3+ years data engineering experience, strong SQL, Python/PySpark, ETL/ELT, cloud data platform experience (Microsoft Fabric/Azure/Databricks/Snowflake), data modeling, data quality, orchestration, and ability to work with stakeholders; travel as required.
SQL, Python, PySpark, notebooks, Microsoft Fabric, Azure Data Lake, Azure Data Factory, Azure SQL, Synapse, Databricks, Snowflake, Power BI, DAX, Git, SharePoint, MES, PLM, QMS
5d
Save
Mark Applied
Hide
Senior Data Engineer
Woburn, Massachusetts, United States
$130k-$164k/yr HybridFull Time
American Tower
American TowerNYSE: AMT: Leases space on wireless and broadcast towers for communications.
4+ YOEBachelor’s degree required; 4–7 years of data engineering or platform experience; SQL, Python, Spark/PySpark, cloud and data platform expertise; production pipeline, streaming, orchestration, and communication skills.
Structured Query Language, Python, Spark, PySpark, Azure, Databricks, Snowflake, Kafka, Airflow, Azure Data Factory
1mo
Save
Mark Applied
Hide
Principal Data Engineer
Boston, Massachusetts, United States
$175k-$200k/yr HybridFull Time
CodaMetrix
CodaMetrix: AI platform for autonomous medical coding and revenue management.
8+ YOEDegree in CS or related,8+ years data engineering,5+ years Databricks,expert PySpark/Python,Terraform,AWS,Kafka,CI/CD,HIPAA experience and disaster recovery expertise.
Databricks, PySpark, Unity Catalog, Delta Lake, Structured Streaming, Terraform, Apache Kafka, AWS MSK, Jenkins, GitHub Actions, Python, SQL, CloudZero, AWS Cost Explorer, Tableau, S3, IAM, Secrets Manager, VPC/Private Link, HL7, FHIR, EHR, Claude, Gemini, Codex
1mo
Save
Mark Applied
Hide
Data Engineer Senior Developer, AVP
Quincy or Boston
$90k-$158k/yr OnsiteFull Time
State Street
State StreetNYSE: STT: Provides investment servicing and management to institutional investors.
5+ YOEExperience designing and building cloud data lake solutions using AWS/Databricks, ETL/ELT with Spark/Scala/PySpark, data modeling, and CI/CD; 5+ years software/data engineering experience.
Apache Spark, Scala, Hadoop, Hive, AWS, Databricks, Terraform, CloudFormation, Amazon S3, Glue, Lambda, EMR, Redshift, Athena, Kinesis, PL/SQL, Python, PERL, Delta Lake, Unity Catalog, Databricks Workflows, Git, CI/CD, DevOps
4w
Save
Mark Applied
Hide
Databricks Data Engineer
United States or Arlington or Tysons or Washington or New York City or Chicago or Austin or Atlanta or Boston or Boulder
$113k-$188k/yr RemoteFull Time
Guidehouse
Guidehouse: Provides management and technology consulting services to diverse organizations.
3+ YOEBachelor's degree,3+ years data engineering experience,proficiency with Python/PySpark/SQL,Databricks/Spark/Delta Lake experience,knowledge of data pipelines,governance,and cloud platforms.
Databricks, PySpark, Python, SQL, Delta Lake, Unity Catalog, Spark, CI/CD, Terraform, Azure, AWS, GCP
1mo
Save
Mark Applied
Hide
Data Engineer
Atlanta or Baltimore or Boston or Charlotte or Columbus or Detroit or Hartford or Miami or New York or Philadelphia or Raleigh or Tampa or Washington
$91k-$122k/yr OnsiteFull Time
Slalom
Slalom: Provides business and technology consulting and software engineering services.
4+ YOE4+ years building production data engineering solutions; experience with cloud data platforms, streaming, orchestration, Python/Java; strong communication and critical thinking.
Amazon Redshift, Snowflake, Google BigQuery, Azure Synapse Analytics, Amazon EMR, Apache Spark, Presto, Databricks, Amazon Kinesis, Apache Kafka, Apache Airflow, dbt, Dagster, Azure Data Factory, DynamoDB, Cosmos DB, MongoDB, Kubernetes, Amazon ECS, Amazon SageMaker, Azure ML Studio, Python, Java
1mo
Save
Mark Applied
Hide
Associate Data Engineer / Data Engineer II / Senior Data Engineer (REMOTE)
Worcester, Massachusetts, United States
$60k-$130k/yr RemoteFull Time
The Hanover Insurance Group
The Hanover Insurance GroupNYSE: THG: Provides property and casualty insurance products and services.
0+ YOEDegree in data-related field, experience with data engineering/ETL, proficiency in SQL and Python, experience with Azure and Databricks, strong problem-solving and communication; must be eligible to work in the US without sponsorship.
Azure Synapse, Data Factory, ADLS, Databricks, Delta Tables, Spark, PySpark, SQL, T-SQL, Python, Java, Scala, Power BI, GitHub, Azure DevOps
1mo
Save
Mark Applied
Hide
Associate Data Engineer / Data Engineer II / Senior Data Engineer (REMOTE)
Worcester, Massachusetts, United States
$60k-$130k/yr RemoteFull Time
The Hanover Insurance Group
The Hanover Insurance GroupNYSE: THG: Provides property and casualty insurance products to individuals and businesses.
0+ YOEDegree in Data Science/Computer Science or related, experience in data engineering/ETL/data modeling (levels 0–5+ years), proficiency in SQL and Python, experience with Azure cloud platforms preferred, strong problem-solving and communication, US work authorization required.
Azure Synapse, Data Factory, ADLS, Data Lake, Databricks, Delta Tables, Spark, PySpark, SQL, T-SQL, Python, Java, Scala, Microsoft Power BI, GitHub, Azure DevOps, Azure
6d
Save
Mark Applied
Hide
Senior Data Engineer - NBA
Nashville or Boston
$118k-$162k/yr RemoteFull Time
Humana
HumanaNYSE: HUM: Provides health insurance plans and clinical healthcare services.
5+ YOERequires 5+ years of data engineering experience, strong SQL and Python, Spark-based pipelines, Databricks or lakehouse experience, batch and streaming processing, data modeling, quality controls, and operational support.
Databricks, Databricks Lakehouse, SQL, Python, Apache Spark, Delta Lake, Databricks Feature Store, Unity Catalog, Delta Live Tables, Databricks Workflows, Apache Kafka, Azure Data Factory, Azure Data Lake Storage, Azure Event Hubs, Great Expectations, Monte Carlo, Claude, GitHub Copilot, HireVue, Microsoft Workday
2w
Save
Mark Applied
Hide
Principal Data Engineer / Solution Architect Fabric
New York City or Boston
FieldFull Time, Contract
Fusemachines
FusemachinesNASDAQ: FUSE: Provides enterprise AI products, consulting, and talent development services.
8+ YOE8+ years in data engineering or architecture; advanced Microsoft Fabric, Azure, SQL, Python/PySpark, ADLS Gen2, and Databricks Unity Catalog expertise; regulated life sciences experience required.
Microsoft Fabric, Microsoft Fabric Data Factory, Azure Data Factory (ADF), Microsoft SQL, Python, PySpark, Databricks Unity Catalog, Azure Data Lake Storage Gen2 (ADLS Gen2)
2w
Save
Mark Applied
Hide
Senior Data Engineer
Boston, Massachusetts, United States
$150k-$215k/yr OnsiteFull Time
WHOOP
WHOOP: Wearable technology for personalized health and performance tracking.
5+ YOERequires 5+ years building production data systems, strong Python, SQL, ELT, Snowflake, dbt, distributed processing, initiative leadership, communication, and mentoring experience.
Python, PySpark, SQL, Snowflake, dbt, Spark, Kafka
2d
Save
Mark Applied
Hide
Lead Data Engineer - Tax Product Development
New York City or Washington or Houston or Chicago or Grand Rapids or Richmond or Raleigh or Boston or Denver or Atlanta or Orlando or Dallas or Milwaukee or Miami or Philadelphia or Charlotte or Seattle or United States
$140k-$210k/yr HybridFull Time
BDO USA
BDO USA: Provides accounting, tax, and business advisory services to organizations.
6+ YOEBachelor's degree required and 6+ years of data engineering experience. Requires programming experience and expertise in databases, SQL, ETL/ELT pipelines, data modeling, and distributed data environments.
SQL Server, PostgreSQL, Oracle, CosmosDB, MongoDB, Cassandra, DynamoDB, SQL, Apache Spark, Databricks, Airflow, Talend, Informatica, Python, Java, C#, C++, Scala, Microsoft Office Suite, Microsoft Azure DevOps, GitHub, Microsoft SQL Server, Azure SQL DB
1d
Save
Mark Applied
Hide
Sr. Data Engineer - Snowflake and Lakehouse
Phoenix or Johnston
$100k-$115k/yr OnsiteFull Time
Cognizant
CognizantNasdaq: CTSH: Provides global information technology and business process outsourcing services.
5+ YOERequires 5+ years delivering enterprise Snowflake data engineering solutions, advanced SQL, Snowpipe, dbt, Snowpark, Python, Spark, Kafka, AWS, data modeling, governance, and CI/CD experience.
Snowflake, Snowpipe, Snowpipe Streaming, dbt, Snowpark, Python, Apache Spark, Dynamic Tables, Snowflake Tasks, Apache Iceberg, Kafka, Change Data Capture (CDC), AWS, Amazon S3, AWS IAM, AWS Glue, AWS Lambda, SQL, Git, CI/CD, Java, Apache Airflow
1d
Save
Mark Applied
Hide
Sr. Data Engineer - Snowflake and Lakehouse
Phoenix or Johnston
$100k-$115k/yr OnsiteFull Time
Cognizant
CognizantNasdaq: CTSH: Provides IT consulting and digital business process services.
5+ YOERequires 5+ years delivering Snowflake data engineering solutions, advanced SQL, Snowpipe, dbt, Snowpark with Python and Spark, Kafka or CDC, AWS services, data modeling, governance, Git, and CI/CD.
Snowflake, Snowpipe, Snowpipe Streaming, dbt, Snowpark, Python, Apache Spark, Snowflake Tasks, Apache Iceberg, Kafka, Change Data Capture (CDC), Amazon Web Services (AWS), Amazon S3, AWS IAM, AWS Glue, AWS Lambda, SQL, Git, CI/CD, Java, Interactive Tables, Apache Airflow, SnowPro Core, SnowPro Advanced
3mo
Save
Mark Applied
Hide
Data Solution Engineer
Boston, Massachusetts, United States
$120k-$180k/yr HybridFull Time
RA Capital Management
RA Capital Management: Invests in and builds life science and sustainability companies.
2+ YOEBachelor’s or Master’s in CS/Data Eng; 2-5 years BI/data solutions; SQL/Python; Databricks/Snowflake/AWS; healthcare/biotech/finance exp; Boston hybrid; US work eligibility.
Databricks, Snowflake, AWS, SQL, Python, PySpark, Sigma Computing, Dash Enterprise
1w
Save
Mark Applied
Hide
Data Engineering and Development VP
Quincy, Massachusetts, United States
$120k-$218k/yr OnsiteFull Time
State Street
State StreetNYSE: STT: Provides investment management and custody services to institutional investors.
12+ YOE12+ years in IT delivery, including 3+ years in AI/ML and data engineering; expertise in Python, Spark, PySpark, Databricks, AI models, data architecture, governance, and regulated financial services.
Python, FastAPI, PyTorch, TensorFlow, Pandas, Java, Fiddler, Postman, Apache Spark, PySpark, Databricks, OpenAI, Hugging Face, Azure OpenAI, LangChain
1mo
Save
Mark Applied
Hide
Senior Business Intelligence Engineer
Boston, Massachusetts, United States
$150k-$185k/yr HybridFull Time
WilmerHale
WilmerHale: Global law firm providing comprehensive legal representation services.
3+ YOE3+ years in data analysis/warehousing, hands-on Microsoft Fabric, Power BI, T-SQL, DAX, Azure Data Factory and notebook transformations (Python/PySpark); CI/CD and DevOps experience; strong analytical and communication skills.
Microsoft Fabric, Power BI, DAX, SQL, T-SQL, Python, PySpark, Azure Data Factory, MSSQL, Microsoft SharePoint, Microsoft Excel, Microsoft Dev Ops, SSIS, SSAS, SSRS, Azure Keyvault, Azure Logic Apps, Azure Storage Accounts, SQL Server, CI/CD, ITIL
1w
Save
Mark Applied
Hide
BI / Data Architect
Marlborough, Massachusetts, United States
$150k-$160k/yr OnsiteFull Time
Tata Consultancy Services
Tata Consultancy ServicesNational Stock Exchange of India: TCS: Global provider of IT services, consulting, and business solutions.
12+ YOERequires 12–15 years of experience with lakehouse architecture, Apache Iceberg, Spark, Flink, Kafka, cloud platforms, data engineering tools, programming languages, containers, and infrastructure automation.
Apache Iceberg, Apache Spark, Apache Flink, Apache Kafka, dbt, Trino, Snowflake, Databricks, AWS, Microsoft Azure, Google Cloud, Python, Scala, SQL, Java, Kubernetes, Docker, Terraform, Apache Airflow, Dagster, Prefect, Polaris, Unity Catalog, Glue Catalog, Apache Nessie
3w
Save
Mark Applied
Hide
Forward Deployed Engineer
Boston or New York City
OnsiteFull Time
OnCorps
OnCorps: Automating financial fund operations with domain-specific AI agents.
7+ YOERequires 7+ years in solutions or forward-deployed engineering, JSON/YAML, REST APIs, Python or TypeScript, SQL, databases, data pipelines, Databricks, CI/CD, and strong communication skills.
JSON, YAML, REST API, Python, TypeScript, SQL, Databricks, Pandas, PySpark, AWS, Docker, Kubernetes