50 pyspark data engineer jobs at 32 companies in Dudley, MA
1w
Save
Mark Applied
Hide
Pyspark Developer
Hartford or Indianapolis or Phoenix or Raleigh or Richardson
OnsiteFull Time
Bachelor's degree or equivalent experience; experience with PySpark, AWS Redshift, AWS Glue and Gen AI; ability to work across SDLC, support production systems; US work authorization required; relocation/travel possible.
PySpark, AWS Redshift, Gen AI, AWS Glue
4w
Save
Mark Applied
Hide
Principal Data Engineer
Boston, Massachusetts, United States
$175k-$200k/yr HybridFull Time
8+ YOEDegree in CS or related,8+ years data engineering,5+ years Databricks,expert PySpark/Python,Terraform,AWS,Kafka,CI/CD,HIPAA experience and disaster recovery expertise.
Databricks, PySpark, Unity Catalog, Delta Lake, Structured Streaming, Terraform, Apache Kafka, AWS MSK, Jenkins, GitHub Actions, Python, SQL, CloudZero, AWS Cost Explorer, Tableau, S3, IAM, Secrets Manager, VPC/Private Link, HL7, FHIR, EHR, Claude, Gemini, Codex
2w
Save
Mark Applied
Hide
Data Engineer Senior Developer, AVP
Quincy or Boston
$90k-$158k/yr OnsiteFull Time
5+ YOEExperience designing and building cloud data lake solutions using AWS/Databricks, ETL/ELT with Spark/Scala/PySpark, data modeling, and CI/CD; 5+ years software/data engineering experience.
Apache Spark, Scala, Hadoop, Hive, AWS, Databricks, Terraform, CloudFormation, Amazon S3, Glue, Lambda, EMR, Redshift, Athena, Kinesis, PL/SQL, Python, PERL, Delta Lake, Unity Catalog, Databricks Workflows, Git, CI/CD, DevOps
1mo
Save
Mark Applied
Hide
Data Engineer II - Databricks Platform
Hartford or Hunt Valley or Saint Paul
$127k-$209k/yr HybridFull Time
8+ YOEBachelor’s in STEM or equivalent, ~8 years related experience with additional data engineering experience, strong Databricks/PySpark/AWS skills, data governance and quality experience, stakeholder communication and leadership.
Databricks, Unity Catalog, Pyspark, AWS, Genie
1mo
Save
Mark Applied
Hide
Data Engineer
Atlanta or Baltimore or Boston or Charlotte or Columbus or Detroit or Hartford or Miami or New York or Philadelphia or Raleigh or Tampa or Washington
$91k-$122k/yr OnsiteFull Time
4+ YOE4+ years building production data engineering solutions; experience with cloud data platforms, streaming, orchestration, Python/Java; strong communication and critical thinking.
Amazon Redshift, Snowflake, Google BigQuery, Azure Synapse Analytics, Amazon EMR, Apache Spark, Presto, Databricks, Amazon Kinesis, Apache Kafka, Apache Airflow, dbt, Dagster, Azure Data Factory, DynamoDB, Cosmos DB, MongoDB, Kubernetes, Amazon ECS, Amazon SageMaker, Azure ML Studio, Python, Java
1mo
Save
Mark Applied
Hide
Associate Data Engineer / Data Engineer II / Senior Data Engineer (REMOTE)
Worcester, Massachusetts, United States
$60k-$130k/yr RemoteFull Time
0+ YOEDegree in data-related field, experience with data engineering/ETL, proficiency in SQL and Python, experience with Azure and Databricks, strong problem-solving and communication; must be eligible to work in the US without sponsorship.
Azure Synapse, Data Factory, ADLS, Databricks, Delta Tables, Spark, PySpark, SQL, T-SQL, Python, Java, Scala, Power BI, GitHub, Azure DevOps
1mo
Save
Mark Applied
Hide
Associate Data Engineer / Data Engineer II / Senior Data Engineer (REMOTE)
Worcester, Massachusetts, United States
$60k-$130k/yr RemoteFull Time
0+ YOEDegree in Data Science/Computer Science or related, experience in data engineering/ETL/data modeling (levels 0–5+ years), proficiency in SQL and Python, experience with Azure cloud platforms preferred, strong problem-solving and communication, US work authorization required.
Azure Synapse, Data Factory, ADLS, Data Lake, Databricks, Delta Tables, Spark, PySpark, SQL, T-SQL, Python, Java, Scala, Microsoft Power BI, GitHub, Azure DevOps, Azure
2mo
Save
Mark Applied
Hide
Senior Data Engineer, Underwriting Technical Lead
Hartford or St. Paul
$139k-$230k/yr HybridFull Time
10+ YOEBachelor's in STEM or equivalent; ~10 years related experience with 6+ years in data engineering; expertise with AWS (S3, Glue, Redshift, Lambda, EMR), Databricks, dbt, PySpark; AI/ML knowledge; technical leadership and mentoring experience.
AWS, S3, Glue, Redshift, Lambda, EMR, Databricks, dbt, PySpark, Azure Data Factory, Synapse Analytics, Azure Databricks
3d
Save
Mark Applied
Hide
Senior Data Engineer
White Plains or Greensboro or Charleston or Greenville or Maitland or Harrisonburg or Clearwater or Louisville or Birmingham or Huntsville or Alpharetta or Clayton or Honolulu or Lake Oswego or Gainesville or Fayetteville or Naples or Hibbing or Miami or Myrtle Beach or Houston or Denver or Piscataway or Irvine or Key Largo or Columbia or Little Rock or Austin or Pensacola or Lexington or Bloomington or Fort Myers or Panama City or San Antonio or Rochester or Mobile or Salt Lake City or Bend or Charlotte or Glen Allen or Raleigh or Abilene or Tallahassee or San Ramon or Dallas or Pittsburgh or Boston or Missoula or Cincinnati or Boise or Eugene or McMinnville or Knoxville or Dakota Dunes or Kissimmee or Fort Worth or Grand Forks or Canonsburg or Buffalo or Eastland or Philadelphia or Chicago or Phoenix or Dublin or Jacksonville or St. Louis or Los Angeles or Atlanta or Norwalk or Colchester or Grand Rapids or Richmond or Hoboken or Indianapolis or Kansas City or Chagrin Falls or Orland Park or Anchorage or High Point or Bonita Springs or Rancho Cordova or Las Vegas or Irving or Brandenburg or Minneapolis or Fort Lauderdale or Shreveport or Fargo or Sarasota or Kennesaw or Dayton or Sacramento or Princeton or Durham or Conshohocken or Baton Rouge or Asheville or Chattanooga or Memphis or Nashville or United States
$96k-$168k/yr RemoteFull Time
10+ YOERequires 10+ years of enterprise data engineering experience and advanced Azure, Databricks, Spark, Python, SQL, ETL, data modeling, streaming, and cloud architecture expertise.
Microsoft Azure, Azure Databricks, Azure Functions, Azure Data Factory, Databricks, Apache Spark, PySpark, Python, SQL, Scala, Unity Catalog, Microsoft SQL Server, Kafka, Event Hub, Azure DevOps, Git, Terraform, ARM templates, Databricks Genie
1d
Save
Mark Applied
Hide
Principal Data Engineer / Solution Architect Fabric
New York City or Boston
FieldFull Time, Contract
8+ YOE8+ years in data engineering or architecture; advanced Microsoft Fabric, Azure, SQL, Python/PySpark, ADLS Gen2, and Databricks Unity Catalog expertise; regulated life sciences experience required.
Microsoft Fabric, Microsoft Fabric Data Factory, Azure Data Factory (ADF), Microsoft SQL, Python, PySpark, Databricks Unity Catalog, Azure Data Lake Storage Gen2 (ADLS Gen2)
3mo
Save
Mark Applied
Hide
Principal, Data Engineer
Woburn, Massachusetts, United States
HybridFull Time
8+ YOE8+ years data engineering; CS/Math degree; expert SQL/Python; cloud platforms; Spark; Kafka; Airflow; governance; leadership.
SQL, Python, Apache Spark, PySpark, AWS, Azure, Google Cloud, Databricks, Snowflake, Kafka, Kinesis, Airflow, dbt, CI/CD, Infrastructure as Code, Data Quality, Data Governance
1d
Save
Mark Applied
Hide
Senior Data Science Engineer
Boston or United States
$121k-$151k/yr RemoteFull Time
3+ YOEBachelor’s degree in a quantitative field, 3+ years building production machine learning or analytics solutions, and strong Python, pandas, NumPy, and PySpark proficiency.
Python, pandas, NumPy, PySpark
2mo
Save
Mark Applied
Hide
Data Engineer (CT, Newington)
Newington, Connecticut, United States
OnsiteFull Time
Bachelor's in a technical field (or equivalent), extensive data engineering experience with SQL and Python, BI and ETL tool proficiency, experience deploying ML models, and familiarity with CMMC/NIST SP 800-171 and ITAR eligibility requirements.
SQL, Python, Microsoft SQL Server, Oracle, PostgreSQL, Microsoft Power BI, SSRS, PowerShell, C#, Perl, Microsoft SharePoint, ASP.NET Core, PHP, Bootstrap, HTML5, React.js, Node.js, Django, Microsoft Graph API, Microsoft Power Platform, Power Apps, Power Automate, Tableau, Qlik, Looker, MicroStrategy, Oracle Analytics, Microsoft Power Query, SSIS, Talend, Boomi, Apache Airflow, Prefect, Dagster, Apache Spark, Databricks, MLOps
6d
Save
Mark Applied
Hide
Senior Data Engineer
Boston, Massachusetts, United States
$150k-$215k/yr OnsiteFull Time
5+ YOERequires 5+ years building production data systems, strong Python, SQL, ELT, Snowflake, dbt, distributed processing, initiative leadership, communication, and mentoring experience.
Python, PySpark, SQL, Snowflake, dbt, Spark, Kafka
2mo
Save
Mark Applied
Hide
Sr Data Engineer- Data Platform & AI Enablement
Johnston or United States
OnsiteFull Time
6+ YOE6+ years data engineering experience; hands-on with streaming (Apache Spark, Beam, Flink) and Kafka; Java/Scala/Python; strong SQL; experience with Redshift, PostgreSQL, Snowflake, MongoDB; CI/CD (Bitbucket/Git); AWS/Azure; AI/GenAI/LLM pipelines.
Apache Spark, Beam, Flink, Apache Kafka, Java, Scala, Python, SQL, Redshift, PostgreSQL, Snowflake, MongoDB, Bitbucket, Git, Talend, DataStage, Java Spring Boot, React, TypeScript, Angular, AWS, Azure
2mo
Save
Mark Applied
Hide
Data Solution Engineer
Boston, Massachusetts, United States
$120k-$180k/yr HybridFull Time
2+ YOEBachelor’s or Master’s in CS/Data Eng; 2-5 years BI/data solutions; SQL/Python; Databricks/Snowflake/AWS; healthcare/biotech/finance exp; Boston hybrid; US work eligibility.
Databricks, Snowflake, AWS, SQL, Python, PySpark, Sigma Computing, Dash Enterprise
1d
Save
Mark Applied
Hide
Data Engineer (Hybrid)
Cedar Rapids or Charlotte or Windsor Locks or Richardson
$87k-$165k/yr HybridFull Time
5+ YOEUniversity degree and 5 years of relevant experience, or advanced degree and 3 years. Requires U.S. citizenship, Python, SQL, data frameworks, cloud platforms, ETL/ELT, distributed systems, and secure data architecture.
Python, SQL, Spark, PySpark, Databricks, EMR, Glue, AWS, Microsoft Azure, GCP, SharePoint, Terraform, CloudFormation, GitHub Actions, Jenkins
2w
Save
Mark Applied
Hide
Senior Data Quality & Active Learning AI Engineer (Plymouth)
Plymouth or Bedford
$156k-$187k/yr HybridFull Time
5+ YOE5+ years data-quality or data-engineering experience, bachelor's degree, expertise with medical imaging data, DICOM/PACS, HIPAA/GDPR, active-learning methods, Python and SQL, cloud data pipelines and validation.
Python, Structured Query Language (SQL), Amazon Web Services (AWS), Apache Spark, Ray, Digital Imaging and Communications in Medicine (DICOM), Picture Archiving and Communication System (PACS), HL7, Fast Healthcare Interoperability Resources (FHIR), OpenAI Codex, Claude Code, PyTorch, TensorFlow
1mo
Save
Mark Applied
Hide
Senior Business Intelligence Engineer
Boston, Massachusetts, United States
$150k-$185k/yr HybridFull Time
3+ YOE3+ years in data analysis/warehousing, hands-on Microsoft Fabric, Power BI, T-SQL, DAX, Azure Data Factory and notebook transformations (Python/PySpark); CI/CD and DevOps experience; strong analytical and communication skills.
Microsoft Fabric, Power BI, DAX, SQL, T-SQL, Python, PySpark, Azure Data Factory, MSSQL, Microsoft SharePoint, Microsoft Excel, Microsoft Dev Ops, SSIS, SSAS, SSRS, Azure Keyvault, Azure Logic Apps, Azure Storage Accounts, SQL Server, CI/CD, ITIL
1w
Save
Mark Applied
Hide
Director of Retail Actuarial Data
Hartford or New York City or Charlotte
$165k-$180k/yr HybridFull Time
6+ YOEBachelor's degree in a quantitative field and 6+ years in actuarial data, data engineering, data science, or related insurance fields. Requires SQL, databases, data engineering, ETL, AI tools, and strong communication.
SQL, Python, PySpark, Power BI, ETL, AI
Explore Jobs