40 pyspark data engineer jobs at 29 companies in Natick, MA
1mo
Save
Mark Applied
Hide
Data Engineer
Nashua, New Hampshire, United States
OnsiteFull Time
3+ YOEBS in a relevant field, 3+ years data engineering experience, strong SQL, Python/PySpark, ETL/ELT, cloud data platform experience (Microsoft Fabric/Azure/Databricks/Snowflake), data modeling, data quality, orchestration, and ability to work with stakeholders; travel as required.
SQL, Python, PySpark, notebooks, Microsoft Fabric, Azure Data Lake, Azure Data Factory, Azure SQL, Synapse, Databricks, Snowflake, Power BI, DAX, Git, SharePoint, MES, PLM, QMS
1mo
Save
Mark Applied
Hide
Data Engineer
Nashua, New Hampshire, United States
OnsiteFull Time
3+ YOEBS in a computing field required, 3+ years data engineering experience; strong SQL, Python/PySpark, ETL/ELT, cloud data platform experience (Microsoft Fabric, Azure, Databricks, Snowflake); data modeling, data quality, orchestration, and collaboration skills; travel as required.
SQL, Python, PySpark, notebooks, Microsoft Fabric, Azure Data Lake, Azure Data Factory, Synapse, Databricks, Snowflake, Azure SQL, Power BI, DAX, Git, SharePoint, ERP, MES, PLM, QMS
4w
Save
Mark Applied
Hide
Principal Data Engineer
Boston, Massachusetts, United States
$175k-$200k/yr HybridFull Time
8+ YOEDegree in CS or related,8+ years data engineering,5+ years Databricks,expert PySpark/Python,Terraform,AWS,Kafka,CI/CD,HIPAA experience and disaster recovery expertise.
Databricks, PySpark, Unity Catalog, Delta Lake, Structured Streaming, Terraform, Apache Kafka, AWS MSK, Jenkins, GitHub Actions, Python, SQL, CloudZero, AWS Cost Explorer, Tableau, S3, IAM, Secrets Manager, VPC/Private Link, HL7, FHIR, EHR, Claude, Gemini, Codex
2w
Save
Mark Applied
Hide
Data Engineer Senior Developer, AVP
Quincy or Boston
$90k-$158k/yr OnsiteFull Time
5+ YOEExperience designing and building cloud data lake solutions using AWS/Databricks, ETL/ELT with Spark/Scala/PySpark, data modeling, and CI/CD; 5+ years software/data engineering experience.
Apache Spark, Scala, Hadoop, Hive, AWS, Databricks, Terraform, CloudFormation, Amazon S3, Glue, Lambda, EMR, Redshift, Athena, Kinesis, PL/SQL, Python, PERL, Delta Lake, Unity Catalog, Databricks Workflows, Git, CI/CD, DevOps
1mo
Save
Mark Applied
Hide
Data Engineer
Atlanta or Baltimore or Boston or Charlotte or Columbus or Detroit or Hartford or Miami or New York or Philadelphia or Raleigh or Tampa or Washington
$91k-$122k/yr OnsiteFull Time
4+ YOE4+ years building production data engineering solutions; experience with cloud data platforms, streaming, orchestration, Python/Java; strong communication and critical thinking.
Amazon Redshift, Snowflake, Google BigQuery, Azure Synapse Analytics, Amazon EMR, Apache Spark, Presto, Databricks, Amazon Kinesis, Apache Kafka, Apache Airflow, dbt, Dagster, Azure Data Factory, DynamoDB, Cosmos DB, MongoDB, Kubernetes, Amazon ECS, Amazon SageMaker, Azure ML Studio, Python, Java
1mo
Save
Mark Applied
Hide
Associate Data Engineer / Data Engineer II / Senior Data Engineer (REMOTE)
Worcester, Massachusetts, United States
$60k-$130k/yr RemoteFull Time
0+ YOEDegree in data-related field, experience with data engineering/ETL, proficiency in SQL and Python, experience with Azure and Databricks, strong problem-solving and communication; must be eligible to work in the US without sponsorship.
Azure Synapse, Data Factory, ADLS, Databricks, Delta Tables, Spark, PySpark, SQL, T-SQL, Python, Java, Scala, Power BI, GitHub, Azure DevOps
1mo
Save
Mark Applied
Hide
Associate Data Engineer / Data Engineer II / Senior Data Engineer (REMOTE)
Worcester, Massachusetts, United States
$60k-$130k/yr RemoteFull Time
0+ YOEDegree in Data Science/Computer Science or related, experience in data engineering/ETL/data modeling (levels 0–5+ years), proficiency in SQL and Python, experience with Azure cloud platforms preferred, strong problem-solving and communication, US work authorization required.
Azure Synapse, Data Factory, ADLS, Data Lake, Databricks, Delta Tables, Spark, PySpark, SQL, T-SQL, Python, Java, Scala, Microsoft Power BI, GitHub, Azure DevOps, Azure
3d
Save
Mark Applied
Hide
Senior Data Engineer
White Plains or Greensboro or Charleston or Greenville or Maitland or Harrisonburg or Clearwater or Louisville or Birmingham or Huntsville or Alpharetta or Clayton or Honolulu or Lake Oswego or Gainesville or Fayetteville or Naples or Hibbing or Miami or Myrtle Beach or Houston or Denver or Piscataway or Irvine or Key Largo or Columbia or Little Rock or Austin or Pensacola or Lexington or Bloomington or Fort Myers or Panama City or San Antonio or Rochester or Mobile or Salt Lake City or Bend or Charlotte or Glen Allen or Raleigh or Abilene or Tallahassee or San Ramon or Dallas or Pittsburgh or Boston or Missoula or Cincinnati or Boise or Eugene or McMinnville or Knoxville or Dakota Dunes or Kissimmee or Fort Worth or Grand Forks or Canonsburg or Buffalo or Eastland or Philadelphia or Chicago or Phoenix or Dublin or Jacksonville or St. Louis or Los Angeles or Atlanta or Norwalk or Colchester or Grand Rapids or Richmond or Hoboken or Indianapolis or Kansas City or Chagrin Falls or Orland Park or Anchorage or High Point or Bonita Springs or Rancho Cordova or Las Vegas or Irving or Brandenburg or Minneapolis or Fort Lauderdale or Shreveport or Fargo or Sarasota or Kennesaw or Dayton or Sacramento or Princeton or Durham or Conshohocken or Baton Rouge or Asheville or Chattanooga or Memphis or Nashville or United States
$96k-$168k/yr RemoteFull Time
10+ YOERequires 10+ years of enterprise data engineering experience and advanced Azure, Databricks, Spark, Python, SQL, ETL, data modeling, streaming, and cloud architecture expertise.
Microsoft Azure, Azure Databricks, Azure Functions, Azure Data Factory, Databricks, Apache Spark, PySpark, Python, SQL, Scala, Unity Catalog, Microsoft SQL Server, Kafka, Event Hub, Azure DevOps, Git, Terraform, ARM templates, Databricks Genie
1d
Save
Mark Applied
Hide
Principal Data Engineer / Solution Architect Fabric
New York City or Boston
FieldFull Time, Contract
8+ YOE8+ years in data engineering or architecture; advanced Microsoft Fabric, Azure, SQL, Python/PySpark, ADLS Gen2, and Databricks Unity Catalog expertise; regulated life sciences experience required.
Microsoft Fabric, Microsoft Fabric Data Factory, Azure Data Factory (ADF), Microsoft SQL, Python, PySpark, Databricks Unity Catalog, Azure Data Lake Storage Gen2 (ADLS Gen2)
3mo
Save
Mark Applied
Hide
Principal, Data Engineer
Woburn, Massachusetts, United States
HybridFull Time
8+ YOE8+ years data engineering; CS/Math degree; expert SQL/Python; cloud platforms; Spark; Kafka; Airflow; governance; leadership.
SQL, Python, Apache Spark, PySpark, AWS, Azure, Google Cloud, Databricks, Snowflake, Kafka, Kinesis, Airflow, dbt, CI/CD, Infrastructure as Code, Data Quality, Data Governance
1d
Save
Mark Applied
Hide
Senior Data Science Engineer
Boston or United States
$121k-$151k/yr RemoteFull Time
3+ YOEBachelor’s degree in a quantitative field, 3+ years building production machine learning or analytics solutions, and strong Python, pandas, NumPy, and PySpark proficiency.
Python, pandas, NumPy, PySpark
6d
Save
Mark Applied
Hide
Senior Data Engineer
Boston, Massachusetts, United States
$150k-$215k/yr OnsiteFull Time
5+ YOERequires 5+ years building production data systems, strong Python, SQL, ELT, Snowflake, dbt, distributed processing, initiative leadership, communication, and mentoring experience.
Python, PySpark, SQL, Snowflake, dbt, Spark, Kafka
2mo
Save
Mark Applied
Hide
Sr Data Engineer- Data Platform & AI Enablement
Johnston or United States
OnsiteFull Time
6+ YOE6+ years data engineering experience; hands-on with streaming (Apache Spark, Beam, Flink) and Kafka; Java/Scala/Python; strong SQL; experience with Redshift, PostgreSQL, Snowflake, MongoDB; CI/CD (Bitbucket/Git); AWS/Azure; AI/GenAI/LLM pipelines.
Apache Spark, Beam, Flink, Apache Kafka, Java, Scala, Python, SQL, Redshift, PostgreSQL, Snowflake, MongoDB, Bitbucket, Git, Talend, DataStage, Java Spring Boot, React, TypeScript, Angular, AWS, Azure
2mo
Save
Mark Applied
Hide
Data Solution Engineer
Boston, Massachusetts, United States
$120k-$180k/yr HybridFull Time
2+ YOEBachelor’s or Master’s in CS/Data Eng; 2-5 years BI/data solutions; SQL/Python; Databricks/Snowflake/AWS; healthcare/biotech/finance exp; Boston hybrid; US work eligibility.
Databricks, Snowflake, AWS, SQL, Python, PySpark, Sigma Computing, Dash Enterprise
2w
Save
Mark Applied
Hide
Senior Data Quality & Active Learning AI Engineer (Plymouth)
Plymouth or Bedford
$156k-$187k/yr HybridFull Time
5+ YOE5+ years data-quality or data-engineering experience, bachelor's degree, expertise with medical imaging data, DICOM/PACS, HIPAA/GDPR, active-learning methods, Python and SQL, cloud data pipelines and validation.
Python, Structured Query Language (SQL), Amazon Web Services (AWS), Apache Spark, Ray, Digital Imaging and Communications in Medicine (DICOM), Picture Archiving and Communication System (PACS), HL7, Fast Healthcare Interoperability Resources (FHIR), OpenAI Codex, Claude Code, PyTorch, TensorFlow
1w
Save
Mark Applied
Hide
Data Engineering Quality Engineer
Dallas or Merrimack or Jersey City
$69k-$153k/yr OnsiteFull Time
6+ YOE6+ years quality engineering experience; strong SQL, Python, and API testing; ETL/ELT and BI validation; automation and CI/CD experience; Bachelor's degree in computer science or related field.
Playwright, RestAssured, Karate, Cucumber, TestNG, Oracle, PostgreSQL, DB2, SQL, PL/SQL, Python, GitHub, Jenkins, Maven, Docker, SonarQube, AWS, Azure, Google Cloud, Snowflake, Databricks, Apache Spark, Hadoop, Jira
1mo
Save
Mark Applied
Hide
Senior Business Intelligence Engineer
Boston, Massachusetts, United States
$150k-$185k/yr HybridFull Time
3+ YOE3+ years in data analysis/warehousing, hands-on Microsoft Fabric, Power BI, T-SQL, DAX, Azure Data Factory and notebook transformations (Python/PySpark); CI/CD and DevOps experience; strong analytical and communication skills.
Microsoft Fabric, Power BI, DAX, SQL, T-SQL, Python, PySpark, Azure Data Factory, MSSQL, Microsoft SharePoint, Microsoft Excel, Microsoft Dev Ops, SSIS, SSAS, SSRS, Azure Keyvault, Azure Logic Apps, Azure Storage Accounts, SQL Server, CI/CD, ITIL
1w
Save
Mark Applied
Hide
Forward Deployed Engineer
Boston or New York City
OnsiteFull Time
7+ YOERequires 7+ years in solutions or forward-deployed engineering, JSON/YAML, REST APIs, Python or TypeScript, SQL, databases, data pipelines, Databricks, CI/CD, and strong communication skills.
JSON, YAML, REST API, Python, TypeScript, SQL, Databricks, Pandas, PySpark, AWS, Docker, Kubernetes
2mo
Save
Mark Applied
Hide
Senior Software Engineer
Wakefield or Boston
$102k-$190k/yr OnsiteFull Time
5+ YOE5-8 years software engineering, strong data engineering and distributed systems experience; AWS, Databricks, Python, PySpark; Databricks, Spark, Kafka/RabbitMQ; SQL/NoSQL databases; CI/CD and DevOps; mentoring.
AWS, Databricks, Python, PySpark, Apache Spark, Kafka, RabbitMQ, SQL Server, MongoDB, Jenkins, GitHub, GitLab, Bitbucket, CI/CD, DevOps
2w
Save
Mark Applied
Hide
ML Data Scientist III ( Seattle/Provo)
Provo or Seattle or Chicago or Boston or South Bend
$100k-$140k/yr HybridFull Time
5+ YOEMaster's in CS/AI or related,5+ years in applied research or software engineering,proven conversational AI and generative AI experience,knowledge of ML/NLP and collaboration skills.
LangChain, LangGraph, MCP, ADK, A2A, Apache Spark, Databricks, Docker, Kubernetes, Azure, AWS, GCP
Explore Jobs