119 spark data engineer jobs at 39 companies in Shrewsbury, MA

2w
Save
Mark Applied
Hide
Databricks Data Engineer
United States or Arlington or Tysons or Washington or New York City or Chicago or Austin or Atlanta or Boston or Boulder
$113k-$188k/yr RemoteFull Time
Guidehouse
Guidehouse: Provides management and technology consulting services to diverse organizations.
3+ YOEBachelor's degree,3+ years data engineering experience,proficiency with Python/PySpark/SQL,Databricks/Spark/Delta Lake experience,knowledge of data pipelines,governance,and cloud platforms.
Databricks, PySpark, Python, SQL, Delta Lake, Unity Catalog, Spark, CI/CD, Terraform, Azure, AWS, GCP
1mo
Save
Mark Applied
Hide
Data Engineer II
Providence, Rhode Island, United States
$104k/yr OnsiteFull Time
International Game Technology
International Game Technology: Global provider of gaming, digital entertainment, and fintech solutions.
3+ YOEBachelor's or equivalent, 3+ years data engineering, strong SQL and Python, Databricks/Spark experience, cloud (AWS) familiarity, data modeling and ETL/ELT experience.
Databricks, Apache Spark, Delta Lake, Python, SQL, Amazon S3, Git, REST APIs, Apache Airflow, Databricks Workflows, CI/CD pipelines
1w
Save
Mark Applied
Hide
Senior Data Engineer
Austin or Boston or Charleston or Charlotte or Chicago or Dallas or Durham or Harrisburg or Houston or Irvine or Kansas City or Los Angeles or Miami or Nashville or New York or Newark or Palo Alto or Pittsburgh or Portland or Raleigh or San Francisco or Seattle or Washington or Wilmington
$128k-$249k/yr HybridFull Time
K&L Gates
K&L Gates: Global law firm providing comprehensive legal and regulatory counsel.
5+ YOE5+ years designing enterprise Microsoft Fabric data platforms; strong SQL and Python skills; experience with Spark, CI/CD, Azure DevOps/GitHub Actions; knowledge of data governance and Azure AI Foundry; Bachelor's degree or equivalent.
Microsoft Fabric, OneLake, Fabric Data Factory, Dataflow Gen2, Fabric Notebooks, Azure AI Foundry, Microsoft Copilot, Claude, SQL, Python, Spark, Azure DevOps, GitHub Actions, Microsoft Purview
2w
Save
Mark Applied
Hide
Data Engineer Senior Developer, AVP
Quincy or Boston
$90k-$158k/yr OnsiteFull Time
State Street
State StreetNYSE: STT: Provides investment servicing and management to institutional investors.
5+ YOEExperience designing and building cloud data lake solutions using AWS/Databricks, ETL/ELT with Spark/Scala/PySpark, data modeling, and CI/CD; 5+ years software/data engineering experience.
Apache Spark, Scala, Hadoop, Hive, AWS, Databricks, Terraform, CloudFormation, Amazon S3, Glue, Lambda, EMR, Redshift, Athena, Kinesis, PL/SQL, Python, PERL, Delta Lake, Unity Catalog, Databricks Workflows, Git, CI/CD, DevOps
3w
Save
Mark Applied
Hide
Senior Data Engineer
Boston or Chicago or Dallas or Los Angeles or Minneapolis or New York City or San Francisco or Seattle or Washington, D.C.
$120k-$162k/yr HybridFull Time
West Monroe
West Monroe: Business and technology consultancy specializing in digital transformation.
4+ YOE4+ years building enterprise data platforms with Databricks, Snowflake or Microsoft Fabric; Spark/SQL/Python; cloud (AWS/Azure/GCP); Git/CI-CD; experience enabling analytics and AI; travel 30–50%; US work authorization required.
Databricks, Snowflake, Microsoft Fabric, AWS, Azure, GCP, Spark, SQL, Python, Azure Data Factory, Azure Storage, Azure Synapse, Git, CI/CD, ChatGPT
1mo
Save
Mark Applied
Hide
Associate Data Engineer / Data Engineer II / Senior Data Engineer (REMOTE)
Worcester, Massachusetts, United States
$60k-$130k/yr RemoteFull Time
The Hanover Insurance Group
The Hanover Insurance GroupNYSE: THG: Provides property and casualty insurance products and services.
0+ YOEDegree in data-related field, experience with data engineering/ETL, proficiency in SQL and Python, experience with Azure and Databricks, strong problem-solving and communication; must be eligible to work in the US without sponsorship.
Azure Synapse, Data Factory, ADLS, Databricks, Delta Tables, Spark, PySpark, SQL, T-SQL, Python, Java, Scala, Power BI, GitHub, Azure DevOps
1mo
Save
Mark Applied
Hide
Associate Data Engineer / Data Engineer II / Senior Data Engineer (REMOTE)
Worcester, Massachusetts, United States
$60k-$130k/yr RemoteFull Time
The Hanover Insurance Group
The Hanover Insurance GroupNYSE: THG: Provides property and casualty insurance products to individuals and businesses.
0+ YOEDegree in Data Science/Computer Science or related, experience in data engineering/ETL/data modeling (levels 0–5+ years), proficiency in SQL and Python, experience with Azure cloud platforms preferred, strong problem-solving and communication, US work authorization required.
Azure Synapse, Data Factory, ADLS, Data Lake, Databricks, Delta Tables, Spark, PySpark, SQL, T-SQL, Python, Java, Scala, Microsoft Power BI, GitHub, Azure DevOps, Azure
3mo
Save
Mark Applied
Hide
Principal, Data Engineer
Woburn, Massachusetts, United States
HybridFull Time
American Tower
American TowerNYSE: AMT: Leases space on wireless and broadcast towers for communications.
8+ YOE8+ years data engineering; CS/Math degree; expert SQL/Python; cloud platforms; Spark; Kafka; Airflow; governance; leadership.
SQL, Python, Apache Spark, PySpark, AWS, Azure, Google Cloud, Databricks, Snowflake, Kafka, Kinesis, Airflow, dbt, CI/CD, Infrastructure as Code, Data Quality, Data Governance
2mo
Save
Mark Applied
Hide
Staff Data Engineer
Waltham or North Bethesda
$180k-$200k/yr HybridFull Time
Xometry
XometryNASDAQ: XMTR: Operates an AI-powered marketplace for custom manufacturing and prototyping.
5+ YOESenior data engineer owning enterprise-scale data architecture and partner integrations.
Snowflake, SQL, Python, dbt, Airbyte, Airflow, Kafka, Spark, Kinesis, Looker, Streamlit, Terraform, CloudFormation, Apache Iceberg
6d
Save
Mark Applied
Hide
Data Engineer
California or Boston
$90k-$167k/yr RemoteFull Time
Manulife
ManulifeTSX: MFC: Provides insurance, wealth management, and investment services globally.
3+ YOEMaster’s degree in computer science, engineering, information systems, or related field; 3+ years with Python, SQL, ETL, cloud, distributed computing, databases, governance, APIs, machine learning, and monitoring.
Python, SQL, ETL, Microsoft Azure, AWS, Spark, Databricks, Synapse, Apache Airflow, Power BI, Tableau, MongoDB, REST APIs, Splunk, CloudWatch, Docker
3mo
Save
Mark Applied
Hide
Data Engineer, PXT Central Science
Seattle or Boston or Bellevue or Arlington or San Francisco
OnsiteFull Time
Amazon
AmazonNASDAQ: AMZN: Global online retail and cloud computing technology provider.
3+ YOE3+ years data engineering; AWS stack; data modeling/ETL; programming in Python/Java/Scala/NodeJS; experience with Redshift/S3/Glue/EMR/Kinesis/Lambda; non-relational data stores.
AWS, Python, SQL, Spark, Hadoop, Hive, Redshift, S3, EMR, Lambda, Kinesis, Airflow
1w
Save
Mark Applied
Hide
Senior Data Engineer
Boston, Massachusetts, United States
$150k-$215k/yr OnsiteFull Time
WHOOP
WHOOP: Wearable technology for personalized health and performance tracking.
5+ YOERequires 5+ years building production data systems, strong Python, SQL, ELT, Snowflake, dbt, distributed processing, initiative leadership, communication, and mentoring experience.
Python, PySpark, SQL, Snowflake, dbt, Spark, Kafka
2w
Save
Mark Applied
Hide
BI Data Engineer II
Boston, Massachusetts, United States
$77k-$136k/yr HybridFull Time
Boston Beer Company
Boston Beer CompanyNYSE: SAM: Produces and markets craft beers, hard seltzers, and ciders.
Hands-on Databricks/Spark data engineering using Python and SQL, Lakehouse/Delta Lake experience, CI/CD exposure, data quality and governance, bachelor’s in CS or related (or equivalent).
Databricks, Spark, Delta Lake, Python, SQL, Databricks Unity Catalog, Delta Live Tables, Databricks SQL, Azure DevOps, Databricks Asset Bundles, Power BI, SSIS, Jira, Confluence, Databricks notebooks, PowerShell
3mo
Save
Mark Applied
Hide
Lead Data Engineer - Data Transformation (Modeling and Architecture)
Richmond or McLean or Cambridge
$179k-$225k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: Provides credit card, banking, and auto loan services.
4+ YOEBachelor's degree, 4+ years application development, 2+ years big data, and 1+ year cloud computing experience; expertise in data architecture, modeling, pipelines, governance, SQL, Python, and distributed systems.
SQL, Spark, Python, AWS, Microsoft Azure, Google Cloud, Scala, Java, MapReduce, Hadoop, Hive, EMR, Kafka, Gurobi, MySQL, Mongo, Cassandra, Redshift, Snowflake, UNIX, Linux, Agile, AI
2w
Save
Mark Applied
Hide
Lead Data Engineer (Python, AWS)
Richmond or McLean or Cambridge
$179k-$225k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: A diversified financial services providing banking and credit products.
4+ YOEBachelor's degree, 4+ years of application development, 2+ years of big data experience, and 1+ year of cloud computing experience; preferred experience with Python, SQL, Scala, Java, AWS, and distributed data tools.
Java, Scala, Python, SQL, AWS, Microsoft Azure, Google Cloud, Redshift, Snowflake, MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, MySQL, Mongo, Cassandra, UNIX, Linux, Agile
3d
Save
Mark Applied
Hide
Sr. Data Engineer - Analytical Development
Boston or Cambridge
$137k-$215k/yr HybridFull Time
Takeda
TakedaTokyo Stock Exchange / New York Stock Exchange: 4502 / TAK: Researches, develops, and manufactures prescription pharmaceutical medicines.
8+ YOEComputer science, software engineering, or related degree; 8+ years combined analytical experience with SQL, AWS, cloud, Python, DevOps, and R Studio; ETL, statistical, and software engineering expertise.
SQL, AWS, Python, R Studio, R, Scala, C, C++, Spark, Databricks, Spotfire, Tableau, Power BI, Minitab, MATLAB, ETL
3mo
Save
Mark Applied
Hide
Lead Data Engineer - Data Transformation (Modeling and Architecture)
Richmond or McLean or Cambridge
$179k-$225k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: Financial services offering credit cards, banking, and loans.
4+ YOEBachelor’s degree; 4+ years in application development; 2+ years in big data; 1+ year cloud experience; 4+ years in data architecture/modeling; 7+ years in app development; 4+ years in distributed data tools; 4+ years in data warehousing; 4+ years UNIX/Linux; 2+ years Agile; experience with AI tooling.
SQL, Spark, Python, AWS, Azure, Google Cloud, NoSQL, MongoDB, Cassandra, Redshift, Snowflake, Hadoop, Hive, EMR, Kafka, Unix/Linux, Shell scripting, Java, Scala
1mo
Save
Mark Applied
Hide
Security Data Engineer
Ashville or Atlanta or Boston or Costa Mesa or Seattle or Washington or United States
$129k-$220k/yr HybridFull Time
Anduril Industries
Anduril Industries: Defense technology building autonomous military hardware and software.
Design and implement log aggregation, ETL, and security data lake pipelines; strong programming (Go, Rust, Java, Scala); infra-as-code (Terraform, AWS CDK, Pulumi); cloud and CI/CD deployment; eligible for U.S. Top Secret clearance.
Lattice OS, Spark, DuckDB, Go, Rust, Java, Scala, Terraform, AWS CDK, Pulumi, CI/CD, AWS, Azure, GCP, Iceberg, Delta Lake, Splunk
1mo
Save
Mark Applied
Hide
Principal Engineer, Data Infrastructure
Boston, Massachusetts, United States
$244k-$366k/yr OnsiteFull Time
Klaviyo
KlaviyoNYSE: KVYO: Software platform for automated e-commerce marketing and customer data.
10+ YOE10+ years building and operating distributed data systems; expertise in ingestion/CDC, stream processing, batch orchestration, lakehouse patterns, governance, SLOs, and applying AI/ML to data platforms.
Kafka, PubSub, Flink, Spark, Beam, Airflow, Dagster, Iceberg, Delta, Hudi, Snowflake, BigQuery, object storage
2mo
Save
Mark Applied
Hide
Analytics Engineer, Data Science
Chicago or Austin or Baltimore or Denver or Boulder or Hartford or New Haven or Philadelphia or Providence or Miami
$118k-$173k/yr HybridFull Time
DoorDash
DoorDashNASDAQ: DASH: On-demand delivery platform connecting consumers with local merchants.
2+ YOE2-6+ years in BI/analytics/data engineering; SQL; Python/Scala; Looker/Tableau/Sigma; database fundamentals; data quality checks; strong communication; fast-paced; self-starter.
SQL, Python, Scala, Looker, Tableau, Sigma, S3, Hive, Spark, Pydeequ, Great Expectations