82 spark data engineer jobs at 40 companies in Gloucester, MA

22h
Save
Mark Applied
Hide
Senior Data Engineer
White Plains or Greensboro or Charleston or Greenville or Maitland or Harrisonburg or Clearwater or Louisville or Birmingham or Huntsville or Alpharetta or Clayton or Honolulu or Lake Oswego or Gainesville or Fayetteville or Naples or Hibbing or Miami or Myrtle Beach or Houston or Denver or Piscataway or Irvine or Key Largo or Columbia or Little Rock or Austin or Pensacola or Lexington or Bloomington or Fort Myers or Panama City or San Antonio or Rochester or Mobile or Salt Lake City or Bend or Charlotte or Glen Allen or Raleigh or Abilene or Tallahassee or San Ramon or Dallas or Pittsburgh or Boston or Missoula or Cincinnati or Boise or Eugene or McMinnville or Knoxville or Dakota Dunes or Kissimmee or Fort Worth or Grand Forks or Canonsburg or Buffalo or Eastland or Philadelphia or Chicago or Phoenix or Dublin or Jacksonville or St. Louis or Los Angeles or Atlanta or Norwalk or Colchester or Grand Rapids or Richmond or Hoboken or Indianapolis or Kansas City or Chagrin Falls or Orland Park or Anchorage or High Point or Bonita Springs or Rancho Cordova or Las Vegas or Irving or Brandenburg or Minneapolis or Fort Lauderdale or Shreveport or Fargo or Sarasota or Kennesaw or Dayton or Sacramento or Princeton or Durham or Conshohocken or Baton Rouge or Asheville or Chattanooga or Memphis or Nashville or United States
$96k-$168k/yr RemoteFull Time
Marsh McLennan
Marsh McLennanNYSE: MRSH: Global professional services firm providing risk, strategy, and people solutions.
10+ YOERequires 10+ years of enterprise data engineering experience and advanced Azure, Databricks, Spark, Python, SQL, ETL, data modeling, streaming, and cloud architecture expertise.
Microsoft Azure, Azure Databricks, Azure Functions, Azure Data Factory, Databricks, Apache Spark, PySpark, Python, SQL, Scala, Unity Catalog, Microsoft SQL Server, Kafka, Event Hub, Azure DevOps, Git, Terraform, ARM templates, Databricks Genie
1w
Save
Mark Applied
Hide
Senior Data Engineer
Boston, Massachusetts, United States
$115k-$175k/yr RemoteFull Time
Veeva Systems
Veeva SystemsNYSE: VEEV: Cloud-based software solutions for the global life sciences industry.
5+ YOE5+ years building data models and pipelines, 2+ years production Airflow, 2+ years Spark at scale, strong Python and SQL, AWS (S3,ECS/Fargate,Glue,IAM,Secrets Manager) experience.
Airflow, MWAA, Spark, AWS Glue, Databricks, Python, SQL, S3, ECS/Fargate, IAM, Secrets Manager, Claude Code, Open Meta
2w
Save
Mark Applied
Hide
Data Engineer Senior Developer, AVP
Quincy or Boston
$90k-$158k/yr OnsiteFull Time
State Street
State StreetNYSE: STT: Provides investment servicing and management to institutional investors.
5+ YOEExperience designing and building cloud data lake solutions using AWS/Databricks, ETL/ELT with Spark/Scala/PySpark, data modeling, and CI/CD; 5+ years software/data engineering experience.
Apache Spark, Scala, Hadoop, Hive, AWS, Databricks, Terraform, CloudFormation, Amazon S3, Glue, Lambda, EMR, Redshift, Athena, Kinesis, PL/SQL, Python, PERL, Delta Lake, Unity Catalog, Databricks Workflows, Git, CI/CD, DevOps
2w
Save
Mark Applied
Hide
Senior Data Engineer
Boston or Chicago or Dallas or Los Angeles or Minneapolis or New York City or San Francisco or Seattle or Washington, D.C.
$120k-$162k/yr HybridFull Time
West Monroe
West Monroe: Business and technology consultancy specializing in digital transformation.
4+ YOE4+ years building enterprise data platforms with Databricks, Snowflake or Microsoft Fabric; Spark/SQL/Python; cloud (AWS/Azure/GCP); Git/CI-CD; experience enabling analytics and AI; travel 30–50%; US work authorization required.
Databricks, Snowflake, Microsoft Fabric, AWS, Azure, GCP, Spark, SQL, Python, Azure Data Factory, Azure Storage, Azure Synapse, Git, CI/CD, ChatGPT
3mo
Save
Mark Applied
Hide
Principal, Data Engineer
Woburn, Massachusetts, United States
HybridFull Time
American Tower
American TowerNYSE: AMT: Leases space on wireless and broadcast towers for communications.
8+ YOE8+ years data engineering; CS/Math degree; expert SQL/Python; cloud platforms; Spark; Kafka; Airflow; governance; leadership.
SQL, Python, Apache Spark, PySpark, AWS, Azure, Google Cloud, Databricks, Snowflake, Kafka, Kinesis, Airflow, dbt, CI/CD, Infrastructure as Code, Data Quality, Data Governance
2mo
Save
Mark Applied
Hide
Staff Data Engineer
Waltham or North Bethesda
$180k-$200k/yr HybridFull Time
Xometry
XometryNASDAQ: XMTR: Operates an AI-powered marketplace for custom manufacturing and prototyping.
5+ YOESenior data engineer owning enterprise-scale data architecture and partner integrations.
Snowflake, SQL, Python, dbt, Airbyte, Airflow, Kafka, Spark, Kinesis, Looker, Streamlit, Terraform, CloudFormation, Apache Iceberg
3mo
Save
Mark Applied
Hide
Data Engineer, PXT Central Science
Seattle or Boston or Bellevue or Arlington or San Francisco
OnsiteFull Time
Amazon
AmazonNASDAQ: AMZN: Global online retail and cloud computing technology provider.
3+ YOE3+ years data engineering; AWS stack; data modeling/ETL; programming in Python/Java/Scala/NodeJS; experience with Redshift/S3/Glue/EMR/Kinesis/Lambda; non-relational data stores.
AWS, Python, SQL, Spark, Hadoop, Hive, Redshift, S3, EMR, Lambda, Kinesis, Airflow
3d
Save
Mark Applied
Hide
Senior Data Engineer
Boston, Massachusetts, United States
$150k-$215k/yr OnsiteFull Time
WHOOP
WHOOP: Wearable technology for personalized health and performance tracking.
5+ YOERequires 5+ years building production data systems, strong Python, SQL, ELT, Snowflake, dbt, distributed processing, initiative leadership, communication, and mentoring experience.
Python, PySpark, SQL, Snowflake, dbt, Spark, Kafka
2w
Save
Mark Applied
Hide
BI Data Engineer II
Boston, Massachusetts, United States
$77k-$136k/yr HybridFull Time
Boston Beer Company
Boston Beer CompanyNYSE: SAM: Produces and markets craft beers, hard seltzers, and ciders.
Hands-on Databricks/Spark data engineering using Python and SQL, Lakehouse/Delta Lake experience, CI/CD exposure, data quality and governance, bachelor’s in CS or related (or equivalent).
Databricks, Spark, Delta Lake, Python, SQL, Databricks Unity Catalog, Delta Live Tables, Databricks SQL, Azure DevOps, Databricks Asset Bundles, Power BI, SSIS, Jira, Confluence, Databricks notebooks, PowerShell
2mo
Save
Mark Applied
Hide
Junior Data Engineer
London or Boston or Victoria
$70k-$85k/yr HybridFull Time
Opensignal
Opensignal: Provides independent data on global mobile and broadband experiences.
1+ YOE1+ years in building big data pipelines; Spark/Scala/SQL experience; AWS; Bachelor’s degree.
Apache Spark, Scala, SQL, Amazon Redshift, Amazon Athena, Amazon S3, Apache Airflow, Amazon EMR, AWS
2mo
Save
Mark Applied
Hide
Lead Data Engineer - Data Transformation (Modeling and Architecture)
Richmond or McLean or Cambridge
$179k-$225k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: Financial services offering credit cards, banking, and loans.
4+ YOEBachelor’s degree; 4+ years in application development; 2+ years in big data; 1+ year cloud experience; 4+ years in data architecture/modeling; 7+ years in app development; 4+ years in distributed data tools; 4+ years in data warehousing; 4+ years UNIX/Linux; 2+ years Agile; experience with AI tooling.
SQL, Spark, Python, AWS, Azure, Google Cloud, NoSQL, MongoDB, Cassandra, Redshift, Snowflake, Hadoop, Hive, EMR, Kafka, Unix/Linux, Shell scripting, Java, Scala
1mo
Save
Mark Applied
Hide
Security Data Engineer
Ashville or Atlanta or Boston or Costa Mesa or Seattle or Washington or United States
$129k-$220k/yr HybridFull Time
Anduril Industries
Anduril Industries: Defense technology building autonomous military hardware and software.
Design and implement log aggregation, ETL, and security data lake pipelines; strong programming (Go, Rust, Java, Scala); infra-as-code (Terraform, AWS CDK, Pulumi); cloud and CI/CD deployment; eligible for U.S. Top Secret clearance.
Lattice OS, Spark, DuckDB, Go, Rust, Java, Scala, Terraform, AWS CDK, Pulumi, CI/CD, AWS, Azure, GCP, Iceberg, Delta Lake, Splunk
1mo
Save
Mark Applied
Hide
Principal Engineer, Data Infrastructure
Boston, Massachusetts, United States
$244k-$366k/yr OnsiteFull Time
Klaviyo
KlaviyoNYSE: KVYO: Software platform for automated e-commerce marketing and customer data.
10+ YOE10+ years building and operating distributed data systems; expertise in ingestion/CDC, stream processing, batch orchestration, lakehouse patterns, governance, SLOs, and applying AI/ML to data platforms.
Kafka, PubSub, Flink, Spark, Beam, Airflow, Dagster, Iceberg, Delta, Hudi, Snowflake, BigQuery, object storage
2w
Save
Mark Applied
Hide
Senior Data Engineer
Indianapolis or Woodland Hills or Ashburn or Costa Mesa or Miami or Richmond or Chicago or New York City or Seattle or Grand Prairie or Chicago or Atlanta or Iselin or Overland Park or Tampa or Woburn
$127k-$229k/yr HybridFull Time
Elevance Health
Elevance HealthNYSE: ELV: Provides health insurance plans and integrated healthcare services.
8+ YOEBS/BA and 8+ years technical experience in systems administration/security, data platform architecture, Microsoft Fabric/Azure, data pipelines, SQL/Python, and regulatory compliance (HIPAA,NIST,SOC2).
Microsoft Fabric, Apache Spark, SQL, Python, PySpark, Spark, Delta Lake, Parquet, REST APIs, JSON, Git, Azure DevOps, CI/CD
3w
Save
Mark Applied
Hide
Data Product Lead
Boston or Cambridge
$177k-$278k/yr OnsiteFull Time
Takeda
TakedaTokyo Stock Exchange / New York Stock Exchange: 4502 / TAK: Researches, develops, and manufactures prescription pharmaceutical medicines.
10+ YOE4+ Mgmt10+ years data engineering/platform experience with 4+ years managing technical teams; Bachelor’s in CS or related; hands-on Databricks/AWS/Spark; commercial pharma data and data governance experience; HIPAA compliance.
Databricks, AWS, Spark, Salesforce, IQVIA, Komodo, EMR/EHR
1mo
Save
Mark Applied
Hide
Senior Manager, Data Engineering
San Francisco or Ottawa or Phoenix or Toronto or Los Angeles or Denver or Salt Lake City or Atlanta or Chicago or Houston or Portland or New York City or Vancouver or San Diego or Washington, D.C. or Sacramento or Jacksonville or Seattle or Mexico City or Austin or Miami or Boston or Dallas
$155k-$265k/yr HybridFull Time
Scribd
Scribd: Subscription-based digital library for e-books, audiobooks, and documents.
10+ YOE3+ Mgmt10+ years in data engineering, 3+ years managing engineering teams; advanced SQL and experience with Python/Scala, Spark, Databricks/Delta Lake/Snowflake/BigQuery; strong data architecture, dimensional modeling, and cross-functional leadership.
SQL, Python, Scala, Spark, Databricks, Delta Lake, Snowflake, BigQuery
2w
Save
Mark Applied
Hide
Kearney Activate- Senior Data Scientist & Product Engineer
Washington or Arlington or Boston
$100k-$150k/yr OnsiteFull Time
Kearney
Kearney: Global management consulting firm providing strategic and operational advice.
Senior generalist with end-to-end data science experience: framing, EDA, modeling, deployment, monitoring; Bachelor\u0002s degree in a relevant field; U.S. work authorization and ability to obtain Secret clearance.
Python, SQL, Power BI, Tableau, Git, Docker, Spark, JavaScript, React, CI/CD, LLMs, RAG
2w
Save
Mark Applied
Hide
Kearney Activate- Senior Data Scientist & Product Engineer
Washington or Arlington or Boston
$100k-$150k/yr OnsiteFull Time
Kearney
Kearney: Global management consulting firm providing strategic and operational advice.
Experienced data science generalist able to deliver end-to-end solutions: framing, EDA, modeling (ML and LLM), deployment, monitoring, and client-facing leadership. Must be U.S.-authorized and able to obtain Secret clearance; bachelor’s degree or equivalent.
Python, SQL, LLMs, RAG, Prompt engineering, GenAI, Power BI, Tableau, Git, CI/CD, Spark, Docker, JavaScript, React
1mo
Save
Mark Applied
Hide
Senior Software Engineer - Data Acquisition Team
Waltham, Massachusetts, United States
$140k-$220k/yr HybridFull Time
ZoomInfo
ZoomInfoNASDAQ: GTM: Provides B2B contact data and sales intelligence software.
5+ YOE5+ years software engineering experience with backend data pipeline design, Java proficiency, expertise with data processing/orchestration and cloud (preferably GCP); bachelor's degree required.
Java, Apache Airflow, Apache Beam, Spark, Google Dataflow, DataProc, Kafka, Pub/Sub, BigQuery, Snowflake, Trino, GCS, GKE, Kubernetes, Terraform
22h
Save
Mark Applied
Hide
Sr. Lead Software Engineer - Data Engineer
Jersey City or Boston
$171k-$260k/yr OnsiteFull Time
JPMorgan Chase
JPMorgan ChaseNYSE: JPM: Global financial services firm providing banking and investment solutions.
5+ YOERequires 5+ years of software engineering experience, advanced Python, Spark, Java, and SQL, system design, data modeling, AI/ML, agentic AI frameworks, cloud, Agile, CI/CD, and a related technical field.
Python, Java, Spark, SQL, Agentic AI, ADK, LangChain, LangGraph, AutoGen, CrewAI, CI/CD, Databricks, CockroachDB, Apache Iceberg, Trino, Spring Boot, Kafka, RESTful APIs, AWS