82 spark data engineer jobs at 40 companies in Gloucester, MA
22h
Save
Mark Applied
Hide
22h
Senior Data Engineer
White Plains or Greensboro or Charleston or Greenville or Maitland or Harrisonburg or Clearwater or Louisville or Birmingham or Huntsville or Alpharetta or Clayton or Honolulu or Lake Oswego or Gainesville or Fayetteville or Naples or Hibbing or Miami or Myrtle Beach or Houston or Denver or Piscataway or Irvine or Key Largo or Columbia or Little Rock or Austin or Pensacola or Lexington or Bloomington or Fort Myers or Panama City or San Antonio or Rochester or Mobile or Salt Lake City or Bend or Charlotte or Glen Allen or Raleigh or Abilene or Tallahassee or San Ramon or Dallas or Pittsburgh or Boston or Missoula or Cincinnati or Boise or Eugene or McMinnville or Knoxville or Dakota Dunes or Kissimmee or Fort Worth or Grand Forks or Canonsburg or Buffalo or Eastland or Philadelphia or Chicago or Phoenix or Dublin or Jacksonville or St. Louis or Los Angeles or Atlanta or Norwalk or Colchester or Grand Rapids or Richmond or Hoboken or Indianapolis or Kansas City or Chagrin Falls or Orland Park or Anchorage or High Point or Bonita Springs or Rancho Cordova or Las Vegas or Irving or Brandenburg or Minneapolis or Fort Lauderdale or Shreveport or Fargo or Sarasota or Kennesaw or Dayton or Sacramento or Princeton or Durham or Conshohocken or Baton Rouge or Asheville or Chattanooga or Memphis or Nashville or United States
$96k-$168k/yrRemoteFull Time
Marsh McLennanNYSE: MRSH: Global professional services firm providing risk, strategy, and people solutions.
10+ YOERequires 10+ years of enterprise data engineering experience and advanced Azure, Databricks, Spark, Python, SQL, ETL, data modeling, streaming, and cloud architecture expertise.
Microsoft Azure, Azure Databricks, Azure Functions, Azure Data Factory, Databricks, Apache Spark, PySpark, Python, SQL, Scala, Unity Catalog, Microsoft SQL Server, Kafka, Event Hub, Azure DevOps, Git, Terraform, ARM templates, Databricks Genie
Veeva SystemsNYSE: VEEV: Cloud-based software solutions for the global life sciences industry.
5+ YOE5+ years building data models and pipelines, 2+ years production Airflow, 2+ years Spark at scale, strong Python and SQL, AWS (S3,ECS/Fargate,Glue,IAM,Secrets Manager) experience.
Airflow, MWAA, Spark, AWS Glue, Databricks, Python, SQL, S3, ECS/Fargate, IAM, Secrets Manager, Claude Code, Open Meta
State StreetNYSE: STT: Provides investment servicing and management to institutional investors.
5+ YOEExperience designing and building cloud data lake solutions using AWS/Databricks, ETL/ELT with Spark/Scala/PySpark, data modeling, and CI/CD; 5+ years software/data engineering experience.
Boston or Chicago or Dallas or Los Angeles or Minneapolis or New York City or San Francisco or Seattle or Washington, D.C.
$120k-$162k/yrHybridFull Time
West Monroe: Business and technology consultancy specializing in digital transformation.
4+ YOE4+ years building enterprise data platforms with Databricks, Snowflake or Microsoft Fabric; Spark/SQL/Python; cloud (AWS/Azure/GCP); Git/CI-CD; experience enabling analytics and AI; travel 30–50%; US work authorization required.
Databricks, Snowflake, Microsoft Fabric, AWS, Azure, GCP, Spark, SQL, Python, Azure Data Factory, Azure Storage, Azure Synapse, Git, CI/CD, ChatGPT
Seattle or Boston or Bellevue or Arlington or San Francisco
OnsiteFull Time
AmazonNASDAQ: AMZN: Global online retail and cloud computing technology provider.
3+ YOE3+ years data engineering; AWS stack; data modeling/ETL; programming in Python/Java/Scala/NodeJS; experience with Redshift/S3/Glue/EMR/Kinesis/Lambda; non-relational data stores.
WHOOP: Wearable technology for personalized health and performance tracking.
5+ YOERequires 5+ years building production data systems, strong Python, SQL, ELT, Snowflake, dbt, distributed processing, initiative leadership, communication, and mentoring experience.
Boston Beer CompanyNYSE: SAM: Produces and markets craft beers, hard seltzers, and ciders.
Hands-on Databricks/Spark data engineering using Python and SQL, Lakehouse/Delta Lake experience, CI/CD exposure, data quality and governance, bachelor’s in CS or related (or equivalent).
Databricks, Spark, Delta Lake, Python, SQL, Databricks Unity Catalog, Delta Live Tables, Databricks SQL, Azure DevOps, Databricks Asset Bundles, Power BI, SSIS, Jira, Confluence, Databricks notebooks, PowerShell
Lead Data Engineer - Data Transformation (Modeling and Architecture)
Richmond or McLean or Cambridge
$179k-$225k/yrOnsiteFull Time
Capital OneNYSE: COF: Financial services offering credit cards, banking, and loans.
4+ YOEBachelor’s degree; 4+ years in application development; 2+ years in big data; 1+ year cloud experience; 4+ years in data architecture/modeling; 7+ years in app development; 4+ years in distributed data tools; 4+ years in data warehousing; 4+ years UNIX/Linux; 2+ years Agile; experience with AI tooling.
Ashville or Atlanta or Boston or Costa Mesa or Seattle or Washington or United States
$129k-$220k/yrHybridFull Time
Anduril Industries: Defense technology building autonomous military hardware and software.
Design and implement log aggregation, ETL, and security data lake pipelines; strong programming (Go, Rust, Java, Scala); infra-as-code (Terraform, AWS CDK, Pulumi); cloud and CI/CD deployment; eligible for U.S. Top Secret clearance.
KlaviyoNYSE: KVYO: Software platform for automated e-commerce marketing and customer data.
10+ YOE10+ years building and operating distributed data systems; expertise in ingestion/CDC, stream processing, batch orchestration, lakehouse patterns, governance, SLOs, and applying AI/ML to data platforms.
Indianapolis or Woodland Hills or Ashburn or Costa Mesa or Miami or Richmond or Chicago or New York City or Seattle or Grand Prairie or Chicago or Atlanta or Iselin or Overland Park or Tampa or Woburn
$127k-$229k/yrHybridFull Time
Elevance HealthNYSE: ELV: Provides health insurance plans and integrated healthcare services.
8+ YOEBS/BA and 8+ years technical experience in systems administration/security, data platform architecture, Microsoft Fabric/Azure, data pipelines, SQL/Python, and regulatory compliance (HIPAA,NIST,SOC2).
Microsoft Fabric, Apache Spark, SQL, Python, PySpark, Spark, Delta Lake, Parquet, REST APIs, JSON, Git, Azure DevOps, CI/CD
TakedaTokyo Stock Exchange / New York Stock Exchange: 4502 / TAK: Researches, develops, and manufactures prescription pharmaceutical medicines.
10+ YOE4+ Mgmt10+ years data engineering/platform experience with 4+ years managing technical teams; Bachelor’s in CS or related; hands-on Databricks/AWS/Spark; commercial pharma data and data governance experience; HIPAA compliance.
San Francisco or Ottawa or Phoenix or Toronto or Los Angeles or Denver or Salt Lake City or Atlanta or Chicago or Houston or Portland or New York City or Vancouver or San Diego or Washington, D.C. or Sacramento or Jacksonville or Seattle or Mexico City or Austin or Miami or Boston or Dallas
$155k-$265k/yrHybridFull Time
Scribd: Subscription-based digital library for e-books, audiobooks, and documents.
10+ YOE3+ Mgmt10+ years in data engineering, 3+ years managing engineering teams; advanced SQL and experience with Python/Scala, Spark, Databricks/Delta Lake/Snowflake/BigQuery; strong data architecture, dimensional modeling, and cross-functional leadership.
SQL, Python, Scala, Spark, Databricks, Delta Lake, Snowflake, BigQuery
Kearney Activate- Senior Data Scientist & Product Engineer
Washington or Arlington or Boston
$100k-$150k/yrOnsiteFull Time
Kearney: Global management consulting firm providing strategic and operational advice.
Senior generalist with end-to-end data science experience: framing, EDA, modeling, deployment, monitoring; Bachelor\u0002s degree in a relevant field; U.S. work authorization and ability to obtain Secret clearance.
Kearney Activate- Senior Data Scientist & Product Engineer
Washington or Arlington or Boston
$100k-$150k/yrOnsiteFull Time
Kearney: Global management consulting firm providing strategic and operational advice.
Experienced data science generalist able to deliver end-to-end solutions: framing, EDA, modeling (ML and LLM), deployment, monitoring, and client-facing leadership. Must be U.S.-authorized and able to obtain Secret clearance; bachelor’s degree or equivalent.
ZoomInfoNASDAQ: GTM: Provides B2B contact data and sales intelligence software.
5+ YOE5+ years software engineering experience with backend data pipeline design, Java proficiency, expertise with data processing/orchestration and cloud (preferably GCP); bachelor's degree required.
JPMorgan ChaseNYSE: JPM: Global financial services firm providing banking and investment solutions.
5+ YOERequires 5+ years of software engineering experience, advanced Python, Spark, Java, and SQL, system design, data modeling, AI/ML, agentic AI frameworks, cloud, Agile, CI/CD, and a related technical field.