146 spark engineer jobs at 75 companies in Massachusetts

1w
Save
Mark Applied
Hide
Senior Data Engineer | Emerging Products
California or Colorado or Connecticut or Florida or Georgia or Illinois or Kansas or Massachusetts or Maryland or Maine or New Jersey or North Carolina or New York or Oregon or Tennessee or Texas or Virginia or Washington
$110k-$200k/yr HybridFull Time
NinjaOne
NinjaOne: Unified IT platform for automated endpoint management and security.
10+ YOE10+ years data engineering experience building lakehouse architectures and distributed systems; Bachelor's in CS or equivalent preferred; strong Python and SQL; expertise with Kafka, Spark, Airflow, Databricks, and open table formats.
Kafka, Spark, Airflow, Iceberg, Databricks, Delta, Hudi, Trino, Starburst, Python, SQL
2w
Save
Mark Applied
Hide
Data Platform Engineer, VP II - State Street Investment Management
Boston, Massachusetts, United States
$120k-$203k/yr OnsiteFull Time
State Street
State StreetNYSE: STT: Provides investment servicing and management to institutional investors.
15+ YOELead architecture and engineering of cloud-native data platforms; deep expertise in distributed data processing, Spark, Lakehouse platforms, governance, and devops practices.
Python, SQL, Java, Scala, GitHub Copilot, Codex, Anthropic, Spark, Snowflake, Databricks, AWS, Azure, Apache Iceberg, Unity Catalog, GCP, Collibra, Alation, Claude Code Assistant, Terraform, CloudFormation
2mo
Save
Mark Applied
Hide
Data Platform Engineer
Ohio or New York or New Jersey or Missouri or Minnesota or Michigan or Massachusetts or Indiana or Illinois or Georgia or Florida or Colorado or California or Arizona or Pennsylvania or Wisconsin or Texas or United States
$120k-$160k/yr RemoteFull Time
SullivanCotter
SullivanCotter: Consulting and data for healthcare and nonprofit compensation strategies.
5+ YOE5+ years experience; degree in CS/Software Engineering/Information Systems/IT or equivalent; proficiency in Python/Scala/Java/SQL, Apache Spark, Databricks, ELT/ETL, streaming, RESTful/gRPC, SDLC, testing and CI/CD tooling; strong design and mentoring skills.
Python, Scala, Java, SQL, Apache Spark, Databricks, Pytest, GitHub Actions, Poetry, Git, RESTful, gRPC
2w
Save
Mark Applied
Hide
Software Engineer III - PA085
Waltham, Massachusetts, United States
$112k-$176k/yr HybridFull Time
ZoomInfo
ZoomInfoNASDAQ: GTM: Provides B2B contact data and sales intelligence software.
3+ YOE3+ years software engineering experience building production data pipelines and backend services. Strong Java, ETL/ELT, streaming, cloud (GCP) and data quality skills required.
Java, Apache Beam, Apache Airflow, Spark, Google Dataflow, DataProc, Kafka, Google Pub/Sub, BigQuery, GCS, GKE, SQL, Kubernetes, EKS, Snowflake, Starburst, Trino, Terraform
1w
Save
Mark Applied
Hide
Senior Quantitative Developer
Boston, Massachusetts, United States
$150k-$170k/yr HybridFull Time
Man Group
Man GroupLondon Stock Exchange: EMG: Global alternative investment management and systematic trading services.
5+ YOE5+ years software engineering experience for quantitative applications; expert Python and Pandas; Linux and Git proficiency; experience with large datasets, production systems, and relevant databases.
Linux, Python, NumPy, SciPy, Pandas, statsmodels, scikit-learn, Java, MongoDB, MS SQL, Postgres, Control-M, Airflow, Kafka, Bitbucket, Jenkins, Grafana, Prometheus, ELK, Docker, OpenStack, Ansible, Slack, React, Spark, Dask, Kubernetes, Redis, ArcticDB, Git
1mo
Save
Mark Applied
Hide
Forward Data Engineer
McLean or California or Colorado or Hawaii or Illinois or Maine or Maryland or Massachusetts or Minnesota or New Jersey or New York or Vermont or Virginia or Washington or District of Columbia or Cleveland
$130k-$265k/yr OnsiteFull Time
Accenture Federal Services
Accenture Federal ServicesNYSE: ACN: Provides technology and consulting services to U.S. federal agencies.
4+ YOE4+ years data lifecycle and ETL engineering experience; cloud and on-prem storage; Python, SQL, Spark; experience with ElasticSearch, NiFi, Palantir Foundry; Agile/Scrum experience; active TS/SCI with poly required.
Spark, Apache Iceberg, EMR, Kubernetes, Python, SQL, ElasticSearch, NiFi, Palantir Foundry, Agile, Scrum
1mo
Save
Mark Applied
Hide
Principal Engineer
United States or Colorado or Hawaii or Illinois or Maryland or Massachusetts or Minnesota or New Jersey or New York or Vermont or District of Columbia or Washington or California
$188k-$277k/yr RemoteFull Time
Twilio
TwilioNYSE: TWLO: Cloud communications platform for programmable messaging, voice, and email.
16+ YOE16+ years building high-scale, secure cloud-native distributed systems; expert in Java or Go and AWS; experience with LLM-driven development, APIs, high-throughput data, Kubernetes/Terraform, and cross-team technical leadership.
Java, Go, AWS, Lambda, EKS, DynamoDB, Kafka, LLMs, GitHub Copilot, Anthropic Claude, SQL, NoSQL, Redis, Spark, Kubernetes, Terraform
1w
Save
Mark Applied
Hide
Databricks Data Engineer
United States or Arlington or Tysons or Washington or New York City or Chicago or Austin or Atlanta or Boston or Boulder
$113k-$188k/yr RemoteFull Time
Guidehouse
Guidehouse: Provides management and technology consulting services to diverse organizations.
3+ YOEBachelor's degree,3+ years data engineering experience,proficiency with Python/PySpark/SQL,Databricks/Spark/Delta Lake experience,knowledge of data pipelines,governance,and cloud platforms.
Databricks, PySpark, Python, SQL, Delta Lake, Unity Catalog, Spark, CI/CD, Terraform, Azure, AWS, GCP
1mo
Save
Mark Applied
Hide
Lead Data Engineer
Las Vegas or New Jersey or Michigan or Texas or Florida or Massachusetts or Maryland or Mississippi or Ohio
$122k-$162k/yr OnsiteFull Time
MGM Resorts International
MGM Resorts InternationalNYSE: MGM: Operates destination resorts, luxury hotels, casinos, and global entertainment venues.
8+ YOE8+ years delivering enterprise data integration, lakehouse and platform solutions using Databricks, Spark, Delta Lake and Azure; experienced with ELT/ETL, CI/CD, IaC, MLOps/DataOps, data governance, and mentoring engineers.
Databricks, Spark, Delta Lake, Azure, ELT/ETL, CI/CD, Infrastructure as Code (IaC), MLOps, DataOps, Generative AI, Retrieval-Augmented Generation (RAG)
3d
Save
Mark Applied
Hide
Sr. Solutions Engineer - Digital Native Business, Named Accounts
Florida or Massachusetts or New York or North Carolina or Pennsylvania or Virginia
$152k-$209k/yr RemoteFull Time
Databricks
Databricks: A unified platform for data analytics and artificial intelligence.
3+ YOE3+ years in data engineering/architecture or pre-sales, experience with distributed data systems, Python and SQL proficiency, public cloud experience (AWS/Azure/GCP), travel to customer sites, and domain expertise in data engineering or ML technologies.
Python, SQL, Spark, Hadoop, Kafka, pandas, scikit-learn, PyTorch, TensorFlow, AWS, Azure, GCP, MLflow, Delta Lake
1w
Save
Mark Applied
Hide
BI Data Engineer II
Boston, Massachusetts, United States
$77k-$136k/yr HybridFull Time
Boston Beer Company
Boston Beer CompanyNYSE: SAM: Produces and markets craft beers, hard seltzers, and ciders.
Hands-on Databricks/Spark data engineering using Python and SQL, Lakehouse/Delta Lake experience, CI/CD exposure, data quality and governance, bachelor’s in CS or related (or equivalent).
Databricks, Spark, Delta Lake, Python, SQL, Databricks Unity Catalog, Delta Live Tables, Databricks SQL, Azure DevOps, Databricks Asset Bundles, Power BI, SSIS, Jira, Confluence, Databricks notebooks, PowerShell
2w
Save
Mark Applied
Hide
Senior Lead Software Engineer - Data Platform
Boston, Massachusetts, United States
$216k-$324k/yr OnsiteFull Time
Klaviyo
KlaviyoNYSE: KVYO: Software platform for automated e-commerce marketing and customer data.
12+ YOE12+ years software engineering experience with distributed systems and data platform architecture; expertise in lakehouse, ingestion, orchestration, observability, and operational automation; strong technical leadership and cross-team coordination skills.
Iceberg, S3, Spark, EMR, Airflow, Python, Materialized Views, AWS, KDB
2mo
Save
Mark Applied
Hide
Principal Engineer
United States or Colorado or Hawaii or Illinois or Maryland or Massachusetts or Minnesota or Vermont or District of Columbia or New York or New Jersey or Washington or California
$188k-$277k/yr RemoteFull Time
Twilio
TwilioNYSE: TWLO: Cloud communications platform for building customer engagement applications.
16+ YOE16+ years building high-scale, secure cloud-native distributed systems; expert in Java or Go, AWS (Lambda, EKS, DynamoDB, Kafka); experience with LLMs/AI-driven workflows, APIs, data platforms, Kubernetes, Terraform, and CI/CD.
Java, Go, AWS, Lambda, EKS, DynamoDB, Kafka, GitHub Copilot, Anthropic Claude, LLMs, SQL, NoSQL, Redis, Spark, Kubernetes, Terraform, CI/CD
1mo
Save
Mark Applied
Hide
Cost Engineer
Massachusetts, United States
$95k-$121k/yr HybridFull Time
Zelis
Zelis: Providing healthcare payment and claims cost management solutions.
2+ YOEExperience with C#, Rust, SQL, JSON, EDI, healthcare pricing, and software delivery; typically bachelor's +2 years or master's with no experience; familiarity with cloud, big data, and AI-assisted development.
C#, Rust, SQL, JSON, EDI, Python, Java, Hadoop, Spark, Kafka, AWS, Azure, GCP
1mo
Save
Mark Applied
Hide
Director, Software Engineer Finance Tech - (Remote Eligible)
McLean or Cambridge or Richmond or United States
$245k-$307k/yr RemoteFull Time
Capital One
Capital OneNYSE: COF: Financial services offering credit cards, banking, and loans.
7+ YOE5+ MgmtBachelor's degree, 7+ years software engineering experience, 5+ years people management, proficiency with Python/SQL/Big Data tools, cloud-native and data engineering experience.
Python, SQL, Spark, Scala, Snowflake, Databricks, AWS, Apache Airflow, MLOps, CI/CD
1mo
Save
Mark Applied
Hide
Senior Software Engineer, Investment Systems
Boston, Massachusetts, United States
$115k-$325k/yr OnsiteFull Time
Arrowstreet Capital
Arrowstreet Capital: Manages global equity portfolios using systematic quantitative models.
7+ YOE7+ years software engineering experience; 5+ years cloud (AWS preferred); strong SQL, Iceberg, Spark, Pandas/Polars; experience building mission-critical production systems; strong debugging, testing, and communication skills.
AWS, GCP, Azure, SQL, Iceberg, Spark, Pandas, Polars
3d
Save
Mark Applied
Hide
Agentic Data Engineer - Health - Manager - Consulting - Boston
Boston, Massachusetts, United States
$126k-$230k/yr HybridFull Time
EY
EY: Global firm providing audit, tax, and professional consulting services.
6+ YOE2+ Mgmt6+ years data engineering experience with healthcare interoperability, cloud-native data platforms, SQL/Python/Spark proficiency, and 2+ years leading technical teams; bachelor's degree required.
FHIR, HL7 v2, CDA/CCDA, DICOM, X12 EDI, EHR, EMR, SNOMED CT, LOINC, RxNorm, OMOP, PCORnet, Sentinel, Databricks, Snowflake, Microsoft Fabric, AWS, Azure, Google Cloud, SQL, Python, Spark, Epic, Oracle Health, Cerner, Meditech, Athenahealth, Health Catalyst, Arcadia, AWS HealthLake, AWS HealthOmics, Azure Health Data Services, Google Cloud Healthcare API
1mo
Save
Mark Applied
Hide
Security Data Engineer
Ashville or Atlanta or Boston or Costa Mesa or Seattle or Washington or United States
$129k-$220k/yr HybridFull Time
Anduril Industries
Anduril Industries: Defense technology building autonomous military hardware and software.
Design and implement log aggregation, ETL, and security data lake pipelines; strong programming (Go, Rust, Java, Scala); infra-as-code (Terraform, AWS CDK, Pulumi); cloud and CI/CD deployment; eligible for U.S. Top Secret clearance.
Lattice OS, Spark, DuckDB, Go, Rust, Java, Scala, Terraform, AWS CDK, Pulumi, CI/CD, AWS, Azure, GCP, Iceberg, Delta Lake, Splunk
6d
Save
Mark Applied
Hide
Senior Data Engineer
Boston, Massachusetts, United States
$115k-$175k/yr RemoteFull Time
Veeva Systems
Veeva SystemsNYSE: VEEV: Cloud-based software solutions for the global life sciences industry.
5+ YOE5+ years building data models and pipelines, 2+ years production Airflow, 2+ years Spark at scale, strong Python and SQL, AWS (S3,ECS/Fargate,Glue,IAM,Secrets Manager) experience.
Airflow, MWAA, Spark, AWS Glue, Databricks, Python, SQL, S3, ECS/Fargate, IAM, Secrets Manager, Claude Code, Open Meta
2mo
Save
Mark Applied
Hide
Principal, Data Engineer
Woburn, Massachusetts, United States
HybridFull Time
American Tower
American TowerNYSE: AMT: Leases space on wireless and broadcast towers for communications.
8+ YOE8+ years data engineering; CS/Math degree; expert SQL/Python; cloud platforms; Spark; Kafka; Airflow; governance; leadership.
SQL, Python, Apache Spark, PySpark, AWS, Azure, Google Cloud, Databricks, Snowflake, Kafka, Kinesis, Airflow, dbt, CI/CD, Infrastructure as Code, Data Quality, Data Governance