169 spark engineer jobs at 63 companies in Weymouth, MA
1mo
Save
Mark Applied
Hide
Data Platform Engineer, VP II - State Street Investment Management
Boston, Massachusetts, United States
$120k-$203k/yr OnsiteFull Time
15+ YOELead architecture and engineering of cloud-native data platforms; deep expertise in distributed data processing, Spark, Lakehouse platforms, governance, and devops practices.
Python, SQL, Java, Scala, GitHub Copilot, Codex, Anthropic, Spark, Snowflake, Databricks, AWS, Azure, Apache Iceberg, Unity Catalog, GCP, Collibra, Alation, Claude Code Assistant, Terraform, CloudFormation
1mo
Save
Mark Applied
Hide
Software Engineer III - PA085
Waltham, Massachusetts, United States
$112k-$176k/yr HybridFull Time
3+ YOE3+ years software engineering experience building production data pipelines and backend services. Strong Java, ETL/ELT, streaming, cloud (GCP) and data quality skills required.
Java, Apache Beam, Apache Airflow, Spark, Google Dataflow, DataProc, Kafka, Google Pub/Sub, BigQuery, GCS, GKE, SQL, Kubernetes, EKS, Snowflake, Starburst, Trino, Terraform
2d
Save
Mark Applied
Hide
Senior Data Engineer
Woburn, Massachusetts, United States
$130k-$164k/yr HybridFull Time
4+ YOEBachelor’s degree required; 4–7 years of data engineering or platform experience; SQL, Python, Spark/PySpark, cloud and data platform expertise; production pipeline, streaming, orchestration, and communication skills.
Structured Query Language, Python, Spark, PySpark, Azure, Databricks, Snowflake, Kafka, Airflow, Azure Data Factory
4w
Save
Mark Applied
Hide
Senior Quantitative Developer
Boston, Massachusetts, United States
$150k-$170k/yr HybridFull Time
5+ YOE5+ years software engineering experience for quantitative applications; expert Python and Pandas; Linux and Git proficiency; experience with large datasets, production systems, and relevant databases.
Linux, Python, NumPy, SciPy, Pandas, statsmodels, scikit-learn, Java, MongoDB, MS SQL, Postgres, Control-M, Airflow, Kafka, Bitbucket, Jenkins, Grafana, Prometheus, ELK, Docker, OpenStack, Ansible, Slack, React, Spark, Dask, Kubernetes, Redis, ArcticDB, Git
3w
Save
Mark Applied
Hide
Databricks Data Engineer
United States or Arlington or Tysons or Washington or New York City or Chicago or Austin or Atlanta or Boston or Boulder
$113k-$188k/yr RemoteFull Time
3+ YOEBachelor's degree,3+ years data engineering experience,proficiency with Python/PySpark/SQL,Databricks/Spark/Delta Lake experience,knowledge of data pipelines,governance,and cloud platforms.
Databricks, PySpark, Python, SQL, Delta Lake, Unity Catalog, Spark, CI/CD, Terraform, Azure, AWS, GCP
4d
Save
Mark Applied
Hide
Lead Data Engineer - NBA
Nashville or Boston
$142k-$196k/yr RemoteFull Time
7+ YOE2+ MgmtBachelor's degree, 7+ years of data engineering experience, 1–2 years of technical leadership, expert SQL and Python, Databricks, Delta Lake, Spark, batch and streaming pipelines, and regulated-data platform experience.
Databricks, Delta Lake, SQL, Python, Spark, Kafka, Spark Structured Streaming, Unity Catalog, Databricks Feature Store, Delta Live Tables, Databricks Workflows, Azure Data Factory, Azure Event Hubs, Azure Data Lake Storage, Great Expectations, Monte Carlo, Claude, GitHub Copilot, Drools, DRL, DMN, IBM ODM, OPA, Rego, HireVue, Microsoft Workday
3w
Save
Mark Applied
Hide
BI Data Engineer II
Boston, Massachusetts, United States
$77k-$136k/yr HybridFull Time
Hands-on Databricks/Spark data engineering using Python and SQL, Lakehouse/Delta Lake experience, CI/CD exposure, data quality and governance, bachelor’s in CS or related (or equivalent).
Databricks, Spark, Delta Lake, Python, SQL, Databricks Unity Catalog, Delta Live Tables, Databricks SQL, Azure DevOps, Databricks Asset Bundles, Power BI, SSIS, Jira, Confluence, Databricks notebooks, PowerShell
1mo
Save
Mark Applied
Hide
Senior Lead Software Engineer - Data Platform
Boston, Massachusetts, United States
$216k-$324k/yr OnsiteFull Time
12+ YOE12+ years software engineering experience with distributed systems and data platform architecture; expertise in lakehouse, ingestion, orchestration, observability, and operational automation; strong technical leadership and cross-team coordination skills.
Iceberg, S3, Spark, EMR, Airflow, Python, Materialized Views, AWS, KDB
2mo
Save
Mark Applied
Hide
Senior Software Engineer, Investment Systems
Boston, Massachusetts, United States
$115k-$325k/yr OnsiteFull Time
7+ YOE7+ years software engineering experience; 5+ years cloud (AWS preferred); strong SQL, Iceberg, Spark, Pandas/Polars; experience building mission-critical production systems; strong debugging, testing, and communication skills.
AWS, GCP, Azure, SQL, Iceberg, Spark, Pandas, Polars
3mo
Save
Mark Applied
Hide
Senior Distinguished Engineer, AI Compute (Remote Eligible)
San Francisco or Cambridge or Richmond or McLean or New York or San Jose or San Francisco
$286k-$392k/yr RemoteFull Time
10+ YOE10+ years AI/ML engineering; Python/Go/Scala/Java; distributed compute; CPU/GPU infrastructure; ML/AI workloads.
Python, Go, Scala, Java, Spark, Dask, Ray, Flink, Kubernetes, AWS Lambda
1mo
Save
Mark Applied
Hide
Senior Data Platform Engineer
Boston, Massachusetts, United States
$158k-$195k/yr RemoteFull Time
8+ YOE8+ years in data/platform engineering owning full production data platforms. Expert with Fivetran, Snowflake, dbt, Looker; strong SQL and Python; streaming (Kafka/Kinesis/Spark) experience; data modeling, governance, observability, and AI data access patterns.
Fivetran, Snowflake, dbt, Looker, Grafana, Kafka, Kinesis, Spark, InfluxDB, SQL, Python
1mo
Save
Mark Applied
Hide
Data Engineer II
Providence, Rhode Island, United States
$104k/yr OnsiteFull Time
3+ YOEBachelor's or equivalent, 3+ years data engineering, strong SQL and Python, Databricks/Spark experience, cloud (AWS) familiarity, data modeling and ETL/ELT experience.
Databricks, Apache Spark, Delta Lake, Python, SQL, Amazon S3, Git, REST APIs, Apache Airflow, Databricks Workflows, CI/CD pipelines
2w
Save
Mark Applied
Hide
Senior Data Engineer
Austin or Boston or Charleston or Charlotte or Chicago or Dallas or Durham or Harrisburg or Houston or Irvine or Kansas City or Los Angeles or Miami or Nashville or New York or Newark or Palo Alto or Pittsburgh or Portland or Raleigh or San Francisco or Seattle or Washington or Wilmington
$128k-$249k/yr HybridFull Time
5+ YOE5+ years designing enterprise Microsoft Fabric data platforms; strong SQL and Python skills; experience with Spark, CI/CD, Azure DevOps/GitHub Actions; knowledge of data governance and Azure AI Foundry; Bachelor's degree or equivalent.
Microsoft Fabric, OneLake, Fabric Data Factory, Dataflow Gen2, Fabric Notebooks, Azure AI Foundry, Microsoft Copilot, Claude, SQL, Python, Spark, Azure DevOps, GitHub Actions, Microsoft Purview
1mo
Save
Mark Applied
Hide
Senior Data Engineer
Boston or Chicago or Dallas or Los Angeles or Minneapolis or New York City or San Francisco or Seattle or Washington, D.C.
$120k-$162k/yr HybridFull Time
4+ YOE4+ years building enterprise data platforms with Databricks, Snowflake or Microsoft Fabric; Spark/SQL/Python; cloud (AWS/Azure/GCP); Git/CI-CD; experience enabling analytics and AI; travel 30–50%; US work authorization required.
Databricks, Snowflake, Microsoft Fabric, AWS, Azure, GCP, Spark, SQL, Python, Azure Data Factory, Azure Storage, Azure Synapse, Git, CI/CD, ChatGPT
4d
Save
Mark Applied
Hide
Senior Data Engineer - Revenue Data Platform
Boston or New York City
$192k-$240k/yr HybridFull Time
Significant experience building and operating production data pipelines at scale with Spark and Airflow, plus complex investigations, data correctness, platform health, and cross-functional alignment.
Python, Scala, Spark, Airflow, Trino, Apache Iceberg
2d
Save
Mark Applied
Hide
Software Engineer
Cambridge or United States
$114k-$136k/yr RemoteFull Time
0.5+ YOEBachelor's degree in a listed computing or engineering field plus 6 months of related experience. Requires 6 months with Apache Spark, AWS, Apache Airflow, Python, Scala, SQL, Big Data, Hadoop MapReduce, Git, and Jenkins.
Apache Spark, Amazon Web Services (AWS), Apache Airflow, Python, Scala, SQL, Big Data, Hadoop MapReduce, Git, Jenkins
1mo
Save
Mark Applied
Hide
Senior Engineer, ML Engineering (Databricks)
New York or Chicago or Boston or Toronto or London
$130k-$147k/yr HybridFull Time
Experience operationalizing production ML/AI on Databricks, MLflow, Databricks Model Serving; strong Python, Spark, SQL; CI/CD and monitoring for model performance, safety, and governance.
Databricks, Databricks Workflows, Delta Lake, Delta Live Tables, Asset Bundles, Unity Catalog, Genie Code, MonteCarlo, Fiddler, MLflow, Databricks Model Serving, Python, Spark, SQL, Jenkins, shell, Yarn, AWS, chatGPT, Claude, Copilot
2mo
Save
Mark Applied
Hide
Senior Software Engineer
Wakefield or Boston
$102k-$190k/yr OnsiteFull Time
5+ YOE5-8 years software engineering, strong data engineering and distributed systems experience; AWS, Databricks, Python, PySpark; Databricks, Spark, Kafka/RabbitMQ; SQL/NoSQL databases; CI/CD and DevOps; mentoring.
AWS, Databricks, Python, PySpark, Apache Spark, Kafka, RabbitMQ, SQL Server, MongoDB, Jenkins, GitHub, GitLab, Bitbucket, CI/CD, DevOps
1mo
Save
Mark Applied
Hide
Machine Learning Engineer, Senior Manager
Southfield or San Francisco or Seattle or Boston or New York City or Los Angeles or San Diego or United States
$184k-$270k/yr RemoteFull Time
8+ YOEPhD (8+ yrs) or MS (10+ yrs) in a relevant technical field; 8+ years designing, building, and deploying ML/DL/Gen-AI models; hands-on experience with production ML/LLM ops, scalable systems, and leading technical teams.
Kubeflow, DVC, Ray, gRPC, GraphQL, Databricks MLflow, Databricks Model Serving, MLflow, Apache Airflow, Spark, Flink, Kafka, Kinesis, Snowflake, Databricks, XGBoost, Transformers
3mo
Save
Mark Applied
Hide
Senior Distinguished Engineer, AI Compute (Remote Eligible)
San Francisco or Richmond or New York City or San Jose or North America or Cambridge or McLean
$286k-$392k/yr RemoteFull Time
8+ YOEBachelor's degree plus 10 years or master's degree plus 8 years in AI/ML technologies, and 10 years programming with Python, Go, Scala, or Java; distributed systems expertise required.
Golang, Python, Spark, Dask, Ray, Flink, Kubernetes, AWS Lambda, Scala, Java, Amazon EKS, Amazon EC2 UltraClusters, Amazon Graviton
Explore Jobs