130 spark engineer jobs at 59 companies in Mansfield, MA
1mo
Save
Mark Applied
Hide
Principal Data Engineer - Neo4J
Johnston or Phoenix or United States
OnsiteFull Time
8+ YOE8+ years data engineering experience with Neo4j expertise, graph modeling and ontology design, Python proficiency, experience with big-data ecosystems (Spark, Kafka), graph performance tuning, data ingestion pipelines, and team leadership.
Neo4j, Spark, Kafka, Python
3w
Save
Mark Applied
Hide
Data Platform Engineer, VP II - State Street Investment Management
Boston, Massachusetts, United States
$120k-$203k/yr OnsiteFull Time
15+ YOELead architecture and engineering of cloud-native data platforms; deep expertise in distributed data processing, Spark, Lakehouse platforms, governance, and devops practices.
Python, SQL, Java, Scala, GitHub Copilot, Codex, Anthropic, Spark, Snowflake, Databricks, AWS, Azure, Apache Iceberg, Unity Catalog, GCP, Collibra, Alation, Claude Code Assistant, Terraform, CloudFormation
2w
Save
Mark Applied
Hide
Software Engineer III - PA085
Waltham, Massachusetts, United States
$112k-$176k/yr HybridFull Time
3+ YOE3+ years software engineering experience building production data pipelines and backend services. Strong Java, ETL/ELT, streaming, cloud (GCP) and data quality skills required.
Java, Apache Beam, Apache Airflow, Spark, Google Dataflow, DataProc, Kafka, Google Pub/Sub, BigQuery, GCS, GKE, SQL, Kubernetes, EKS, Snowflake, Starburst, Trino, Terraform
2w
Save
Mark Applied
Hide
Senior Quantitative Developer
Boston, Massachusetts, United States
$150k-$170k/yr HybridFull Time
5+ YOE5+ years software engineering experience for quantitative applications; expert Python and Pandas; Linux and Git proficiency; experience with large datasets, production systems, and relevant databases.
Linux, Python, NumPy, SciPy, Pandas, statsmodels, scikit-learn, Java, MongoDB, MS SQL, Postgres, Control-M, Airflow, Kafka, Bitbucket, Jenkins, Grafana, Prometheus, ELK, Docker, OpenStack, Ansible, Slack, React, Spark, Dask, Kubernetes, Redis, ArcticDB, Git
2w
Save
Mark Applied
Hide
BI Data Engineer II
Boston, Massachusetts, United States
$77k-$136k/yr HybridFull Time
Hands-on Databricks/Spark data engineering using Python and SQL, Lakehouse/Delta Lake experience, CI/CD exposure, data quality and governance, bachelor’s in CS or related (or equivalent).
Databricks, Spark, Delta Lake, Python, SQL, Databricks Unity Catalog, Delta Live Tables, Databricks SQL, Azure DevOps, Databricks Asset Bundles, Power BI, SSIS, Jira, Confluence, Databricks notebooks, PowerShell
3w
Save
Mark Applied
Hide
Senior Lead Software Engineer - Data Platform
Boston, Massachusetts, United States
$216k-$324k/yr OnsiteFull Time
12+ YOE12+ years software engineering experience with distributed systems and data platform architecture; expertise in lakehouse, ingestion, orchestration, observability, and operational automation; strong technical leadership and cross-team coordination skills.
Iceberg, S3, Spark, EMR, Airflow, Python, Materialized Views, AWS, KDB
1mo
Save
Mark Applied
Hide
Senior Software Engineer, Investment Systems
Boston, Massachusetts, United States
$115k-$325k/yr OnsiteFull Time
7+ YOE7+ years software engineering experience; 5+ years cloud (AWS preferred); strong SQL, Iceberg, Spark, Pandas/Polars; experience building mission-critical production systems; strong debugging, testing, and communication skills.
AWS, GCP, Azure, SQL, Iceberg, Spark, Pandas, Polars
3mo
Save
Mark Applied
Hide
Senior Distinguished Engineer, AI Compute (Remote Eligible)
San Francisco or Cambridge or Richmond or McLean or New York or San Jose or San Francisco
$286k-$392k/yr RemoteFull Time
10+ YOE10+ years AI/ML engineering; Python/Go/Scala/Java; distributed compute; CPU/GPU infrastructure; ML/AI workloads.
Python, Go, Scala, Java, Spark, Dask, Ray, Flink, Kubernetes, AWS Lambda
1mo
Save
Mark Applied
Hide
Security Data Engineer
Ashville or Atlanta or Boston or Costa Mesa or Seattle or Washington or United States
$129k-$220k/yr HybridFull Time
Design and implement log aggregation, ETL, and security data lake pipelines; strong programming (Go, Rust, Java, Scala); infra-as-code (Terraform, AWS CDK, Pulumi); cloud and CI/CD deployment; eligible for U.S. Top Secret clearance.
Lattice OS, Spark, DuckDB, Go, Rust, Java, Scala, Terraform, AWS CDK, Pulumi, CI/CD, AWS, Azure, GCP, Iceberg, Delta Lake, Splunk
2d
Save
Mark Applied
Hide
Senior Data Engineer
White Plains or Greensboro or Charleston or Greenville or Maitland or Harrisonburg or Clearwater or Louisville or Birmingham or Huntsville or Alpharetta or Clayton or Honolulu or Lake Oswego or Gainesville or Fayetteville or Naples or Hibbing or Miami or Myrtle Beach or Houston or Denver or Piscataway or Irvine or Key Largo or Columbia or Little Rock or Austin or Pensacola or Lexington or Bloomington or Fort Myers or Panama City or San Antonio or Rochester or Mobile or Salt Lake City or Bend or Charlotte or Glen Allen or Raleigh or Abilene or Tallahassee or San Ramon or Dallas or Pittsburgh or Boston or Missoula or Cincinnati or Boise or Eugene or McMinnville or Knoxville or Dakota Dunes or Kissimmee or Fort Worth or Grand Forks or Canonsburg or Buffalo or Eastland or Philadelphia or Chicago or Phoenix or Dublin or Jacksonville or St. Louis or Los Angeles or Atlanta or Norwalk or Colchester or Grand Rapids or Richmond or Hoboken or Indianapolis or Kansas City or Chagrin Falls or Orland Park or Anchorage or High Point or Bonita Springs or Rancho Cordova or Las Vegas or Irving or Brandenburg or Minneapolis or Fort Lauderdale or Shreveport or Fargo or Sarasota or Kennesaw or Dayton or Sacramento or Princeton or Durham or Conshohocken or Baton Rouge or Asheville or Chattanooga or Memphis or Nashville or United States
$96k-$168k/yr RemoteFull Time
10+ YOERequires 10+ years of enterprise data engineering experience and advanced Azure, Databricks, Spark, Python, SQL, ETL, data modeling, streaming, and cloud architecture expertise.
Microsoft Azure, Azure Databricks, Azure Functions, Azure Data Factory, Databricks, Apache Spark, PySpark, Python, SQL, Scala, Unity Catalog, Microsoft SQL Server, Kafka, Event Hub, Azure DevOps, Git, Terraform, ARM templates, Databricks Genie
1w
Save
Mark Applied
Hide
Senior Data Engineer
Austin or Boston or Charleston or Charlotte or Chicago or Dallas or Durham or Harrisburg or Houston or Irvine or Kansas City or Los Angeles or Miami or Nashville or New York or Newark or Palo Alto or Pittsburgh or Portland or Raleigh or San Francisco or Seattle or Washington or Wilmington
$128k-$249k/yr HybridFull Time
5+ YOE5+ years designing enterprise Microsoft Fabric data platforms; strong SQL and Python skills; experience with Spark, CI/CD, Azure DevOps/GitHub Actions; knowledge of data governance and Azure AI Foundry; Bachelor's degree or equivalent.
Microsoft Fabric, OneLake, Fabric Data Factory, Dataflow Gen2, Fabric Notebooks, Azure AI Foundry, Microsoft Copilot, Claude, SQL, Python, Spark, Azure DevOps, GitHub Actions, Microsoft Purview
3mo
Save
Mark Applied
Hide
Principal, Data Engineer
Woburn, Massachusetts, United States
HybridFull Time
8+ YOE8+ years data engineering; CS/Math degree; expert SQL/Python; cloud platforms; Spark; Kafka; Airflow; governance; leadership.
SQL, Python, Apache Spark, PySpark, AWS, Azure, Google Cloud, Databricks, Snowflake, Kafka, Kinesis, Airflow, dbt, CI/CD, Infrastructure as Code, Data Quality, Data Governance
2w
Save
Mark Applied
Hide
Senior Data Engineer
Boston or Chicago or Dallas or Los Angeles or Minneapolis or New York City or San Francisco or Seattle or Washington, D.C.
$120k-$162k/yr HybridFull Time
4+ YOE4+ years building enterprise data platforms with Databricks, Snowflake or Microsoft Fabric; Spark/SQL/Python; cloud (AWS/Azure/GCP); Git/CI-CD; experience enabling analytics and AI; travel 30–50%; US work authorization required.
Databricks, Snowflake, Microsoft Fabric, AWS, Azure, GCP, Spark, SQL, Python, Azure Data Factory, Azure Storage, Azure Synapse, Git, CI/CD, ChatGPT
2mo
Save
Mark Applied
Hide
Senior Software Engineer
Wakefield or Boston
$102k-$190k/yr OnsiteFull Time
5+ YOE5-8 years software engineering, strong data engineering and distributed systems experience; AWS, Databricks, Python, PySpark; Databricks, Spark, Kafka/RabbitMQ; SQL/NoSQL databases; CI/CD and DevOps; mentoring.
AWS, Databricks, Python, PySpark, Apache Spark, Kafka, RabbitMQ, SQL Server, MongoDB, Jenkins, GitHub, GitLab, Bitbucket, CI/CD, DevOps
1mo
Save
Mark Applied
Hide
Senior Engineer, ML Engineering (Databricks)
New York or Chicago or Boston or Toronto or London
$130k-$147k/yr HybridFull Time
Experience operationalizing production ML/AI on Databricks, MLflow, Databricks Model Serving; strong Python, Spark, SQL; CI/CD and monitoring for model performance, safety, and governance.
Databricks, Databricks Workflows, Delta Lake, Delta Live Tables, Asset Bundles, Unity Catalog, Genie Code, MonteCarlo, Fiddler, MLflow, Databricks Model Serving, Python, Spark, SQL, Jenkins, shell, Yarn, AWS, chatGPT, Claude, Copilot
1mo
Save
Mark Applied
Hide
Machine Learning Engineer, Senior Manager
Southfield or San Francisco or Seattle or Boston or New York City or Los Angeles or San Diego or United States
$184k-$270k/yr RemoteFull Time
8+ YOEPhD (8+ yrs) or MS (10+ yrs) in a relevant technical field; 8+ years designing, building, and deploying ML/DL/Gen-AI models; hands-on experience with production ML/LLM ops, scalable systems, and leading technical teams.
Kubeflow, DVC, Ray, gRPC, GraphQL, Databricks MLflow, Databricks Model Serving, MLflow, Apache Airflow, Spark, Flink, Kafka, Kinesis, Snowflake, Databricks, XGBoost, Transformers
3mo
Save
Mark Applied
Hide
Senior Distinguished Engineer, AI Compute (Remote Eligible)
San Francisco or Richmond or New York City or San Jose or Cambridge or McLean or United States
$286k-$392k/yr RemoteFull Time
8+ YOEBachelor's degree plus 10 years or master's degree plus 8 years developing AI/ML technologies; 10 years programming with Python, Go, Scala, or Java; distributed systems expertise required.
Golang, Python, Spark, Dask, Ray, Flink, Kubernetes, AWS Lambda, Scala, Java, Amazon EKS, Amazon EC2 UltraClusters, Graviton
1mo
Save
Mark Applied
Hide
Senior Machine Learning Engineer, Personalization
Canada or Boston
RemoteFull Time
3+ YOEBachelor's degree in a technical field, 3+ years building production ML systems, strong Python and SQL skills, experience with Spark and Databricks, MLflow/Jenkins/GitOps familiarity, A/B testing and mentoring experience.
Python, SQL, Spark, MLflow, Jenkins, GitOps, Databricks
2mo
Save
Mark Applied
Hide
Junior Data Engineer
London or Boston or Victoria
$70k-$85k/yr HybridFull Time
1+ YOE1+ years in building big data pipelines; Spark/Scala/SQL experience; AWS; Bachelor’s degree.
Apache Spark, Scala, SQL, Amazon Redshift, Amazon Athena, Amazon S3, Apache Airflow, Amazon EMR, AWS
2mo
Save
Mark Applied
Hide
Senior Software Engineer
Wakefield or Boston
$102k-$190k/yr HybridFull Time
5+ YOE5-8 years of software engineering experience; strong data engineering expertise; Databricks, Python, PySpark, Spark; AWS (S3/Glue/Athena/Lambda); Kafka/RabbitMQ; SQL Server/MongoDB; CI/CD; Azure/GCP; Generative AI exposure; experience in large-scale data platforms.
Databricks, Python, PySpark, Apache Spark, AWS, S3, Glue, Athena, Lambda, Kafka, RabbitMQ, SQL Server, MongoDB, Jenkins, GitHub, GitLab, Bitbucket, CI/CD, DevOps, Delta Lake, Azure, GCP, LLM, Generative AI
Explore Jobs