113 spark engineer jobs at 59 companies in Canton, MA
1mo
Save
Mark Applied
Hide
1mo
Principal Data Engineer - Neo4J
Johnston or Phoenix or United States
OnsiteFull Time
Citizens Financial GroupNYSE: CFG: Provides retail, commercial, and private banking services to customers.
8+ YOE8+ years data engineering experience with Neo4j expertise, graph modeling and ontology design, Python proficiency, experience with big-data ecosystems (Spark, Kafka), graph performance tuning, data ingestion pipelines, and team leadership.
Data Platform Engineer, VP II - State Street Investment Management
Boston, Massachusetts, United States
$120k-$203k/yrOnsiteFull Time
State StreetNYSE: STT: Provides investment servicing and management to institutional investors.
15+ YOELead architecture and engineering of cloud-native data platforms; deep expertise in distributed data processing, Spark, Lakehouse platforms, governance, and devops practices.
ZoomInfoNASDAQ: GTM: Provides B2B contact data and sales intelligence software.
3+ YOE3+ years software engineering experience building production data pipelines and backend services. Strong Java, ETL/ELT, streaming, cloud (GCP) and data quality skills required.
Man GroupLondon Stock Exchange: EMG: Global alternative investment management and systematic trading services.
5+ YOE5+ years software engineering experience for quantitative applications; expert Python and Pandas; Linux and Git proficiency; experience with large datasets, production systems, and relevant databases.
United States or Arlington or Tysons or Washington or New York City or Chicago or Austin or Atlanta or Boston or Boulder
$113k-$188k/yrRemoteFull Time
Guidehouse: Provides management and technology consulting services to diverse organizations.
3+ YOEBachelor's degree,3+ years data engineering experience,proficiency with Python/PySpark/SQL,Databricks/Spark/Delta Lake experience,knowledge of data pipelines,governance,and cloud platforms.
Boston Beer CompanyNYSE: SAM: Produces and markets craft beers, hard seltzers, and ciders.
Hands-on Databricks/Spark data engineering using Python and SQL, Lakehouse/Delta Lake experience, CI/CD exposure, data quality and governance, bachelor’s in CS or related (or equivalent).
Databricks, Spark, Delta Lake, Python, SQL, Databricks Unity Catalog, Delta Live Tables, Databricks SQL, Azure DevOps, Databricks Asset Bundles, Power BI, SSIS, Jira, Confluence, Databricks notebooks, PowerShell
KlaviyoNYSE: KVYO: Software platform for automated e-commerce marketing and customer data.
12+ YOE12+ years software engineering experience with distributed systems and data platform architecture; expertise in lakehouse, ingestion, orchestration, observability, and operational automation; strong technical leadership and cross-team coordination skills.
Arrowstreet Capital: Manages global equity portfolios using systematic quantitative models.
7+ YOE7+ years software engineering experience; 5+ years cloud (AWS preferred); strong SQL, Iceberg, Spark, Pandas/Polars; experience building mission-critical production systems; strong debugging, testing, and communication skills.
Capital OneNYSE: COF: Financial services offering credit cards, banking, and loans.
7+ YOE5+ MgmtBachelor's degree, 7+ years software engineering experience, 5+ years people management, proficiency with Python/SQL/Big Data tools, cloud-native and data engineering experience.
Agentic Data Engineer - Health - Manager - Consulting - Boston
Boston, Massachusetts, United States
$126k-$230k/yrHybridFull Time
EY: Global firm providing audit, tax, and professional consulting services.
6+ YOE2+ Mgmt6+ years data engineering experience with healthcare interoperability, cloud-native data platforms, SQL/Python/Spark proficiency, and 2+ years leading technical teams; bachelor's degree required.
FHIR, HL7 v2, CDA/CCDA, DICOM, X12 EDI, EHR, EMR, SNOMED CT, LOINC, RxNorm, OMOP, PCORnet, Sentinel, Databricks, Snowflake, Microsoft Fabric, AWS, Azure, Google Cloud, SQL, Python, Spark, Epic, Oracle Health, Cerner, Meditech, Athenahealth, Health Catalyst, Arcadia, AWS HealthLake, AWS HealthOmics, Azure Health Data Services, Google Cloud Healthcare API
Ashville or Atlanta or Boston or Costa Mesa or Seattle or Washington or United States
$129k-$220k/yrHybridFull Time
Anduril Industries: Defense technology building autonomous military hardware and software.
Design and implement log aggregation, ETL, and security data lake pipelines; strong programming (Go, Rust, Java, Scala); infra-as-code (Terraform, AWS CDK, Pulumi); cloud and CI/CD deployment; eligible for U.S. Top Secret clearance.
Veeva SystemsNYSE: VEEV: Cloud-based software solutions for the global life sciences industry.
5+ YOE5+ years building data models and pipelines, 2+ years production Airflow, 2+ years Spark at scale, strong Python and SQL, AWS (S3,ECS/Fargate,Glue,IAM,Secrets Manager) experience.
Airflow, MWAA, Spark, AWS Glue, Databricks, Python, SQL, S3, ECS/Fargate, IAM, Secrets Manager, Claude Code, Open Meta
International Game Technology: Global provider of gaming, digital entertainment, and fintech solutions.
3+ YOEBachelor's or equivalent, 3+ years data engineering, strong SQL and Python, Databricks/Spark experience, cloud (AWS) familiarity, data modeling and ETL/ELT experience.
Austin or Boston or Charleston or Charlotte or Chicago or Dallas or Durham or Harrisburg or Houston or Irvine or Kansas City or Los Angeles or Miami or Nashville or New York or Newark or Palo Alto or Pittsburgh or Portland or Raleigh or San Francisco or Seattle or Washington or Wilmington
$128k-$249k/yrHybridFull Time
K&L Gates: Global law firm providing comprehensive legal and regulatory counsel.
5+ YOE5+ years designing enterprise Microsoft Fabric data platforms; strong SQL and Python skills; experience with Spark, CI/CD, Azure DevOps/GitHub Actions; knowledge of data governance and Azure AI Foundry; Bachelor's degree or equivalent.
Microsoft Fabric, OneLake, Fabric Data Factory, Dataflow Gen2, Fabric Notebooks, Azure AI Foundry, Microsoft Copilot, Claude, SQL, Python, Spark, Azure DevOps, GitHub Actions, Microsoft Purview
Publicis GroupeEuronext Paris: PUB: Global communications, advertising, and digital transformation holding.
8+ YOE8+ years software engineering experience building scalable REST APIs, microservices, Kubernetes, cloud-native data platforms, and distributed data processing using Python/Java and Spark.
REST APIs, microservices, Kubernetes, Data Warehousing, Data Lakes, Delta Lake, Python, Java, Angular, PySpark, Apache Spark, TypeScript, JavaScript, AWS S3, Lambda, API Gateway, EventBridge, Kafka, SNS, SQS, PostgreSQL, SQL Server, Aurora, DynamoDB, MongoDB, Redis, Terraform, Ansible, Jenkins, GitHub, GitLab, Bitbucket, GoCD, Databricks, Azure, Google Cloud Platform (GCP), LLMs, RAG architectures, Agentic AI
Boston or Chicago or Dallas or Los Angeles or Minneapolis or New York City or San Francisco or Seattle or Washington, D.C.
$120k-$162k/yrHybridFull Time
West Monroe: Business and technology consultancy specializing in digital transformation.
4+ YOE4+ years building enterprise data platforms with Databricks, Snowflake or Microsoft Fabric; Spark/SQL/Python; cloud (AWS/Azure/GCP); Git/CI-CD; experience enabling analytics and AI; travel 30–50%; US work authorization required.
Databricks, Snowflake, Microsoft Fabric, AWS, Azure, GCP, Spark, SQL, Python, Azure Data Factory, Azure Storage, Azure Synapse, Git, CI/CD, ChatGPT
New York or Chicago or Boston or Toronto or London
$130k-$147k/yrHybridFull Time
Curinos: Providing data-driven decision intelligence for global financial institutions.
Experience operationalizing production ML/AI on Databricks, MLflow, Databricks Model Serving; strong Python, Spark, SQL; CI/CD and monitoring for model performance, safety, and governance.
Databricks, Databricks Workflows, Delta Lake, Delta Live Tables, Asset Bundles, Unity Catalog, Genie Code, MonteCarlo, Fiddler, MLflow, Databricks Model Serving, Python, Spark, SQL, Jenkins, shell, Yarn, AWS, chatGPT, Claude, Copilot
8+ YOEPhD (8+ yrs) or MS (10+ yrs) in a relevant technical field; 8+ years designing, building, and deploying ML/DL/Gen-AI models; hands-on experience with production ML/LLM ops, scalable systems, and leading technical teams.
DraftKingsNASDAQ: DKNG: Provide online sports betting, fantasy sports, and casino gaming.
3+ YOEBachelor's degree in a technical field, 3+ years building production ML systems, strong Python and SQL skills, experience with Spark and Databricks, MLflow/Jenkins/GitOps familiarity, A/B testing and mentoring experience.