HiringCafe
Join our community

92 spark data engineer jobs at 41 companies in Lynn, MA

PromotedHiringCafe
Founding Machine Learning / AI Search Engineer
Cupertino, CA, US
$160k-$310k/yr On-SiteFull Time
HiringCafe
HiringCafe: Building a 100× better job search engine to take on Indeed and LinkedIn.
Build the ML and AI search behind HiringCafe — ranking, recommenders, retrieval, and LLM agents that surface jobs people would never find on their own.
Python, PyTorch, Elasticsearch, LLMs
Help us #BeatIndeed & #BeatLinkedIn
3mo
Save
Mark Applied
Hide
Data Engineer
Orlando or Boston
HybridFull Time
VaxCare
VaxCare: Automated vaccine management and billing platform for healthcare providers.
5+ YOE3-5 years data engineering; 1+ year with Databricks/Spark; Python and SQL; Delta Lake; Databricks; CI/CD; collaboration with data scientists
Python, PySpark, SQL, Spark SQL, Delta Lake, Databricks, Delta Live Tables, Unity Catalog, Databricks Workflows, Git, CI/CD, Azure DevOps, Jenkins
Job PostingView all
1w
Save
Mark Applied
Hide
Principal Data Engineer
Boston or Massachusetts
$207k-$284k/yr HybridFull Time
Humana
HumanaNYSE: HUM: Provides health insurance plans and clinical healthcare services.
10+ YOE1+ Mgmt10+ years data engineering, Bachelor’s in CS or related, strong Databricks/Delta Lake, SQL, Python, Spark, medallion lakehouse experience, 1–2 years tech lead experience; sponsorship not available.
Databricks, Delta Lake, SQL, Python, Spark, Databricks Delta Live Tables, Unity Catalog, Feature Store, Kafka, Claude, Copilot, Hire Vue, Workday
Job PostingView all
3mo
Save
Mark Applied
Hide
Data Engineer
Wakefield, Massachusetts, United States
$90k-$150k/yr HybridFull Time
GEI Consultants
GEI Consultants: Provides multi-disciplinary engineering and environmental consulting services.
4+ YOE4+ years data engineering; Python/SQL; Azure data services; Databricks; ETL/ELT; data governance.
Python, SQL, PySpark, Spark, Azure Data Factory, Azure Synapse Analytics, Azure Data Lake Storage, Azure SQL, Azure AI Search, Cosmos DB, Databricks, Delta Lake, Unity Catalog, Terraform, Azure DevOps
Job PostingView all
1d
Save
Mark Applied
Hide
Senior Data Platform Engineer
Boston, Massachusetts, United States
$158k-$195k/yr RemoteFull Time
Bevi
Bevi: Manufacturer of internet-connected, bottleless water and beverage dispensers.
8+ YOE8+ years in data/platform engineering owning full production data platforms. Expert with Fivetran, Snowflake, dbt, Looker; strong SQL and Python; streaming (Kafka/Kinesis/Spark) experience; data modeling, governance, observability, and AI data access patterns.
Fivetran, Snowflake, dbt, Looker, Grafana, Kafka, Kinesis, Spark, InfluxDB, SQL, Python
Job PostingView all
2mo
Save
Mark Applied
Hide
AI Data Engineer
Boston, Massachusetts, United States
RemoteFull Time
C the Signs
C the Signs: AI-powered clinical decision support platform for early cancer detection.
Bachelor's in CS/engineering; data engineer with big data experience; Python/Scala/Java; data warehousing/ETL/data modeling; cloud services (AWS/GCP/Azure); Spark; strong problem solving and communication.
Python, Scala, Java, AWS, GCP, Azure, Apache Spark, Airflow, ETL, Data Warehousing
Job PostingView all
16h
Save
Mark Applied
Hide
Senior Data Engineer
Boston or Chicago or Dallas or Los Angeles or Minneapolis or New York City or San Francisco or Seattle or Washington, D.C.
$120k-$162k/yr HybridFull Time
West Monroe
West Monroe: Business and technology consultancy specializing in digital transformation.
4+ YOE4+ years building enterprise data platforms with Databricks, Snowflake or Microsoft Fabric; Spark/SQL/Python; cloud (AWS/Azure/GCP); Git/CI-CD; experience enabling analytics and AI; travel 30–50%; US work authorization required.
Databricks, Snowflake, Microsoft Fabric, AWS, Azure, GCP, Spark, SQL, Python, Azure Data Factory, Azure Storage, Azure Synapse, Git, CI/CD, ChatGPT
Job PostingView all
3w
Save
Mark Applied
Hide
Associate Data Engineer / Data Engineer II / Senior Data Engineer (REMOTE)
Worcester, Massachusetts, United States
$60k-$130k/yr RemoteFull Time
The Hanover Insurance Group
The Hanover Insurance GroupNYSE: THG: Provides property and casualty insurance products and services.
0+ YOEDegree in data-related field, experience with data engineering/ETL, proficiency in SQL and Python, experience with Azure and Databricks, strong problem-solving and communication; must be eligible to work in the US without sponsorship.
Azure Synapse, Data Factory, ADLS, Databricks, Delta Tables, Spark, PySpark, SQL, T-SQL, Python, Java, Scala, Power BI, GitHub, Azure DevOps
Job PostingView all
3w
Save
Mark Applied
Hide
Associate Data Engineer / Data Engineer II / Senior Data Engineer (REMOTE)
Worcester, Massachusetts, United States
$60k-$130k/yr RemoteFull Time
The Hanover Insurance Group
The Hanover Insurance GroupNYSE: THG: Provides property and casualty insurance products to individuals and businesses.
0+ YOEDegree in Data Science/Computer Science or related, experience in data engineering/ETL/data modeling (levels 0–5+ years), proficiency in SQL and Python, experience with Azure cloud platforms preferred, strong problem-solving and communication, US work authorization required.
Azure Synapse, Data Factory, ADLS, Data Lake, Databricks, Delta Tables, Spark, PySpark, SQL, T-SQL, Python, Java, Scala, Microsoft Power BI, GitHub, Azure DevOps, Azure
Job PostingView all
2mo
Save
Mark Applied
Hide
Principal, Data Engineer
Woburn, Massachusetts, United States
HybridFull Time
American Tower
American TowerNYSE: AMT: Leases space on wireless and broadcast towers for communications.
8+ YOE8+ years data engineering; CS/Math degree; expert SQL/Python; cloud platforms; Spark; Kafka; Airflow; governance; leadership.
SQL, Python, Apache Spark, PySpark, AWS, Azure, Google Cloud, Databricks, Snowflake, Kafka, Kinesis, Airflow, dbt, CI/CD, Infrastructure as Code, Data Quality, Data Governance
Job PostingView all
1mo
Save
Mark Applied
Hide
Staff Data Engineer
Waltham or North Bethesda
$180k-$200k/yr HybridFull Time
Xometry
XometryNASDAQ: XMTR: Operates an AI-powered marketplace for custom manufacturing and prototyping.
5+ YOESenior data engineer owning enterprise-scale data architecture and partner integrations.
Snowflake, SQL, Python, dbt, Airbyte, Airflow, Kafka, Spark, Kinesis, Looker, Streamlit, Terraform, CloudFormation, Apache Iceberg
Job PostingView all
3d
Save
Mark Applied
Hide
Data Platform Engineer, VP II - State Street Investment Management
Boston, Massachusetts, United States
$120k-$203k/yr OnsiteFull Time
State Street
State StreetNYSE: STT: Provides investment servicing and management to institutional investors.
15+ YOELead architecture and engineering of cloud-native data platforms; deep expertise in distributed data processing, Spark, Lakehouse platforms, governance, and devops practices.
Python, SQL, Java, Scala, GitHub Copilot, Codex, Anthropic, Spark, Snowflake, Databricks, AWS, Azure, Apache Iceberg, Unity Catalog, GCP, Collibra, Alation, Claude Code Assistant, Terraform, CloudFormation
Job PostingView all
2mo
Save
Mark Applied
Hide
Data Engineer, PXT Central Science
Seattle or Boston or Bellevue or Arlington or San Francisco
OnsiteFull Time
Amazon
AmazonNASDAQ: AMZN: Global online retail and cloud computing technology provider.
3+ YOE3+ years data engineering; AWS stack; data modeling/ETL; programming in Python/Java/Scala/NodeJS; experience with Redshift/S3/Glue/EMR/Kinesis/Lambda; non-relational data stores.
AWS, Python, SQL, Spark, Hadoop, Hive, Redshift, S3, EMR, Lambda, Kinesis, Airflow
Job PostingView all
2mo
Save
Mark Applied
Hide
Lead Data Engineer
Richmond or Cambridge or McLean
OnsiteFull Time
Capital One
Capital OneNYSE: COF: Financial services offering credit cards, banking, and loans.
4+ YOEBachelor’s degree; 4+ years in application development; 2+ years in big data; 1+ year cloud (AWS/Azure/GCP); 7+ years in related roles (preferred); 4+ years in cloud; 4+ years in distributed data/compute tools; 4+ years in data warehousing; 4+ years in UNIX/Linux; 2+ years in Agile.
Java, Scala, Python, SQL, NoSQL, Redshift, Snowflake, AWS, Azure, GCP, Hadoop, Kafka, Spark, MongoDB, Cassandra, Unix/Linux, Shell, MySQL
Job PostingView all
2mo
Save
Mark Applied
Hide
Junior Data Engineer
London or Boston or Victoria
$70k-$85k/yr HybridFull Time
Opensignal
Opensignal: Provides independent data on global mobile and broadband experiences.
1+ YOE1+ years in building big data pipelines; Spark/Scala/SQL experience; AWS; Bachelor’s degree.
Apache Spark, Scala, SQL, Amazon Redshift, Amazon Athena, Amazon S3, Apache Airflow, Amazon EMR, AWS
Job PostingView all
3w
Save
Mark Applied
Hide
Security Data Engineer
Ashville or Atlanta or Boston or Costa Mesa or Seattle or Washington or United States
$129k-$220k/yr HybridFull Time
Anduril Industries
Anduril Industries: Defense technology building autonomous military hardware and software.
Design and implement log aggregation, ETL, and security data lake pipelines; strong programming (Go, Rust, Java, Scala); infra-as-code (Terraform, AWS CDK, Pulumi); cloud and CI/CD deployment; eligible for U.S. Top Secret clearance.
Lattice OS, Spark, DuckDB, Go, Rust, Java, Scala, Terraform, AWS CDK, Pulumi, CI/CD, AWS, Azure, GCP, Iceberg, Delta Lake, Splunk
Job PostingView all
1mo
Save
Mark Applied
Hide
Principal Engineer, Data Infrastructure
Boston, Massachusetts, United States
$244k-$366k/yr OnsiteFull Time
Klaviyo
KlaviyoNYSE: KVYO: Software platform for automated e-commerce marketing and customer data.
10+ YOE10+ years building and operating distributed data systems; expertise in ingestion/CDC, stream processing, batch orchestration, lakehouse patterns, governance, SLOs, and applying AI/ML to data platforms.
Kafka, PubSub, Flink, Spark, Beam, Airflow, Dagster, Iceberg, Delta, Hudi, Snowflake, BigQuery, object storage
Job PostingView all
1mo
Save
Mark Applied
Hide
Principal Data Engineer
Smithfield, Rhode Island, United States
$155k-$166k/yr OnsiteFull Time
Fidelity Investments
Fidelity Investments: Provides investment management, retirement planning, and brokerage services.
3+ YOEBachelor's (or Master's) in CS/IT/Engineering/IS plus 5 (or 3) years experience. Expertise in data warehousing, ETL, Oracle/PL/SQL, Informatica, Control-M, CI/CD (Terracore/Jenkins/GitHub/uDeploy), Snowflake on AWS, Python, Java, SQL, SnowSQL, Spark SQL, Alation, Collibra.
SQL, PL/SQL, Java, Python, Shell, Jenkins, Terracore, GitHub, uDeploy, Oracle, SQL Server, Snowflake, Amazon Web Services (AWS), SnowSQL, Informatica, Control-M, UNIX, JIRA, JavaScript, Node.js, React, Spark SQL, Alation, Collibra
Job PostingView all
3d
Save
Mark Applied
Hide
Senior Data Engineer
Indianapolis or Woodland Hills or Ashburn or Costa Mesa or Miami or Richmond or Chicago or New York City or Seattle or Grand Prairie or Chicago or Atlanta or Iselin or Overland Park or Tampa or Woburn
$127k-$229k/yr HybridFull Time
Elevance Health
Elevance HealthNYSE: ELV: Provides health insurance plans and integrated healthcare services.
8+ YOEBS/BA and 8+ years technical experience in systems administration/security, data platform architecture, Microsoft Fabric/Azure, data pipelines, SQL/Python, and regulatory compliance (HIPAA,NIST,SOC2).
Microsoft Fabric, Apache Spark, SQL, Python, PySpark, Spark, Delta Lake, Parquet, REST APIs, JSON, Git, Azure DevOps, CI/CD
Job PostingView all
3w
Save
Mark Applied
Hide
Senior Manager, Data Engineering
San Francisco or Ottawa or Phoenix or Toronto or Los Angeles or Denver or Salt Lake City or Atlanta or Chicago or Houston or Portland or New York City or Vancouver or San Diego or Washington, D.C. or Sacramento or Jacksonville or Seattle or Mexico City or Austin or Miami or Boston or Dallas
$155k-$265k/yr HybridFull Time
Scribd
Scribd: Subscription-based digital library for e-books, audiobooks, and documents.
10+ YOE3+ Mgmt10+ years in data engineering, 3+ years managing engineering teams; advanced SQL and experience with Python/Scala, Spark, Databricks/Delta Lake/Snowflake/BigQuery; strong data architecture, dimensional modeling, and cross-functional leadership.
SQL, Python, Scala, Spark, Databricks, Delta Lake, Snowflake, BigQuery
Job PostingView all
1d
Save
Mark Applied
Hide
Kearney Activate- Senior Data Scientist & Product Engineer
Washington or Arlington or Boston
$100k-$150k/yr OnsiteFull Time
Kearney
Kearney: Global management consulting firm providing strategic and operational advice.
Senior generalist with end-to-end data science experience: framing, EDA, modeling, deployment, monitoring; Bachelor\u0002s degree in a relevant field; U.S. work authorization and ability to obtain Secret clearance.
Python, SQL, Power BI, Tableau, Git, Docker, Spark, JavaScript, React, CI/CD, LLMs, RAG
Job PostingView all

Explore Jobs

Expand Your Job Search