37 spark data engineer jobs at 14 companies in Gardner, MA
1mo
Save
Mark Applied
Hide
Associate Data Engineer / Data Engineer II / Senior Data Engineer (REMOTE)
Worcester, Massachusetts, United States
$60k-$130k/yr RemoteFull Time
0+ YOEDegree in data-related field, experience with data engineering/ETL, proficiency in SQL and Python, experience with Azure and Databricks, strong problem-solving and communication; must be eligible to work in the US without sponsorship.
Azure Synapse, Data Factory, ADLS, Databricks, Delta Tables, Spark, PySpark, SQL, T-SQL, Python, Java, Scala, Power BI, GitHub, Azure DevOps
1mo
Save
Mark Applied
Hide
Associate Data Engineer / Data Engineer II / Senior Data Engineer (REMOTE)
Worcester, Massachusetts, United States
$60k-$130k/yr RemoteFull Time
0+ YOEDegree in Data Science/Computer Science or related, experience in data engineering/ETL/data modeling (levels 0–5+ years), proficiency in SQL and Python, experience with Azure cloud platforms preferred, strong problem-solving and communication, US work authorization required.
Azure Synapse, Data Factory, ADLS, Data Lake, Databricks, Delta Tables, Spark, PySpark, SQL, T-SQL, Python, Java, Scala, Microsoft Power BI, GitHub, Azure DevOps, Azure
3mo
Save
Mark Applied
Hide
Principal, Data Engineer
Woburn, Massachusetts, United States
HybridFull Time
8+ YOE8+ years data engineering; CS/Math degree; expert SQL/Python; cloud platforms; Spark; Kafka; Airflow; governance; leadership.
SQL, Python, Apache Spark, PySpark, AWS, Azure, Google Cloud, Databricks, Snowflake, Kafka, Kinesis, Airflow, dbt, CI/CD, Infrastructure as Code, Data Quality, Data Governance
2mo
Save
Mark Applied
Hide
Staff Data Engineer
Waltham or North Bethesda
$180k-$200k/yr HybridFull Time
5+ YOESenior data engineer owning enterprise-scale data architecture and partner integrations.
Snowflake, SQL, Python, dbt, Airbyte, Airflow, Kafka, Spark, Kinesis, Looker, Streamlit, Terraform, CloudFormation, Apache Iceberg
2mo
Save
Mark Applied
Hide
Lead Data Engineer - Data Transformation (Modeling and Architecture)
Richmond or McLean or Cambridge
$179k-$225k/yr OnsiteFull Time
4+ YOEBachelor’s degree; 4+ years in application development; 2+ years in big data; 1+ year cloud experience; 4+ years in data architecture/modeling; 7+ years in app development; 4+ years in distributed data tools; 4+ years in data warehousing; 4+ years UNIX/Linux; 2+ years Agile; experience with AI tooling.
SQL, Spark, Python, AWS, Azure, Google Cloud, NoSQL, MongoDB, Cassandra, Redshift, Snowflake, Hadoop, Hive, EMR, Kafka, Unix/Linux, Shell scripting, Java, Scala
2w
Save
Mark Applied
Hide
Senior Data Engineer
Indianapolis or Woodland Hills or Ashburn or Costa Mesa or Miami or Richmond or Chicago or New York City or Seattle or Grand Prairie or Chicago or Atlanta or Iselin or Overland Park or Tampa or Woburn
$127k-$229k/yr HybridFull Time
8+ YOEBS/BA and 8+ years technical experience in systems administration/security, data platform architecture, Microsoft Fabric/Azure, data pipelines, SQL/Python, and regulatory compliance (HIPAA,NIST,SOC2).
Microsoft Fabric, Apache Spark, SQL, Python, PySpark, Spark, Delta Lake, Parquet, REST APIs, JSON, Git, Azure DevOps, CI/CD
3w
Save
Mark Applied
Hide
Data Product Lead
Boston or Cambridge
$177k-$278k/yr OnsiteFull Time
10+ YOE4+ Mgmt10+ years data engineering/platform experience with 4+ years managing technical teams; Bachelor’s in CS or related; hands-on Databricks/AWS/Spark; commercial pharma data and data governance experience; HIPAA compliance.
Databricks, AWS, Spark, Salesforce, IQVIA, Komodo, EMR/EHR
1mo
Save
Mark Applied
Hide
Senior Software Engineer - Data Acquisition Team
Waltham, Massachusetts, United States
$140k-$220k/yr HybridFull Time
5+ YOE5+ years software engineering experience with backend data pipeline design, Java proficiency, expertise with data processing/orchestration and cloud (preferably GCP); bachelor's degree required.
Java, Apache Airflow, Apache Beam, Spark, Google Dataflow, DataProc, Kafka, Pub/Sub, BigQuery, Snowflake, Trino, GCS, GKE, Kubernetes, Terraform
1w
Save
Mark Applied
Hide
Software Engineer, Data Infrastructure (Staff)
San Francisco or Cambridge
$180k-$300k/yr OnsiteFull Time
Lightfield: AI-powered CRM automating customer interaction capture and insights.
Experience owning production data systems, strong software engineering fundamentals, debugging across stack, query performance and schema evolution, product-oriented judgment.
Postgres, Redis, Typesense, BullMQ, ClickHouse, Kafka, Flink, Spark, Iceberg
1w
Save
Mark Applied
Hide
Director, Data Engineering
Needham, Massachusetts, United States
$176k-$235k/yr HybridFull Time
10+ YOEBachelor's degree in a technical field,10+ years in data engineering or related fields,proven people leadership,enterprise cloud data platform experience,modern data architecture and governance expertise.
Microsoft Azure, AWS, Google Cloud Platform, Microsoft Fabric, Azure Synapse Analytics, Azure Data Factory, Azure Data Lake Storage, Databricks, Snowflake, Microsoft SQL Server, SQL, Python, Spark, Apache Airflow, Terraform, Bicep, Kafka, Power BI, Tableau
2w
Save
Mark Applied
Hide
Lead Cloud Platform Engineer (Data & Execution Platform)
Merrimack or Westlake
OnsiteFull Time
8+ YOE8+ years cloud/platform engineering with hands-on Apache Spark, Apache Airflow, Kubernetes (EKS), AWS services, and proficiency in Python/Java/Go; strong troubleshooting, observability, and leadership skills.
Apache Spark, Apache Airflow, Kubernetes, EKS, EC2, S3, Lambda, RDS, VPCs, IAM, GitHub Copilot, LLMs, Python, Java, Go, Docker
1w
Save
Mark Applied
Hide
Director – AI & Data Architecture (Pre-Sales & Solutioning)
Burlington, Massachusetts, United States
$140k-$311k/yr OnsiteFull Time
12+ YOE5+ Mgmt12+ years in data/analytics/cloud architecture, 5+ years designing enterprise AI solutions, bachelor's in CS/engineering/IS, strong cloud and Snowflake/Databricks experience, EMR not required, excellent executive communication.
AWS, Azure, Google Cloud, Snowflake, Databricks, Azure OpenAI, AWS Bedrock, Google Vertex AI, Snowflake Cortex, Python, SQL, Spark, Java, Power BI, Tableau, Microsoft Fabric
3w
Save
Mark Applied
Hide
Lead Software Engineer
Wakefield, Massachusetts, United States
$113k-$209k/yr HybridFull Time
8+ YOE8+ years software engineering experience building scalable REST APIs, microservices, Kubernetes, cloud-native data platforms, and distributed data processing using Python/Java and Spark.
REST APIs, microservices, Kubernetes, Data Warehousing, Data Lakes, Delta Lake, Python, Java, Angular, PySpark, Apache Spark, TypeScript, JavaScript, AWS S3, Lambda, API Gateway, EventBridge, Kafka, SNS, SQS, PostgreSQL, SQL Server, Aurora, DynamoDB, MongoDB, Redis, Terraform, Ansible, Jenkins, GitHub, GitLab, Bitbucket, GoCD, Databricks, Azure, Google Cloud Platform (GCP), LLMs, RAG architectures, Agentic AI
2mo
Save
Mark Applied
Hide
Senior Software Engineer
Wakefield or Boston
$102k-$190k/yr OnsiteFull Time
5+ YOE5-8 years software engineering, strong data engineering and distributed systems experience; AWS, Databricks, Python, PySpark; Databricks, Spark, Kafka/RabbitMQ; SQL/NoSQL databases; CI/CD and DevOps; mentoring.
AWS, Databricks, Python, PySpark, Apache Spark, Kafka, RabbitMQ, SQL Server, MongoDB, Jenkins, GitHub, GitLab, Bitbucket, CI/CD, DevOps
2w
Save
Mark Applied
Hide
Senior Cloud Ops and Dev Ops Engineer
Cambridge or Plymouth Meeting or United States
OnsiteFull Time
4+ YOE4+ years operating data management solutions on cloud, experience with AWS services, CI/CD, Terraform, database technologies, HIPAA-aware data handling, and onshore/offshore collaboration.
Jenkins, GitHub Actions, Terraform, S3, EFS, EC2, RDS, EKS, Glue, Secrets Manager, AWS Batch, PostgreSQL, MongoDB, Redshift, Elasticsearch, Spark, Bash, Git, LLMOps, GenAI LLM
1w
Save
Mark Applied
Hide
Senior Engineer I/II, Drug Discovery Platform
Cambridge, Massachusetts, United States
$148k-$240k/yr OnsiteFull Time
5+ YOEBachelor's degree,5+ years building production data platforms; strong Python and SQL skills; experience with scientific/lab data, AWS, and Kubernetes; database and schema design for evolving data.
Python, SQL, AWS, Kubernetes, RDKit, OpenEye, CDD Vault, Dotmatics, Benchling Registry, mzML, AnIML, Flyte, Airflow, Dagster, Temporal, Iceberg, Delta Lake, Hudi, DuckDB, Polars, Spark, ChemSpeed, Opentrons, Cursor, Claude Code
1mo
Save
Mark Applied
Hide
Distinguished Technologist, Distributed Systems & Agentic Query Optimization
San Jose or Houston or Durham or Andover
$170k-$413k/yr HybridFull Time
15+ YOE15+ years engineering and architectural leadership experience building and operating large distributed systems and cloud platform services; strong data engineering, distributed query, cloud-native, and AI-first prototyping skills.
Spark, Kafka, Parquet, Go, Java, BigQuery, AWS, GCP, Azure
1mo
Save
Mark Applied
Hide
Distinguished Technologist, Distributed Systems & Agentic Query Optimization
San Jose or Houston or Durham or Andover
$170k-$413k/yr HybridFull Time
15+ YOE15+ years designing and operating large distributed systems and cloud platform services; expertise in distributed query engines, federated data, cloud-native architecture; strong communication and technical leadership skills.
Spark, Kafka, Parquet, Go, Java, BigQuery, AWS, GCP, Azure
Explore Jobs