41 spark airflow jobs at 22 companies in Boston, MA
3mo
Save
Mark Applied
Hide
Principal, Data Engineer
Woburn, Massachusetts, United States
HybridFull Time
8+ YOE8+ years data engineering; CS/Math degree; expert SQL/Python; cloud platforms; Spark; Kafka; Airflow; governance; leadership.
SQL, Python, Apache Spark, PySpark, AWS, Azure, Google Cloud, Databricks, Snowflake, Kafka, Kinesis, Airflow, dbt, CI/CD, Infrastructure as Code, Data Quality, Data Governance
3w
Save
Mark Applied
Hide
Lead Cloud Platform Engineer (Data & Execution Platform)
Merrimack or Westlake
OnsiteFull Time
8+ YOE8+ years in software, platform, or cloud engineering; production Spark and Airflow; AWS and Kubernetes expertise; Python, Java, or Go; bachelor's or master's in computer science or equivalent.
Apache Spark, Apache Airflow, Kubernetes, Amazon EKS, Amazon EC2, Amazon S3, AWS Lambda, Amazon RDS, Amazon VPC, AWS IAM, GitHub Copilot, LLMs, Python, Java, Go, Docker, DNS, TCP/IP, TLS, CI/CD, CRDs, Deployments, StatefulSets, Jobs, CronJobs
3w
Save
Mark Applied
Hide
Lead Cloud Platform Engineer (Data & Execution Platform)
Merrimack or Westlake
OnsiteFull Time
8+ YOE8+ years cloud/platform engineering with hands-on Apache Spark, Apache Airflow, Kubernetes (EKS), AWS services, and proficiency in Python/Java/Go; strong troubleshooting, observability, and leadership skills.
Apache Spark, Apache Airflow, Kubernetes, EKS, EC2, S3, Lambda, RDS, VPCs, IAM, GitHub Copilot, LLMs, Python, Java, Go, Docker
1mo
Save
Mark Applied
Hide
Software Engineering & Development – Development Lead
Boston, Massachusetts, United States
$178k-$196k/yr HybridFull Time
5+ YOEBachelor's in CS plus 7 years (or Master's plus 5) commercial software development; experience with Python, Java, SQL, Spark/Databricks, Kafka, Airflow, Kubernetes, AWS; Agile experience and financial services domain knowledge.
Python, Java, Spring Boot, SQL, Kafka, Apache Spark, Databricks, Apache Airflow, Kubernetes, AWS, Cloud Computing
2mo
Save
Mark Applied
Hide
Staff Data Engineer
North Bethesda or Waltham
$180k-$200k/yr HybridFull Time
5+ YOE5+ years data engineering, STEM bachelor's, Snowflake expertise, SQL and Python, modern pipelines (dbt, Airflow), enterprise data architecture, AWS
Snowflake, SQL, Python, dbt, Airflow, Airbyte, Kafka, Spark, Kinesis, Looker, Streamlit, AWS, Terraform, CloudFormation, Iceberg
1mo
Save
Mark Applied
Hide
Machine Learning and Generative AI Engineer, Digital Transformation
Boston, Massachusetts, United States
HybridFull Time
5+ YOEHands-on ML/GenAI lifecycle expertise; 5+ years post-secondary education or equivalent experience; 2–3 years software development with Python and SQL; 2–3 years deploying NLP/deep learning in cloud; experience with PyTorch/TensorFlow, LangChain/LangGraph, vector DBs, Spark/Kafka, and CI/CD.
Python, SQL, PyTorch, TensorFlow, LangChain, LangGraph, Qdrant, Pinecone, Weaviate, Spark, Kafka, Linux, AWS, GCP, Azure, Airflow, Prefect, Step Functions, CI/CD
1mo
Save
Mark Applied
Hide
Data Engineer II
Providence, Rhode Island, United States
$104k/yr OnsiteFull Time
3+ YOEBachelor's or equivalent, 3+ years data engineering, strong SQL and Python, Databricks/Spark experience, cloud (AWS) familiarity, data modeling and ETL/ELT experience.
Databricks, Apache Spark, Delta Lake, Python, SQL, Amazon S3, Git, REST APIs, Apache Airflow, Databricks Workflows, CI/CD pipelines
4d
Save
Mark Applied
Hide
BI / Data Architect
Marlborough, Massachusetts, United States
$150k-$160k/yr OnsiteFull Time
12+ YOERequires 12–15 years of experience with lakehouse architecture, Apache Iceberg, Spark, Flink, Kafka, cloud platforms, data engineering tools, programming languages, containers, and infrastructure automation.
Apache Iceberg, Apache Spark, Apache Flink, Apache Kafka, dbt, Trino, Snowflake, Databricks, AWS, Microsoft Azure, Google Cloud, Python, Scala, SQL, Java, Kubernetes, Docker, Terraform, Apache Airflow, Dagster, Prefect, Polaris, Unity Catalog, Glue Catalog, Apache Nessie
3mo
Save
Mark Applied
Hide
Lead Data Scientist
Boston, Massachusetts, United States
$167k-$251k/yr OnsiteFull Time
7+ YOE7+ years data science experience with 3+ years in a technical leadership role; BS in CS/Statistics/Math, MS preferred; skilled in Python, R, ML, Spark/AWS; strong communication and collaboration.
Python, R, Stata, SQL, Apache Spark, Apache Airflow, AWS, Ansible, Terraform, Linux, Git, GitLab
1mo
Save
Mark Applied
Hide
Principal Engineer, Data Infrastructure
Boston, Massachusetts, United States
$244k-$366k/yr OnsiteFull Time
10+ YOE10+ years building and operating distributed data systems; expertise in ingestion/CDC, stream processing, batch orchestration, lakehouse patterns, governance, SLOs, and applying AI/ML to data platforms.
Kafka, PubSub, Flink, Spark, Beam, Airflow, Dagster, Iceberg, Delta, Hudi, Snowflake, BigQuery, object storage
2w
Save
Mark Applied
Hide
Senior Engineer I/II, Drug Discovery Platform
Cambridge, Massachusetts, United States
$148k-$240k/yr OnsiteFull Time
5+ YOEBachelor's degree,5+ years building production data platforms; strong Python and SQL skills; experience with scientific/lab data, AWS, and Kubernetes; database and schema design for evolving data.
Python, SQL, AWS, Kubernetes, RDKit, OpenEye, CDD Vault, Dotmatics, Benchling Registry, mzML, AnIML, Flyte, Airflow, Dagster, Temporal, Iceberg, Delta Lake, Hudi, DuckDB, Polars, Spark, ChemSpeed, Opentrons, Cursor, Claude Code
1w
Save
Mark Applied
Hide
Senior Managing Consultant - AI Architect
Coral Gables or Research Triangle Park or Durham or Boston or Atlanta or Jersey City or Dallas or Houston or Austin or Washington or Chicago or New York
$144k-$268k/yr HybridFull Time
10+ YOEBachelor's degree and 10–12+ years in software, data, machine learning, or cloud architecture, with ML deployment, MLOps, generative AI, cloud, data architecture, and system design expertise.
MLflow, Kubeflow, Vertex AI, Amazon SageMaker, OpenAI, Anthropic, Llama, Hugging Face, Spark, Airflow, Kafka, Snowflake, BigQuery, Redshift, IBM Cloud
1mo
Save
Mark Applied
Hide
Senior Machine Learning Engineer, Voice Assistant
Boston or San Jose
$216k-$273k/yr HybridFull Time
5+ years applying ML/AI to NLU/ASR, strong ML fundamentals, production ML model deployment, experience with big data systems and Java/Python/C++, transformer/LLM experience preferred.
Spark, EMR, S3, Airflow, Java, Python, C++
1mo
Save
Mark Applied
Hide
Data, AI and Emerging Technology Risk Principal Analyst
Johnston or Iselin or Westwood or Phoenix
HybridFull Time
7+ YOE7+ years IT risk experience; deep expertise with CRI/NIST/COBIT/ITIL; experience with cloud, data platforms, analytics, and security tools; strong executive communication and mentoring skills.
CRI Profile, NIST Cybersecurity Framework, NIST 800-53, COBIT, ITIL, AWS RDS, OCI, Snowflake, Databricks, Redshift, Starburst, Hadoop, Spark, Kafka, Talend, Informatica, Tableau, Webfocus, Autosys, Airflow, Java, Tessell, MongoAtlas, Collibra, Grafana, Datadog, Qualys, Wiz, CyberArk, Splunk, ServiceNow, Jira, Confluence, GRC Archer, WDesk, Nexus, Jenkins, Harness, Fortify, EKS, Openshift, Bedrock, Sagemaker, H2O.ai, MLflow, Microsoft Excel
1mo
Save
Mark Applied
Hide
Senior Machine Learning Engineer
Wellesley or New York City
$111k-$222k/yr HybridFull Time
5+ YOE5+ years building ML systems in production, 5+ years Python, familiarity with PyTorch/TensorFlow, MLOps (Kubeflow, Vertex), 2+ years SQL with Snowflake/BigQuery, 2+ years system design leadership, experience in reinforcement learning/causal inference/LLMs, mentoring experience, strong communication.
Python, PyTorch, TensorFlow, Kubeflow, Vertex, SQL, Snowflake, BigQuery, Node.js, React, Spark, Kafka, Airflow
1d
Save
Mark Applied
Hide
Associate Scientific Technical Engineer II, PDS&T CMC
Worcester or North Chicago
$66k-$126k/yr HybridFull Time
2+ YOEBachelor's degree plus 2 years or master's degree; expertise in Python, SQL, data pipelines, cloud platforms, ETL/ELT, data modeling, governance, APIs, and AI/ML data infrastructure.
Python, SQL, AWS, Azure, GCP, dbt, Spark, Airflow, Databricks, Snowflake, Informatica, Talend, Apache NiFi, AWS Glue, Azure Data Factory, REST, GraphQL, OData, Erwin, PowerDesigner, MES, OSIsoft PI, AVEVA, LIMS, QMS, ERP, GxP, 21 CFR Part 11, RAG, LLM
3w
Save
Mark Applied
Hide
Slalom Flex (Project Based)- GCP Data Architect
Boston or New York or Georgia or Texas or Maryland or Alabama or Idaho or North Carolina or Wyoming or Illinois or Ohio or South Carolina or California or Michigan or Pennsylvania or Connecticut or Indiana or Florida or Missouri or Nevada or Louisiana or Kentucky or Wisconsin or Minnesota or New Jersey or Oklahoma or Arizona or Maine or Oregon or Rhode Island or Utah or Virginia or District of Columbia
$105-$130/hr RemoteFull Time, Contract
10+ YOE10+ years in data architecture, engineering, or enterprise platforms; deep Google Cloud expertise; scalable data solutions, governance, modeling, streaming, and stakeholder leadership.
Google Cloud Platform (GCP), BigQuery, Dataflow, Dataproc, Pub/Sub, Cloud Storage, Composer, Airflow, Spark, Kafka, Databricks, Snowflake, Terraform
3w
Save
Mark Applied
Hide
Software Engineer III - PA085
Waltham, Massachusetts, United States
$112k-$176k/yr HybridFull Time
3+ YOE3+ years software engineering experience building production data pipelines and backend services. Strong Java, ETL/ELT, streaming, cloud (GCP) and data quality skills required.
Java, Apache Beam, Apache Airflow, Spark, Google Dataflow, DataProc, Kafka, Google Pub/Sub, BigQuery, GCS, GKE, SQL, Kubernetes, EKS, Snowflake, Starburst, Trino, Terraform
3mo
Save
Mark Applied
Hide
Data Engineer, PXT Central Science
Seattle or Boston or Bellevue or Arlington or San Francisco
OnsiteFull Time
3+ YOE3+ years data engineering; AWS stack; data modeling/ETL; programming in Python/Java/Scala/NodeJS; experience with Redshift/S3/Glue/EMR/Kinesis/Lambda; non-relational data stores.
AWS, Python, SQL, Spark, Hadoop, Hive, Redshift, S3, EMR, Lambda, Kinesis, Airflow
3w
Save
Mark Applied
Hide
Senior Quantitative Developer
Boston, Massachusetts, United States
$150k-$170k/yr HybridFull Time
5+ YOE5+ years software engineering experience for quantitative applications; expert Python and Pandas; Linux and Git proficiency; experience with large datasets, production systems, and relevant databases.
Linux, Python, NumPy, SciPy, Pandas, statsmodels, scikit-learn, Java, MongoDB, MS SQL, Postgres, Control-M, Airflow, Kafka, Bitbucket, Jenkins, Grafana, Prometheus, ELK, Docker, OpenStack, Ansible, Slack, React, Spark, Dask, Kubernetes, Redis, ArcticDB, Git
Explore Jobs
Expand Your Job Search
Top Cities Near Boston for Spark Airflow
- Spark Airflow jobs in Worcester, MA
- Spark Airflow jobs in Providence, RI
- Spark Airflow jobs in Lowell, MA
- Spark Airflow jobs in Cambridge, MA
- Spark Airflow jobs in Manchester, NH
- Spark Airflow jobs in Brockton, MA
- Spark Airflow jobs in Fall River, MA
- Spark Airflow jobs in Quincy, MA
- Spark Airflow jobs in Lynn, MA
- Spark Airflow jobs in Newton, MA
- Spark Airflow jobs in Nashua, NH
- Spark Airflow jobs in Warwick, RI
- Spark Airflow jobs in Cranston, RI
- Spark Airflow jobs in Somerville, MA
- Spark Airflow jobs in Lawrence, MA
- Spark Airflow jobs in Pawtucket, RI
- Spark Airflow jobs in Framingham, MA
- Spark Airflow jobs in Waltham, MA
- Spark Airflow jobs in Haverhill, MA
- Spark Airflow jobs in Malden, MA