406 spark engineer jobs at 184 companies in Dover, NJ
2w
Save
Mark Applied
Hide
Spark Engineer
Jersey City or New York City
OnsiteFull Time
Experience with Spark/Hadoop ecosystem, Kafka, HBase/Hive/Impala, Python/SQL/PySpark/Shell; bachelor's degree or equivalent experience; ability to work full SDLC; US work authorization required.
Spark, Hadoop, HDFS, YARN, Confluent Kafka, HBase, Hive, Impala, NoSQL, PySpark, SQL, Python, Shell
1mo
Save
Mark Applied
Hide
Software Engineer, Spark Platform
San Francisco or Sunnyvale or Seattle or New York City
$131k-$285k/yr HybridFull Time
24+ YOEExperience operating production distributed systems and Apache Spark at scale, Kubernetes production experience, familiarity with schedulers and observability stacks, cloud (AWS) experience, programming in Python/Go/Scala/Java, and SQL fluency. BS/MS/PhD in CS or equivalent.
Apache Spark, Amazon EMR, Databricks, Kubernetes, YuniKorn, Volcano, Kueue, Spark-on-Kubernetes operator, Prometheus, OpenTelemetry, Python, Go, Scala, Java, SQL, VPC
5d
Save
Mark Applied
Hide
Lead Data Engineer (Python, AWS, Spark, Kafka, SQL, Snowflake, Databricks, GenAI)
New York City or McLean or Richmond
$215k-$246k/yr OnsiteFull Time
4+ YOEBachelor's degree, 4+ years application development, 2+ years big data, 1+ year cloud experience; proficiency with Python, SQL, Spark, ETL, and distributed data tools.
Python, AWS, Spark, Kafka, SQL, Snowflake, Databricks, GenAI, Claude Code, GitHub Copilot, MapReduce, Hadoop, Hive, EMR, MySQL, Mongo, Cassandra, Redshift, UNIX/Linux, shell scripting
1d
Save
Mark Applied
Hide
Software Engineer - Infrastructure (Senior+)
San Francisco or New York
$100k-$300k/yr OnsiteFull Time
5+ YOE5+ years infrastructure engineering experience, hands-on AWS, Clickhouse, Postgres, Spark; startup experience; security and on-prem deployment experience; able to drive large cross-stakeholder projects.
AWS, Clickhouse, Clickhouse Cloud, Postgres, Spark, GCP, Azure, Envoy, Istio, Hashicorp Vault, MicroVM (Runloop), SPIFFE, SPIRE
4w
Save
Mark Applied
Hide
Principal Engineer in Technical Fellow Office
New York City, New York, United States
HybridFull Time
10+ YOE10+ years engineering experience; hands-on with LLMs/agentic systems, productionizing AI features, and distributed systems (Kafka, Flink, Spark); strong cross-team influence and mentorship skills.
LLMs, Kafka, Flink, Spark
1w
Save
Mark Applied
Hide
Senior Data Platform Engineer
Austin or San Francisco or New York City or Seattle or Los Angeles or Chicago or Gurugram or Bengaluru
$170k-$230k/yr RemoteFull Time
5+ YOE5+ years engineering experience; strong Python or Golang skills; building ETL/ELT pipelines at scale with Spark/Hadoop/Kafka; cloud (AWS/Azure/GCP) and database expertise; containerization and IaC experience.
Python, Golang, PostgreSQL (RDS), OpenSearch, Redshift, EMR, Spark, Docker, Lambda, AWS, EKS, SQS, SNS, S3, Kubernetes, Hadoop, Kafka, Microsoft Azure, GCP
6d
Save
Mark Applied
Hide
Senior Data Engineer, Big Data and Cloud
New York, New York, United States
$105k-$190k/yr HybridFull Time
4+ YOE4+ years experience building scalable big-data pipelines using Python, Spark, SQL, cloud (GCP), Airflow and Kafka; strong software engineering, data architecture, and geospatial experience preferred.
Python, Spark, Scala, SQL, pandas, scikit-learn, scipy, numpy, GCP, Airflow, Kafka, Google BigQuery
1w
Save
Mark Applied
Hide
Senior Data Engineer
Atlanta or New York City
$138k-$182k/yr HybridFull Time
5+ YOE5+ years building data pipelines and platforms; strong SQL and programming (Python/Scala/Java); experience with Airflow, Spark, dbt, Kafka or Databricks; cloud data platform experience; strong problem-solving.
SQL, Python, Scala, Java, Airflow, Spark, dbt, Kafka, Databricks, AWS, GCP, Azure
3mo
Save
Mark Applied
Hide
Sr Data Engineer, Python + Spark (Data Federation skillset - Data Lakehouse - Eg: Starburst) - New York
New York, New York, United States
$40k-$140k/yr OnsiteFull Time
Photon: Global technology services provider.
5+ YOESenior Data Engineer with 5+ years in Python, Spark; expertise in data federation, lakehouse architectures (Delta Lake/Iceberg/Hudi); Starburst/Trino/Dremio; cloud platforms (AWS/Azure/GCP); strong SQL and data modeling.
Python, Apache Spark, Starburst Enterprise, Trino (Presto), Dremio, Delta Lake, Iceberg, Hudi, AWS, S3, Glue, Azure Databricks, ADLS, GCP, SQL, Medallion Architecture, Starburst/Trino
2mo
Save
Mark Applied
Hide
Senior Data Engineer
San Mateo or New York
$140k-$160k/yr HybridFull Time
6+ YOE6+ years building production data systems; expert Python, PostgreSQL, Apache Airflow, Clickhouse, Snowflake, Elasticsearch, Apache Spark, and AWS; bachelor's in CS/Data Engineering preferred or equivalent experience.
Python, PostgreSQL, Apache Airflow, Clickhouse, Snowflake, Elasticsearch, Apache Spark, AWS RDS, AWS
1mo
Save
Mark Applied
Hide
Senior Big Data Engineer
San Francisco or New York City or Seattle or Little Rock
$130k-$197k/yr OnsiteFull Time
7+ YOE7+ years in software/data engineering; hands-on with Apache Spark, Airflow or Temporal, Dataproc, Kubernetes, Terraform, streaming (Redpanda/Kafka); on-call experience; bachelor’s in CS/Engineering/Math or equivalent.
Apache Spark, Airflow, Temporal, Dataproc, Redpanda, Kafka, Kubernetes, Terraform, Grafana, Linux, Python, Go, Java, Scala, GIT, Subversion, AWS, GCP, Azure
2mo
Save
Mark Applied
Hide
Staff Software Engineer - Events Platform
New York City or Seattle or San Francisco
$189k-$331k/yr OnsiteFull Time
8+ YOE8+ years backend engineering experience, leadership on cross-functional projects, expertise building distributed services, experience with data processing frameworks (e.g., Apache Spark or Flink), AWS and observability experience preferred.
Apache Spark, Flink, AWS, Slack, Microsoft 365
2w
Save
Mark Applied
Hide
Database Engineer / Senior Database Engineer
New York or New York
$108k-$152k/yr HybridFull Time
5+ YOEBachelor's degree and 5+ years building production data platforms; strong Python and SQL skills; ETL and distributed processing experience; Databricks/Spark/Delta Lake experience preferred.
Python, SQL, Databricks, Apache Spark, Delta Lake, Streamlit, SCADA
2mo
Save
Mark Applied
Hide
Staff Data Engineer- Data Lake
New York, New York, United States
$170k-$190k/yr HybridFull Time
8+ YOE8+ years building and scaling distributed data platforms; technical leadership and mentoring; strong Python (PySpark), Java/Scala, advanced SQL, Apache Spark, cloud-native big data (AWS EMR/Glue/S3/Athena/Redshift), orchestration (Argo/Airflow), containerization, observability, and experience with large-scale ingestion and data quality.
Apache Spark, Argo, Athena, Avro, CircleCI, Claude Code, Docker, EMR, Elastic MapReduce (EMR), Git, GitHub Copilot, Hudi, Java, JIRA, Kinesis, Kafka, Kubernetes, Ky, MAT, Microsoft Excel, Parquet, PySpark, Python, Redshift, S3, Scala, Spark, SQL, Delta, Glue, Airflow
2mo
Save
Mark Applied
Hide
Senior Machine Learning Engineer
Glendale or San Francisco or New York
$142k-$199k/yr HybridFull Time
5+ YOEExperience building and operating large-scale data/ML systems, strong distributed systems fundamentals, streaming/batch technologies (Kafka, Kinesis, Spark, Flink), Python, plus working knowledge of Java/Scala/Go/C++, cloud-native (AWS, containers, Kubernetes, IaC), observability, and collaboration skills; Bachelor's or Master's required.
Kafka, Kinesis, Spark, Flink, Python, Java, Scala, Go, C++, AWS, Kubernetes, containers, IaC tools
2mo
Save
Mark Applied
Hide
Senior Staff Data Infrastructure Engineer
New York or United States
$200k-$220k/yr RemoteFull Time
7+ YOEUS citizenship required; 7+ years in infrastructure/platform/SRE/DevOps for data-intensive systems; hands-on experience with PostgreSQL, Kafka, Spark/EMR/Hive/Trino, Linux, AWS, Kubernetes, Terraform/Helm; strong communication skills.
PostgreSQL, MongoDB, Kafka, Spark, EMR, Hive, Trino, Linux, AWS, Kubernetes, Terraform, Helm, Service Mesh, Istio
2mo
Save
Mark Applied
Hide
Principal Integration Engineer - Trade Data Warehouse
Charlotte or New York
HybridFull Time
8+ YOEBachelor's degree or equivalent, 8+ years relevant experience; deep knowledge of security master, transactional trade data, electronic trading market structures, expert data modeling, EM/market-data/post-trade flows; Java, Python/Spark, JMS, Spring, Maven, Docker, Postgres/Oracle, Linux skills.
Java, Python, Spark, JMS, Spring, Maven, Docker, Postgres, Oracle, Linux, Kubernetes, Tick Database
1mo
Save
Mark Applied
Hide
Cloud Data Engineer
Jersey City or United States
OnsiteFull Time
6+ YOE6+ years data engineering experience with AWS (Glue, Redshift, S3, Lambda, EMR/Spark, Kinesis, Athena, RDS, API Gateway), Python and SQL proficiency, experience with data lakes/warehouses, ETL/ELT, DevOps/CI/CD, and leadership/mentoring skills.
AWS, Glue, Redshift, S3, Lambda, EMR/Spark, Kinesis, Athena, RDS, API Gateway, Python, SQL, Shell, Scala, CloudFormation, Terraform, CI/CD
1mo
Save
Mark Applied
Hide
Sr. Forward Deployed Engineer - Financial Services
New York City or San Francisco or California
$181k-$248k/yr OnsiteFull Time
6+ YOE6+ years in data engineering/platforms or software engineering; proficiency with Python/Scala/JavaScript/TypeScript, Apache Spark, cloud (AWS/Azure/GCP), CI/CD, MLOps; customer-facing delivery and Databricks certification; travel ~20%.
Python, Scala, JavaScript, TypeScript, Apache Spark, AWS, Azure, GCP, CI/CD, MLOps, AI APIs, Databricks, Delta Lake, MLflow
3w
Save
Mark Applied
Hide
Senior Engineer-GenAI Platform Engineering
Addison or Pennington or Charlotte
$122k-$200k/yr OnsiteFull Time
10+ YOE10+ years building enterprise-scale Generative AI and data platforms; Bachelor's/Master's in CS/Engineering/Data Science; expertise in Python, Kubernetes, Kafka, Spark; strong architecture, CI/CD, and platform leadership skills.
Python, Kafka, Apache Spark, Flink, Kubernetes, CI/CD, DevSecOps, MCP
Explore Jobs