427 spark engineer jobs at 182 companies in Jericho, NY
3w
Save
Mark Applied
Hide
Spark Engineer
Jersey City or New York City
OnsiteFull Time
Experience with Spark/Hadoop ecosystem, Kafka, HBase/Hive/Impala, Python/SQL/PySpark/Shell; bachelor's degree or equivalent experience; ability to work full SDLC; US work authorization required.
Spark, Hadoop, HDFS, YARN, Confluent Kafka, HBase, Hive, Impala, NoSQL, PySpark, SQL, Python, Shell
1w
Save
Mark Applied
Hide
Software Engineer, Spark Platform
San Francisco or Seattle or Sunnyvale or New York City
$131k-$285k/yr HybridFull Time
24+ YOERequires a CS degree or equivalent, 24+ years operating production distributed systems, Spark at scale, Kubernetes, cloud infrastructure, observability, and professional Python, Go, Scala, or Java with SQL fluency.
Apache Spark, Kubernetes, YuniKorn, Volcano, Kueue, Prometheus, OpenTelemetry, AWS, Python, Go, Scala, Java, SQL, Databricks, Amazon EMR
1mo
Save
Mark Applied
Hide
Software Engineer, Spark Platform
San Francisco or Sunnyvale or Seattle or New York City
$131k-$285k/yr HybridFull Time
24+ YOEExperience operating production distributed systems and Apache Spark at scale, Kubernetes production experience, familiarity with schedulers and observability stacks, cloud (AWS) experience, programming in Python/Go/Scala/Java, and SQL fluency. BS/MS/PhD in CS or equivalent.
Apache Spark, Amazon EMR, Databricks, Kubernetes, YuniKorn, Volcano, Kueue, Spark-on-Kubernetes operator, Prometheus, OpenTelemetry, Python, Go, Scala, Java, SQL, VPC
1w
Save
Mark Applied
Hide
Lead Data Engineer (Python, AWS, Spark, Kafka, SQL, Snowflake, Databricks, GenAI)
New York City or McLean or Richmond
$215k-$246k/yr OnsiteFull Time
4+ YOEBachelor's degree, 4+ years application development, 2+ years big data, 1+ year cloud experience; proficiency with Python, SQL, Spark, ETL, and distributed data tools.
Python, AWS, Spark, Kafka, SQL, Snowflake, Databricks, GenAI, Claude Code, GitHub Copilot, MapReduce, Hadoop, Hive, EMR, MySQL, Mongo, Cassandra, Redshift, UNIX/Linux, shell scripting
1w
Save
Mark Applied
Hide
Software Engineer - Infrastructure (Senior+)
San Francisco or New York
$100k-$300k/yr OnsiteFull Time
5+ YOE5+ years infrastructure engineering experience, hands-on AWS, Clickhouse, Postgres, Spark; startup experience; security and on-prem deployment experience; able to drive large cross-stakeholder projects.
AWS, Clickhouse, Clickhouse Cloud, Postgres, Spark, GCP, Azure, Envoy, Istio, Hashicorp Vault, MicroVM (Runloop), SPIFFE, SPIRE
1mo
Save
Mark Applied
Hide
Principal Engineer in Technical Fellow Office
New York City, New York, United States
HybridFull Time
10+ YOE10+ years engineering experience; hands-on with LLMs/agentic systems, productionizing AI features, and distributed systems (Kafka, Flink, Spark); strong cross-team influence and mentorship skills.
LLMs, Kafka, Flink, Spark
6d
Save
Mark Applied
Hide
Staff Data Engineer
Jersey City, New Jersey, United States
$159k-$209k/yr HybridFull Time
8+ YOE8+ years data engineering experience building scalable batch and streaming systems; proficiency with Spark, Airflow, Kafka, Databricks, cloud services; SQL and Python/Scala/Java; strong system ownership and communication skills.
Spark, Airflow, Kafka, Databricks, AWS, GCP, Azure, SQL, Python, Scala, Java, Terraform
1w
Save
Mark Applied
Hide
Senior Data Platform Engineer
Austin or San Francisco or New York City or Seattle or Los Angeles or Chicago or Gurugram or Bengaluru
$170k-$230k/yr RemoteFull Time
5+ YOE5+ years engineering experience; strong Python or Golang skills; building ETL/ELT pipelines at scale with Spark/Hadoop/Kafka; cloud (AWS/Azure/GCP) and database expertise; containerization and IaC experience.
Python, Golang, PostgreSQL (RDS), OpenSearch, Redshift, EMR, Spark, Docker, Lambda, AWS, EKS, SQS, SNS, S3, Kubernetes, Hadoop, Kafka, Microsoft Azure, GCP
1w
Save
Mark Applied
Hide
Senior Data Engineer, Big Data and Cloud
New York, New York, United States
$105k-$190k/yr HybridFull Time
4+ YOE4+ years experience building scalable big-data pipelines using Python, Spark, SQL, cloud (GCP), Airflow and Kafka; strong software engineering, data architecture, and geospatial experience preferred.
Python, Spark, Scala, SQL, pandas, scikit-learn, scipy, numpy, GCP, Airflow, Kafka, Google BigQuery
1mo
Save
Mark Applied
Hide
Data Engineer - Director
New York City, New York, United States
$120k-$155k/yr OnsiteFull Time
Experience designing and building scalable databases and ETL pipelines using Python and SQL; knowledge of Spark, Snowflake, Databricks, DB2/Sybase/SQL Server/Postgres/Greenplum; strong communication and agile experience.
Python, SQL, Spark, Snowflake, Databricks, Power Designer, Unix, K-Shell, DB2, Sybase, SQL Server, Postgres, Greenplum
3mo
Save
Mark Applied
Hide
Sr Data Engineer, Python + Spark (Data Federation skillset - Data Lakehouse - Eg: Starburst) - New York
New York, New York, United States
$40k-$140k/yr OnsiteFull Time
Photon: Global technology services provider.
5+ YOESenior Data Engineer with 5+ years in Python, Spark; expertise in data federation, lakehouse architectures (Delta Lake/Iceberg/Hudi); Starburst/Trino/Dremio; cloud platforms (AWS/Azure/GCP); strong SQL and data modeling.
Python, Apache Spark, Starburst Enterprise, Trino (Presto), Dremio, Delta Lake, Iceberg, Hudi, AWS, S3, Glue, Azure Databricks, ADLS, GCP, SQL, Medallion Architecture, Starburst/Trino
2mo
Save
Mark Applied
Hide
Senior Data Engineer
San Mateo or New York
$140k-$160k/yr HybridFull Time
6+ YOE6+ years building production data systems; expert Python, PostgreSQL, Apache Airflow, Clickhouse, Snowflake, Elasticsearch, Apache Spark, and AWS; bachelor's in CS/Data Engineering preferred or equivalent experience.
Python, PostgreSQL, Apache Airflow, Clickhouse, Snowflake, Elasticsearch, Apache Spark, AWS RDS, AWS
1mo
Save
Mark Applied
Hide
Senior Big Data Engineer
San Francisco or New York City or Seattle or Little Rock
$130k-$197k/yr OnsiteFull Time
7+ YOE7+ years in software/data engineering; hands-on with Apache Spark, Airflow or Temporal, Dataproc, Kubernetes, Terraform, streaming (Redpanda/Kafka); on-call experience; bachelor’s in CS/Engineering/Math or equivalent.
Apache Spark, Airflow, Temporal, Dataproc, Redpanda, Kafka, Kubernetes, Terraform, Grafana, Linux, Python, Go, Java, Scala, GIT, Subversion, AWS, GCP, Azure
9h
Save
Mark Applied
Hide
Practice Customer Engineer, Data Analytics, Google Cloud
Sunnyvale or Atlanta or Austin or Boulder or Chicago or Kirkland or Los Angeles or New York City or Seattle or San Francisco or Portland or Phoenix or Playa Vista
$192k-$267k/yr OnsiteFull Time
10+ YOEBachelor's degree or equivalent, 10 years in cloud-native architecture, Big Data expertise, technical stakeholder engagement, and programming experience with Python, Spark, or SQL.
Google Cloud, Python, Spark, SQL, Informatica, Talend, Alooma, SAP, Data Services, Java, JavaScript, C++, Scala, R, Go, DNS, TCP, Linux, Microsoft Windows, VPN, VPC
2mo
Save
Mark Applied
Hide
Staff Software Engineer - Events Platform
New York City or Seattle or San Francisco
$189k-$331k/yr OnsiteFull Time
8+ YOE8+ years backend engineering experience, leadership on cross-functional projects, expertise building distributed services, experience with data processing frameworks (e.g., Apache Spark or Flink), AWS and observability experience preferred.
Apache Spark, Flink, AWS, Slack, Microsoft 365
3w
Save
Mark Applied
Hide
Database Engineer / Senior Database Engineer
New York or New York
$108k-$152k/yr HybridFull Time
5+ YOEBachelor's degree and 5+ years building production data platforms; strong Python and SQL skills; ETL and distributed processing experience; Databricks/Spark/Delta Lake experience preferred.
Python, SQL, Databricks, Apache Spark, Delta Lake, Streamlit, SCADA
2mo
Save
Mark Applied
Hide
Staff Data Engineer- Data Lake
New York, New York, United States
$170k-$190k/yr HybridFull Time
8+ YOE8+ years building and scaling distributed data platforms; technical leadership and mentoring; strong Python (PySpark), Java/Scala, advanced SQL, Apache Spark, cloud-native big data (AWS EMR/Glue/S3/Athena/Redshift), orchestration (Argo/Airflow), containerization, observability, and experience with large-scale ingestion and data quality.
Apache Spark, Argo, Athena, Avro, CircleCI, Claude Code, Docker, EMR, Elastic MapReduce (EMR), Git, GitHub Copilot, Hudi, Java, JIRA, Kinesis, Kafka, Kubernetes, Ky, MAT, Microsoft Excel, Parquet, PySpark, Python, Redshift, S3, Scala, Spark, SQL, Delta, Glue, Airflow
2mo
Save
Mark Applied
Hide
Senior Machine Learning Engineer
Glendale or San Francisco or New York
$142k-$199k/yr HybridFull Time
5+ YOEExperience building and operating large-scale data/ML systems, strong distributed systems fundamentals, streaming/batch technologies (Kafka, Kinesis, Spark, Flink), Python, plus working knowledge of Java/Scala/Go/C++, cloud-native (AWS, containers, Kubernetes, IaC), observability, and collaboration skills; Bachelor's or Master's required.
Kafka, Kinesis, Spark, Flink, Python, Java, Scala, Go, C++, AWS, Kubernetes, containers, IaC tools
2mo
Save
Mark Applied
Hide
Senior Staff Data Infrastructure Engineer
New York or United States
$200k-$220k/yr RemoteFull Time
7+ YOEUS citizenship required; 7+ years in infrastructure/platform/SRE/DevOps for data-intensive systems; hands-on experience with PostgreSQL, Kafka, Spark/EMR/Hive/Trino, Linux, AWS, Kubernetes, Terraform/Helm; strong communication skills.
PostgreSQL, MongoDB, Kafka, Spark, EMR, Hive, Trino, Linux, AWS, Kubernetes, Terraform, Helm, Service Mesh, Istio
2mo
Save
Mark Applied
Hide
Principal Integration Engineer - Trade Data Warehouse
Charlotte or New York
HybridFull Time
8+ YOEBachelor's degree or equivalent, 8+ years relevant experience; deep knowledge of security master, transactional trade data, electronic trading market structures, expert data modeling, EM/market-data/post-trade flows; Java, Python/Spark, JMS, Spring, Maven, Docker, Postgres/Oracle, Linux skills.
Java, Python, Spark, JMS, Spring, Maven, Docker, Postgres, Oracle, Linux, Kubernetes, Tick Database
Explore Jobs