HiringCafe
Join our community

456 spark engineer jobs at 192 companies in Wayne, NJ

3d
Save
Mark Applied
Hide
Spark Engineer
Jersey City or New York City
OnsiteFull Time
Infosys
InfosysNYSE: INFY: Provides IT consulting, software development, and business outsourcing services.
Experience with Spark/Hadoop ecosystem, Kafka, HBase/Hive/Impala, Python/SQL/PySpark/Shell; bachelor's degree or equivalent experience; ability to work full SDLC; US work authorization required.
Spark, Hadoop, HDFS, YARN, Confluent Kafka, HBase, Hive, Impala, NoSQL, PySpark, SQL, Python, Shell
Job PostingView all
2w
Save
Mark Applied
Hide
Software Engineer, Spark Platform
San Francisco or Sunnyvale or Seattle or New York City
$131k-$285k/yr HybridFull Time
DoorDash
DoorDashNASDAQ: DASH: On-demand delivery platform connecting consumers with local merchants.
24+ YOEExperience operating production distributed systems and Apache Spark at scale, Kubernetes production experience, familiarity with schedulers and observability stacks, cloud (AWS) experience, programming in Python/Go/Scala/Java, and SQL fluency. BS/MS/PhD in CS or equivalent.
Apache Spark, Amazon EMR, Databricks, Kubernetes, YuniKorn, Volcano, Kueue, Spark-on-Kubernetes operator, Prometheus, OpenTelemetry, Python, Go, Scala, Java, SQL, VPC
Job PostingView all
3w
Save
Mark Applied
Hide
Lead Software Engineer, Back End (Python, Spark)
New York City or San Francisco
$215k-$246k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: Financial services offering credit cards, banking, and loans.
4+ YOEBachelor's degree, 4+ years professional software engineering experience, 1+ year cloud computing (AWS/Azure/GCP), proficiency in Java/Python/SQL/Node/Go/Scala, and experience with containerization and cloud services.
Python, Spark, Java, SQL, Node, Node.js, Go, Scala, Docker, Kubernetes, AWS, Microsoft Azure, Google Cloud
Job PostingView all
1w
Save
Mark Applied
Hide
Principal Engineer in Technical Fellow Office
New York City, New York, United States
HybridFull Time
Unity
UnityNYSE: U: Provides software for creating real-time 3D interactive content.
10+ YOE10+ years engineering experience; hands-on with LLMs/agentic systems, productionizing AI features, and distributed systems (Kafka, Flink, Spark); strong cross-team influence and mentorship skills.
LLMs, Kafka, Flink, Spark
Job PostingView all
3mo
Save
Mark Applied
Hide
Principal Site Reliability Engineer
Bellevue or New York City
$164k-$213k/yr HybridFull Time
iSpot.tv
iSpot.tv: Provides real-time measurement and analytics for TV advertising.
10+ YOE3+ Mgmt10+ years in software engineering, cloud architecture, and/or SRE; strong AWS, Kubernetes, Terraform; Spark; CI/CD; leadership; excellent communication.
AWS, EKS, ECR, RDS, SQS, SNS, VPC, MWAA, S3, Terraform, CloudFormation, Kubernetes, kubectl, Helm, ArgoCD, CircleCI, Spark, EMR, Databricks, Glue, OTel, DataDog, GenAI tools
Job PostingView all
1w
Save
Mark Applied
Hide
Data Engineer - Director
New York City, New York, United States
$120k-$155k/yr OnsiteFull Time
Morgan Stanley
Morgan StanleyNYSE: MS: Global financial services firm providing investment and wealth management.
Experience designing and building scalable databases and ETL pipelines using Python and SQL; knowledge of Spark, Snowflake, Databricks, DB2/Sybase/SQL Server/Postgres/Greenplum; strong communication and agile experience.
Python, SQL, Spark, Snowflake, Databricks, Power Designer, Unix, K-Shell, DB2, Sybase, SQL Server, Postgres, Greenplum
Job PostingView all
4w
Save
Mark Applied
Hide
Senior AI Platform Engineer
San Francisco or Boston or Jacksonville or New York or Windsor
$140k-$180k/yr HybridFull Time
SS&C Technologies
SS&C TechnologiesNasdaq: SSNC: Provides software and technology for financial and healthcare sectors.
5+ YOE5+ years Python experience; data engineering/distributed systems (Spark, Hive, Trino, StarRocks, DBT, Airflow, Kubernetes); LLM and agent frameworks (LangChain, LlamaIndex, DSPy, OpenAI MCP, A2A); API design (REST, GraphQL, gRPC); cloud/containerization and enterprise security.
Python, Spark, Hive, Trino, StarRocks, DBT, Airflow, Kubernetes, Docker, LangChain, LlamaIndex, DSPy, OpenAI MCP, A2A, REST, GraphQL, gRPC, pgvector, Pinecone, Weaviate, Milvus, Vespa, Kafka, Pulsar, OpenTelemetry, DataHub, MLflow, Prometheus, Hugging Face
Job PostingView all
2mo
Save
Mark Applied
Hide
Sr Data Engineer, Python + Spark (Data Federation skillset - Data Lakehouse - Eg: Starburst) - New York
New York, New York, United States
$40k-$140k/yr OnsiteFull Time
Photon: Global technology services provider.
5+ YOESenior Data Engineer with 5+ years in Python, Spark; expertise in data federation, lakehouse architectures (Delta Lake/Iceberg/Hudi); Starburst/Trino/Dremio; cloud platforms (AWS/Azure/GCP); strong SQL and data modeling.
Python, Apache Spark, Starburst Enterprise, Trino (Presto), Dremio, Delta Lake, Iceberg, Hudi, AWS, S3, Glue, Azure Databricks, ADLS, GCP, SQL, Medallion Architecture, Starburst/Trino
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Data Engineer
San Mateo or New York
$140k-$160k/yr HybridFull Time
Chartmetric
Chartmetric: Provides a global music data analytics platform for professionals.
6+ YOE6+ years building production data systems; expert Python, PostgreSQL, Apache Airflow, Clickhouse, Snowflake, Elasticsearch, Apache Spark, and AWS; bachelor's in CS/Data Engineering preferred or equivalent experience.
Python, PostgreSQL, Apache Airflow, Clickhouse, Snowflake, Elasticsearch, Apache Spark, AWS RDS, AWS
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Big Data Engineer
San Francisco or New York City or Seattle or Little Rock
$130k-$197k/yr OnsiteFull Time
LiveRamp
LiveRampNew York Stock Exchange: RAMP: Provides a platform for secure data collaboration and identity.
7+ YOE7+ years in software/data engineering; hands-on with Apache Spark, Airflow or Temporal, Dataproc, Kubernetes, Terraform, streaming (Redpanda/Kafka); on-call experience; bachelor’s in CS/Engineering/Math or equivalent.
Apache Spark, Airflow, Temporal, Dataproc, Redpanda, Kafka, Kubernetes, Terraform, Grafana, Linux, Python, Go, Java, Scala, GIT, Subversion, AWS, GCP, Azure
Job PostingView all
3mo
Save
Mark Applied
Hide
Machine Learning Engineer, Presentation and Visual Optimization (New York, NY, US, 10036)
New York, New York, United States
$124k-$150k/yr OnsiteFull Time
Paramount
ParamountNASDAQ: PSKY: Produces and distributes media content across global entertainment platforms.
3+ YOE3+ years of ML engineering or backend software experience; Python; ML frameworks (PyTorch/TensorFlow); SQL; Spark/Databricks; version control and CI/CD; production-grade code.
Python, PyTorch, TensorFlow, SQL, Spark, Databricks, Git, CI/CD
Job PostingView all
3mo
Save
Mark Applied
Hide
Staff Software Engineer - Data Bridge
Seattle or New York City or San Francisco
$189k-$331k/yr OnsiteFull Time
Rippling
Rippling: Unified platform managing workforce HR, IT, and finance operations
8+ YOE8+ years backend engineering experience; leadership on cross-functional projects; expertise building distributed services, data pipelines (Spark/Flink); strong CS fundamentals and product focus.
Apache Spark, Flink, AWS
Job PostingView all
2h
Save
Mark Applied
Hide
Database Engineer / Senior Database Engineer
New York or New York
$108k-$152k/yr HybridFull Time
TerraForm Power
TerraForm Power: Owns and operates utility-scale wind and solar energy assets.
5+ YOEBachelor's degree and 5+ years building production data platforms; strong Python and SQL skills; ETL and distributed processing experience; Databricks/Spark/Delta Lake experience preferred.
Python, SQL, Databricks, Apache Spark, Delta Lake, Streamlit, SCADA
Job PostingView all
1mo
Save
Mark Applied
Hide
Staff Data Engineer- Data Lake
New York, New York, United States
$170k-$190k/yr HybridFull Time
H1
H1: Data platform for healthcare professional insights and drug development.
8+ YOE8+ years building and scaling distributed data platforms; technical leadership and mentoring; strong Python (PySpark), Java/Scala, advanced SQL, Apache Spark, cloud-native big data (AWS EMR/Glue/S3/Athena/Redshift), orchestration (Argo/Airflow), containerization, observability, and experience with large-scale ingestion and data quality.
Apache Spark, Argo, Athena, Avro, CircleCI, Claude Code, Docker, EMR, Elastic MapReduce (EMR), Git, GitHub Copilot, Hudi, Java, JIRA, Kinesis, Kafka, Kubernetes, Ky, MAT, Microsoft Excel, Parquet, PySpark, Python, Redshift, S3, Scala, Spark, SQL, Delta, Glue, Airflow
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Machine Learning Engineer
Glendale or San Francisco or New York
$142k-$199k/yr HybridFull Time
The Walt Disney Company
The Walt Disney CompanyNYSE: DIS: Produces movies, operates theme parks, and provides streaming services.
5+ YOEExperience building and operating large-scale data/ML systems, strong distributed systems fundamentals, streaming/batch technologies (Kafka, Kinesis, Spark, Flink), Python, plus working knowledge of Java/Scala/Go/C++, cloud-native (AWS, containers, Kubernetes, IaC), observability, and collaboration skills; Bachelor's or Master's required.
Kafka, Kinesis, Spark, Flink, Python, Java, Scala, Go, C++, AWS, Kubernetes, containers, IaC tools
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Staff Data Infrastructure Engineer
New York or United States
$200k-$220k/yr RemoteFull Time
Armis
Armis: Sells an asset intelligence platform for enterprise cybersecurity risk management.
7+ YOEUS citizenship required; 7+ years in infrastructure/platform/SRE/DevOps for data-intensive systems; hands-on experience with PostgreSQL, Kafka, Spark/EMR/Hive/Trino, Linux, AWS, Kubernetes, Terraform/Helm; strong communication skills.
PostgreSQL, MongoDB, Kafka, Spark, EMR, Hive, Trino, Linux, AWS, Kubernetes, Terraform, Helm, Service Mesh, Istio
Job PostingView all
1mo
Save
Mark Applied
Hide
Cloud Data Engineer
Jersey City or United States
OnsiteFull Time
EXL
EXLNASDAQ: EXLS: Provides data analytics and digital operations solutions to businesses.
6+ YOE6+ years data engineering experience with AWS (Glue, Redshift, S3, Lambda, EMR/Spark, Kinesis, Athena, RDS, API Gateway), Python and SQL proficiency, experience with data lakes/warehouses, ETL/ELT, DevOps/CI/CD, and leadership/mentoring skills.
AWS, Glue, Redshift, S3, Lambda, EMR/Spark, Kinesis, Athena, RDS, API Gateway, Python, SQL, Shell, Scala, CloudFormation, Terraform, CI/CD
Job PostingView all
4w
Save
Mark Applied
Hide
Sr. Forward Deployed Engineer - Financial Services
New York City or San Francisco or California
$181k-$248k/yr OnsiteFull Time
Databricks
Databricks: A unified platform for data analytics and artificial intelligence.
6+ YOE6+ years in data engineering/platforms or software engineering; proficiency with Python/Scala/JavaScript/TypeScript, Apache Spark, cloud (AWS/Azure/GCP), CI/CD, MLOps; customer-facing delivery and Databricks certification; travel ~20%.
Python, Scala, JavaScript, TypeScript, Apache Spark, AWS, Azure, GCP, CI/CD, MLOps, AI APIs, Databricks, Delta Lake, MLflow
Job PostingView all
1mo
Save
Mark Applied
Hide
Data Engineer
New York City or San Francisco
OnsiteFull Time
Bedrock Robotics
Bedrock Robotics: Automates heavy construction machinery with AI retrofit kits.
5+ YOE5+ years data engineering experience in large-scale data lake/warehouse environments; strong SQL and distributed query engine experience; pipeline orchestration (Airflow/Prefect) and Spark/Databricks experience; data quality and observability expertise.
SQL, Spark, BigQuery, Snowflake, Airflow, Prefect, Databricks
Job PostingView all
2mo
Save
Mark Applied
Hide
Staff Engineer, Identity
Seattle or San Francisco or New York City or United States
HybridFull Time
Stripe
Stripe: Provides online payment processing and financial infrastructure for businesses.
10+ YOE10+ years software engineering, 5+ years technical leadership, API design/abstractions, platform development, strong communication, and cross-functional collaboration.
Ruby, Typescript, Python, Scala, Java, Go, SQL, Spark, Trino, React, GraphQL, Kafka, Protobuf, Airflow, Bazel, Temporal, Mongo, Splunk, Prometheus
Job PostingView all

Explore Jobs

Expand Your Job Search