PromotedHiringCafe
Founding Machine Learning / AI Search Engineer
Cupertino, CA, US
$160k-$310k/yr On-SiteFull Time
Build the ML and AI search behind HiringCafe — ranking, recommenders, retrieval, and LLM agents that surface jobs people would never find on their own.
Python, PyTorch, Elasticsearch, LLMs
1mo
Save
Mark Applied
Hide
Senior Big Data Engineer
San Francisco or New York City or Seattle or Little Rock
$130k-$197k/yr OnsiteFull Time
7+ YOE7+ years in software/data engineering; hands-on with Apache Spark, Airflow or Temporal, Dataproc, Kubernetes, Terraform, streaming (Redpanda/Kafka); on-call experience; bachelor’s in CS/Engineering/Math or equivalent.
Apache Spark, Airflow, Temporal, Dataproc, Redpanda, Kafka, Kubernetes, Terraform, Grafana, Linux, Python, Go, Java, Scala, GIT, Subversion, AWS, GCP, Azure
2mo
Save
Mark Applied
Hide
Senior Lead Data Engineer
New York, New York, United States
$251k-$286k/yr OnsiteFull Time
6+ YOE6+ years in application development; 2+ years in big data; 1+ year cloud computing (AWS/Azure/GCP).
Java, Scala, Python, SQL, Redshift, Snowflake, MongoDB, Cassandra, Hadoop, Hive, Spark, Kafka, Gurobi, Unix/Linux, Shell Scripting, AWS, Azure, Google Cloud, MapReduce, NoSQL
1mo
Save
Mark Applied
Hide
Lead Software Engineer - Big Data
Rockville or Washington or Tysons or Colorado or Florida or Texas or Illinois or Pennsylvania or Massachusetts or Maryland or Virginia or New York or New Jersey
$114k-$249k/yr HybridFull Time
7+ YOEBachelor's in CS or related + 7+ years experience; deep Big Data (Hadoop, Spark, Hive, Trino), SQL, AWS (S3, EMR, Glue, Lambda, Athena, EKS), Python/Scala, system design, CI/CD, DevOps, security, and team mentoring experience.
Hadoop, Spark, Hive, Trino, SQL, S3, EMR, Glue, Lambda, Athena, EKS, Python, Scala, GitHub Copilot, Q Developer, ChatGPT, Claude, Scrum, Kanban, CI/CD, DevOps
1mo
Save
Mark Applied
Hide
Lead Data Engineer
Cary or Bridgewater or New York
$120k-$176k/yr HybridFull Time
8+ YOE8+ years data solutions experience with 4+ years in Azure/Databricks; strong SQL, Spark, Scala/Python, Big Data (Hive/HBase), Azure services, ETL/warehousing, CI/CD, data governance, and leadership/mentoring experience.
Microsoft Azure, Microsoft Azure Databricks, Databricks, Apache Spark, SQL, Scala, Python, Hive, HBase, Microsoft Azure Functions, Microsoft Cosmos DB, Microsoft Azure Data Factory, Delta Lake, Shell, Bash, Microsoft PowerShell, Microsoft Event Hub, Oracle, Microsoft SQL Server, CI/CD
3w
Save
Mark Applied
Hide
Senior Data Engineer
Brazil or New York City
$75k-$92k/yr RemoteFull Time
5+ YOE5+ years in data engineering building big data pipelines, Spark and strongly-typed language experience (Scala/Java), REST API design, Git, unit/integration testing, and 3+ years in agile environments.
Scala, Apache Spark, Python, Airflow, ScyllaDB, PostgreSQL, ClickHouse, Hive, Redis, Kafka, Kafka Connect, Docker, Jenkins, Terraform, AWS, Git
4d
Save
Mark Applied
Hide
Staff Engineer - Data Engineering
Chicago or Scottsdale or San Francisco or New York City
$145k-$223k/yr HybridFull Time
8+ YOEBachelor's degree in CS or related,8+ years relevant experience building data platforms,experience with data warehouse, big data, ETL, cloud, AI/ML lifecycle, and delivering production systems.
Python, Spark, PySpark, R, Data Robot, Pub/Sub, Kafka, RabbitMQ, Google Cloud Platform, AWS, Azure, Tensorflow, Sage Maker, Scikit, PyCharm, Cloudera, S3, Scality S3, HDFS, Elastic Search, Oracle, SQL Server, IBM Infosphere, AppDynamics, Kubernetes
1w
Save
Mark Applied
Hide
Data Scientist & Engineer
New York, New York, United States
$85k-$110k/yr OnsiteFull Time
3+ YOEMaster's in a quantitative field and 3 years' data science/machine learning experience; proficiency in Python or R, scikitlearn, big data tools (Hadoop/Spark), SQL and NoSQL; strong software engineering, deployment, and communication skills.
Python, R, scikitlearn, Hadoop, MapReduce, Spark, SQL, MongoDB
1mo
Save
Mark Applied
Hide
Senior Cybersecurity Data Engineer
Columbus or Frisco or Berkeley Heights or Alpharetta or New Jersey or New York or United States
$109k-$182k/yr OnsiteFull Time
10+ YOE10+ years IT experience (5+ years Big Data), 5+ years building data transformation/pipeline processes, SQL and BigQuery proficiency, experience with Talend/Cribl/Spark/Kafka/PostgreSQL/AlloyDB, bachelor’s in CS/IT or equivalent military experience, and valid unrestricted U.S. work authorization.
Talend, BigQuery, SQL, Cribl, Spark, IBM Streams, Kafka, PostgreSQL, AlloyDB, NoSQL
1d
Save
Mark Applied
Hide
Data Engineer II, GTPC Tech, Compliance & Assurance, AWS Security
New York, New York, United States
$145k-$197k/yr OnsiteFull Time
3+ YOE3+ years data engineering experience building ETL pipelines, data modeling/warehousing, complex SQL, and programming (Python or similar); experience with distributed data systems and AWS big data technologies.
S3, EC2, RDS, Redshift, Kinesis, EMR, Lambda, Glue, Apache Airflow, Athena, IAM, Python, Ruby, Golang, Java, C++, C#, Rust, Perl, PostgreSQL, SQL Server, MySQL
2w
Save
Mark Applied
Hide
Director, Data Engineering
New York, New York, United States
$165k-$210k/yr OnsiteFull Time
8+ YOE8+ years in data engineering; experience with cloud platforms, data warehouses, SQL/NoSQL, big data technologies, programming in Python/Java/Scala, team management, and media data platforms.
Python, Java, Scala, AWS, Google Cloud, Azure, Redshift, Snowflake, Databricks, PostgreSQL, MongoDB, BigQuery, Hadoop, Spark, Kafka, SQL, NoSQL, Tableau, Looker, Jira, Confluence
1d
Save
Mark Applied
Hide
Data and Cloud Engineer
New York City, New York, United States
$190k-$193k/yr HybridFull Time
5+ YOEBachelor's in CS/Engineering plus 5 years software engineering (or Master's plus 3 years). Experience with SQL scripting, big data stack (HDFS,YARN,Spark,Hive,Sqoop,Impala,Airflow,Zookeeper,Kafka), GitHub/CI/CD, ETL, cloud platforms and Python frameworks.
SQL scripting, HDFS, YARN, Apache Spark, Spark, Hive, Sqoop, Impala, Airflow, Zookeeper, Kafka, Apache Hadoop, Elastic Search, GitHub, CI/CD, Snowflake, AWS, GCP, Databricks, Python, Django, Flask, PowerShell
1mo
Save
Mark Applied
Hide
Staff Data Engineer- Data Lake
New York, New York, United States
$170k-$190k/yr HybridFull Time
8+ YOE8+ years building and scaling distributed data platforms; technical leadership and mentoring; strong Python (PySpark), Java/Scala, advanced SQL, Apache Spark, cloud-native big data (AWS EMR/Glue/S3/Athena/Redshift), orchestration (Argo/Airflow), containerization, observability, and experience with large-scale ingestion and data quality.
Apache Spark, Argo, Athena, Avro, CircleCI, Claude Code, Docker, EMR, Elastic MapReduce (EMR), Git, GitHub Copilot, Hudi, Java, JIRA, Kinesis, Kafka, Kubernetes, Ky, MAT, Microsoft Excel, Parquet, PySpark, Python, Redshift, S3, Scala, Spark, SQL, Delta, Glue, Airflow
5d
Save
Mark Applied
Hide
Data Engineer I-Pathology Molecular and Cell Based Medicine
New York, New York, United States
$85k-$109k/yr OnsiteFull Time
2+ YOEBachelor's in computer science or related,2+ years development experience (Linux preferred),strong SQL/NoSQL and big‑data stack knowledge,proficiency with 2+ languages and RESTful services.
LINUX, Oracle, PostgreSQL, MYSQL, Mongo DB, Scala, Python, Java, Node JS, Django, PHP, Hadoop, Spark, Kafka, Azure, AWS, JIRA, Microsoft Office Suite
1mo
Save
Mark Applied
Hide
Software Engineer (L3) Data Substrate
United States or Colorado or Hawaii or Illinois or Maryland or Massachusetts or Minnesota or New Jersey or New York or Vermont or District of Columbia or Washington or California or San Francisco or Oakland or San Jose or Washington
$139k-$204k/yr RemoteFull Time
5+ YOEBachelor's or Master's in CS/Engineering, 5+ years software development, proficiency in Python/Java/Scala, experience with big data tools (Kafka, Spark, Hive, Hudi, Presto, Airflow) and AWS services, strong problem-solving and communication skills.
Kafka, Spark, Hive, Hudi, Presto, Airflow, AWS Lakeformation, Glue, Athena, Python, Java, Scala
5d
Save
Mark Applied
Hide
Data Engineer I-Pathology Molecular and Cell Based Medicine
New York, New York, United States
$85k-$109k/yr OnsiteFull Time
2+ YOEBachelor's in Computer Science or related; 2+ years development experience (Linux preferred); strong SQL/NoSQL knowledge; proficiency in 2+ languages (Scala, Python, Java); experience with REST, microservices, big-data stacks, cloud (Azure/AWS).
LINUX, Oracle, PostgreSQL, MySQL, Mongo DB, Scala, Python, Java, Node JS, Django, PHP, Hadoop, Spark, Kafka, JIRA, Azure, AWS
3w
Save
Mark Applied
Hide
Lead Data Platform Engineer - 11623
New York, New York, United States
$125k-$174k/yr RemoteFull Time
8+ YOEBachelor's degree and 8+ years managing big data technologies and pipelines; 5+ years cloud (AWS/Azure); Linux administration; MLOps/LLM operations; Bash/Python; containerization; IaC and automation tools.
S3, IAM, EMR, Redshift, ECS, Docker, Amazon ECS, EKS, Azure AKS, Terraform, Chef, Ansible, Jenkins, Rundeck, Git, helm charts, Bash, Python, Linux, ApacheSpark, MySQL Server, Looker
2w
Save
Mark Applied
Hide
Senior Software Engineer, Distributed Data Systems
New York, New York, United States
$200k-$350k/yr OnsiteFull Time
4+ YOE4+ years in data systems/backend/platform engineering; proficiency in Haskell and/or TypeScript; experience with distributed and big data systems (Apache Spark, Hadoop); strong algorithms and query optimization skills.
Haskell, TypeScript, Apache Spark, Hadoop
2mo
Save
Mark Applied
Hide
Data Driven Marketing Analyst - Audience Design
New York, New York, United States
$89k/yr HybridFull Time
1+ YOEBachelor's degree; 1-2 years data analytics experience; proficiency in Python/R, SQL, Excel; experience with big data tools; able to build datasets and develop statistical models.
AWS, Python, R, SQL, Excel, IBM SPSS
1mo
Save
Mark Applied
Hide
Kafka Engineer (New York, NY, US)
New York, New York, United States
$80k-$106k/yr OnsiteFull Time
Big Data, Kafka, Flink, S3, Glue, Kinesis; Docker, Kubernetes; AWS, Azure; Linux, Bash; problem solving and coding skills.
S3, Lake Formation, Glue, Kafka, Flink, Kinesis, Docker, Kubernetes, AWS, Azure, Linux, Bash, Command Line Tools
3w
Save
Mark Applied
Hide
Director, Software Engineer
New York, New York, United States
$163k-$165k/yr HybridFull Time
3+ YOEMaster's in computer/electrical engineering, 3+ years relevant experience, proficiency with GUI and backend development, fixed income/interest rate derivatives knowledge, big data, cloud/DevOps, Java/J2EE/Scala/C#/Python, Spring, JSON, Sybase/Oracle, Bash, Git.
Graphical User Interface, Big data, Cloud, DevOps, Java, J2EE, Scala, C#, Spring, JSON, Python, Sybase, Oracle, Bash, Git, Treadmill
Explore Jobs
Expand Your Job Search
Top Cities in New York for Big Data Developer
- Big Data Developer jobs in New York, NY
- Big Data Developer jobs in Brooklyn, NY
- Big Data Developer jobs in Queens, NY
- Big Data Developer jobs in Manhattan, NY
- Big Data Developer jobs in The Bronx, NY
- Big Data Developer jobs in Staten Island, NY
- Big Data Developer jobs in Buffalo, NY
- Big Data Developer jobs in Rochester, NY
- Big Data Developer jobs in Yonkers, NY
- Big Data Developer jobs in Syracuse, NY
- Big Data Developer jobs in Amherst, NY
- Big Data Developer jobs in Albany, NY
- Big Data Developer jobs in Greenburgh, NY
- Big Data Developer jobs in New Rochelle, NY
- Big Data Developer jobs in Cheektowaga, NY
- Big Data Developer jobs in Mount Vernon, NY
- Big Data Developer jobs in Schenectady, NY
- Big Data Developer jobs in Utica, NY
- Big Data Developer jobs in White Plains, NY
- Big Data Developer jobs in Clay, NY