PromotedHiringCafe
Founding Machine Learning / AI Search Engineer
Cupertino, CA, US
$160k-$310k/yr On-SiteFull Time
Build the ML and AI search behind HiringCafe — ranking, recommenders, retrieval, and LLM agents that surface jobs people would never find on their own.
Python, PyTorch, Elasticsearch, LLMs
4d
Save
Mark Applied
Hide
Spark Engineer
Atlanta, Georgia, United States
$62k-$72k/yr OnsiteFull Time
Experience designing and building integrations with Apache Spark, Spark Engine/Flow, APIs and microservices; strong Python, distributed systems, big-data (Hadoop, Hive, SQL, Kafka) and cloud (AWS/Azure/GCP) skills; CI/CD with Github Actions, Docker, Kubernetes.
Apache Spark, Spark Engine, Spark Flow, Python, Hadoop, Hive, SQL, Kafka, AWS, Azure, GCP, Github Actions, Docker, Kubernetes
2mo
Save
Mark Applied
Hide
Apache Spark Developer
Herndon or Springfield or St. Louis or Aurora
$150k-$225k/yr OnsiteFull Time
5+ YOETS/SCI eligibility preferred, Bachelor\u0002s plus 5+ years in data engineering or Spark development, strong Spark and PySpark experience, Python, large-scale data processing, performance tuning, Kubernetes/Docker familiarity.
Apache Spark, PySpark, Scala, Delta Lake, Parquet, Structured Streaming, Kubernetes, Docker, S3, AWS, GCP, Azure, Git, Jenkins, Python, Bash, Terraform, Iceberg
2mo
Save
Mark Applied
Hide
Spark Engineer
Sunnyvale, California, United States
OnsiteFull Time
5+ YOE5+ years in software development; data engineering with pipelines; Python/Perl/Shell; Java; Oracle/MySQL; real-time pipelines with Kafka/Storm.
Python, Perl, Shell, Java, Oracle, MySQL, Kafka, Storm, HDFS, Hive, Pig, Oozie, HBase, Spark
2d
Save
Mark Applied
Hide
Senior Data Engineer - Hadoop/Spark/OCP/Big Data
Pittsburgh or Strongsville or Denver or Phoenix or Birmingham or Dallas
$50k-$186k/yr OnsiteFull Time
5+ YOEDesign and maintain scalable data pipelines with Spark/SQL; containerize workloads; optimize Spark performance; CI/CD and data governance experience; 5+ years industry experience.
Hadoop, Spark, SQL, Docker, Kubernetes, OCP, S3, ADLS, Apache Iceberg, Jenkins, GitHub, Bitbucket, Azure DevOps
1w
Save
Mark Applied
Hide
Lead Data Engineer - Pipelines, Spark Streaming and Spark Offline
Tampa, Florida, United States
OnsiteFull Time
5+ YOE5+ years applied data engineering experience; strong Python/PySpark; experience with Spark/Flink, Databricks, AWS Glue/EMR, batch and real-time pipelines, and distributed system design; AI-assisted workflow experience.
Python, PySpark, Spark, Spark Streaming, Spark Offline, Flink, Databricks, Data brick live tables, Amazon Web Services (AWS), AWS Glue, EMR, Glue, Lamida, Flask, AWS EKS, Kubernetes, Docker, Hadoop, Kafka, NoSQL, relational database
2mo
Save
Mark Applied
Hide
Senior Data Engineer – Enterprise Data Frameworks (Java Spark Focus)
United States
$120k-$160k/yr HybridFull Time
7+ YOE7+ years in data engineering with Java and Apache Spark; experience building Spark batch/streaming jobs; data lake knowledge (Iceberg/Parquet); Spring Boot, REST APIs; CI/CD, Docker/Kubernetes; cloud exposure (AWS); strong collaboration; optional familiarity with Generative AI tools.
Java, Apache Spark, Spring Boot, RESTful APIs, Microservices, CI/CD, Git, Docker, Kubernetes, AWS
2mo
Save
Mark Applied
Hide
MID-LEVEL DATA ENGINEER-Python, AWS, Spark (Hybrid)
Bloomington or Richardson or Tempe or Dunwoody
HybridFull Time
2+ YOE2-4 years as a Data Engineer; proficiency in Python, Spark SQL/PySpark, R, Java, Bash; hands-on AWS (ETL tools, Lambda, Step Functions, S3, DynamoDB, Kinesis, Redshift, SageMaker); Spark/Databricks; IaC (OpenTofu); CI/CD with Airflow.
Python, Apache Spark, PySpark, R, Java, Bash, AWS, Glue, EMR Serverless, Lambda, Step Functions, EventBridge, S3, DynamoDB, Kinesis Firehose, Redshift, Iceberg, SageMaker, Databricks, OpenTofu, Terraform, Airflow, SQL, Athena
2mo
Save
Mark Applied
Hide
Senior Data Engineer (Apache Spark, NiFi, SQL)
O'Fallon, Missouri, United States
$140k-$231k/yr OnsiteFull Time
6+ YOE6+ years in data warehouse/big data, Spark with Scala/Python/Java, NiFi pipelines; experience with Oracle/Netezza; strong debugging, communication, and collaboration.
Apache Spark, NiFi, SQL, Hadoop, Scala, Python, Java, Oracle, Netezza
1w
Save
Mark Applied
Hide
Data Engineer
Chicago, Illinois, United States
$100k-$115k/yr HybridFull Time
3+ YOE3+ years data engineering with Spark on cloud, hands-on Azure Databricks (PySpark/Scala, Spark SQL, Delta Lake), Azure Data Factory, strong SQL, data quality tooling (Great Expectations/Deequ), IaC (Terraform/Bicep), CI/CD and DevOps for data.
Spark, Azure Databricks, PySpark, Scala, Spark SQL, Delta Lake, Unity Catalog, Databricks Jobs, Delta Live Tables, Azure Data Factory, ADLS Gen2, Key Vault, SQL, Great Expectations, Deequ, Git, pytest, dbx, Azure DevOps, GitHub Actions, Terraform, Bicep, Azure Monitor, Log Analytics, Photon
3mo
Save
Mark Applied
Hide
Data Engineer
Reston, Virginia, United States
HybridFull Time
5+ YOEBachelor’s in CS/Engineering or equivalent; 5+ years data engineering in cloud; SQL and Python/Rust/Java; data pipelines (Kafka, Flink, Beam, Spark); data stores for AI; Google Cloud certs; US citizen.
Python, SQL, Kafka, Flink, Beam, Spark, Airflow, Google Cloud Platform, BigQuery, Dataflow, Pub/Sub, Cloud Composer, PostgreSQL, Firestore, MongoDB, Neo4j
1w
Save
Mark Applied
Hide
Data Engineer
United States
$78k-$120k/yr RemoteFull Time
2+ YOEBachelor's in CS or equivalent,2+ years data engineering,experience with Databricks,Spark,Python/Scala/SQL,Hadoop/Kafka,semantic layer and data quality frameworks.
Databricks, Spark, Python, Scala, SQL, Oracle, MySQL, PostgreSQL, Hadoop, Kafka, Pig, Microsoft Word, Microsoft Excel, Microsoft PowerPoint
4w
Save
Mark Applied
Hide
Data Engineer
New York City or San Francisco
OnsiteFull Time
5+ YOE5+ years data engineering experience in large-scale data lake/warehouse environments; strong SQL and distributed query engine experience; pipeline orchestration (Airflow/Prefect) and Spark/Databricks experience; data quality and observability expertise.
SQL, Spark, BigQuery, Snowflake, Airflow, Prefect, Databricks
2mo
Save
Mark Applied
Hide
Data Engineer
Bellevue, Washington, United States
$125k-$140k/yr OnsiteFull Time
4+ YOE4+ years in data engineering; expert Python and advanced SQL; Databricks, Spark, Delta Lake; Azure data services; REST/Graph APIs; strong communication and ownership of data systems.
Databricks, Spark, Delta Lake, Azure Data Lake Storage, Azure Key Vault, ADF, Synapse, Git, Azure DevOps, Python, SQL, Tableau, Power BI, Unity Catalog
3w
Save
Mark Applied
Hide
Data Engineer
Rockville, Maryland, United States
OnsiteFull Time
Bachelor's in CS/data-related field or equivalent experience; proven data engineering experience with Python, SQL, ETL/ELT, Spark/PySpark, data modeling, data quality, and Git; familiarity with cloud data platforms and biomedical data is a plus.
Python, SQL, Spark, PySpark, Git, Snowflake, Databricks, Posit Connect, R/Shiny, Streamlit, Jupyter, Galaxy, Code Ocean, S3, Postgres, APIs
1d
Save
Mark Applied
Hide
Data Engineer
United States
$88k-$155k/yr RemoteFull Time
3+ YOEActive Secret clearance; Bachelor's in CS/Data Engineering/Info Systems; 3+ years data engineering experience; proficiency with SQL, Python, Spark, cloud platforms; experience building scalable ETL pipelines and metadata management.
SQL, Python, Spark, AWS, Azure, Postgres, MongoDb, MySQL, Neo4j, Docker, Kubernetes
1mo
Save
Mark Applied
Hide
Data Engineer
The Woodlands, Texas, United States
OnsiteFull Time
3+ YOEBachelor's in MIS, CS, Engineering, IT or related; 3+ years data-focused experience; Databricks, Spark/SQL; Power BI/Tableau experience preferred.
Databricks, Delta Live Tables, Spark, SQL, Power BI, Tableau
3mo
Save
Mark Applied
Hide
Data Engineer
Houston, Texas, United States
OnsiteFull Time
3+ YOE3+ years data engineering, ETL, SQL, Python; Big Data tools; CI/CD; Linux; Tableau; Mandarin; REST APIs; Hadoop/Kudu/Hive/Kafka/Spark/Flink.
Cicada, Tableau, SQL, Python, Hadoop, Kudu, Hive, Kafka, Spark, Flink, GitLab, JIRA, REST APIs, Linux, CentOS, RedHat, Ubuntu, ETL, Big Data
1mo
Save
Mark Applied
Hide
Data Engineer
Halifax or Alpharetta
$80k-$100k/yr HybridFull Time
5+ YOE5+ years data engineering; 3+ years Databricks/Delta Lake; strong Azure data platform; Spark/PySpark/SQL; Medallion/Lakehouse; data governance; security/CI/CD/IaC; MLOps; communication.
Azure Databricks, Delta Lake, ADF, Azure Synapse, Event Hubs, Azure Functions, Azure Data Lake Storage Gen2, Azure Key Vault, DevOps, Spark, PySpark, SQL, MLflow, Unity Catalog, Bicep, Terraform, ARM templates, Copilot, GenAI, Power BI
1mo
Save
Mark Applied
Hide
Data Engineer
Washington, District of Columbia, United States
$142k-$236k/yr OnsiteFull Time
7+ YOE7+ years data engineering experience; expertise in distributed processing (Spark), ETL/ELT, SQL and Python; Azure ecosystem experience; data governance and preparing data for AI/ML; TS/SCI clearance required.
Spark, Kafka, Trino, Iceberg, SQL, Python, Azure OpenAI, Azure Synapse, Databricks, Azure Security Center, ClickHouse, OpenSearch
3mo
Save
Mark Applied
Hide
Data Engineer
Chantilly or Herndon or McLean
OnsiteFull Time
5+ YOE5+ years in data engineering; TS/SCI with Poly; BS in CS or related; SQL, Spark, ETL/ELT; cloud platforms; Python/Scala/Java.
SQL, PostgreSQL, MySQL, SQL Server, Spark, Hadoop, Apache Airflow, Informatica, AWS, Azure, GCP, Python, Scala, Java, Snowflake, Redshift, BigQuery
Explore Jobs