22 batch data engineer jobs at 18 companies in White Plains, NY
🚀PromotedHiringCafe
Founding Machine Learning / AI Search Engineer
Cupertino, CA, US
$160k-$310k/yrOn-SiteFull Time
HiringCafe: Building a 100× better job search engine to take on Indeed and LinkedIn.
Build the ML and AI search behind HiringCafe — ranking, recommenders, retrieval, and LLM agents that surface jobs people would never find on their own.
5+ YOE5+ years data engineering experience, strong dbt and Databricks skills, Python/PySpark, streaming and batch ingestion, CDC pipelines, data quality and observability, and experience integrating with operational systems.
dbt, Databricks, Delta Lake, Delta Live Tables, Python, PySpark, Salesforce, NetSuite, Stripe, Mulesoft, Great Expectations, Unity Catalog, Airflow, Cloud Run, Cloud Functions, BigQuery, AWS, GCP, Terraform, Spacelift, Boomi
Digital - Senior Data Engineer / Data Engineer, Digital Technology
Seattle or Vancouver or Toronto or New York City or Los Angeles
$100k-$300k/yrOnsiteFull Time
AritziaToronto Stock Exchange: ATZ: Designs and sells everyday luxury women's clothing and accessories.
Design and optimize scalable batch and real-time data pipelines; build ETL/ELT workflows; deliver governed data models; enforce data quality, governance, privacy, and security; mentor junior engineers.
SQL, Google Cloud Platform (GCP), BigQuery, Snowflake, Redshift, Airflow, Pub/Sub, Customer Data Platform (CDP)
Linero: AI-native, venture-backed building data infrastructure software.
5+ YOE5+ years data engineering; Airflow, dbt, Spark; streaming and batch processing; ontology design; multi-tenant, high-security data environments; based in or relocate to New York City.
Beast Industries: Produces digital media and consumer goods for MrBeast brands.
8+ YOE8+ years building production data platforms, expertise in batch and streaming pipelines, data modeling, ETL/ELT, reliability, observability, and privacy-safe foundations for AI/ML.
DRW: Technology-driven principal trading firm operating in global financial markets
5+ YOE5+ years designing ingestion pipelines for batch and real-time market data; experience with equities/futures data, data quality frameworks, observability, on-prem Linux and cloud, CI/CD and MLOps; Parquet/Iceberg familiarity.
Hack The Box: Provides a gamified platform for cybersecurity training and upskilling.
Experienced in designing and operating GCP-native batch and streaming data pipelines, strong SQL and Python, Airflow orchestration, ClickHouse/OLAP, Kafka/Pub/Sub streaming, dbt and data quality practices.
Appgate: Provides zero trust cybersecurity and AI-driven fraud prevention solutions.
Extensive experience building and operating large-scale data platforms and lakes; hands-on expertise with Apache Spark and Apache Flink; strong production engineering skills including Kubernetes and CI/CD; experience with batch and streaming pipelines.
Balyasny Asset Management: Global multi-strategy investment firm managing diverse financial assets.
3+ YOE3+ years backend development experience (Python preferred), experience building data platforms (batch/streaming ETL, data lake/warehouse/lakehouse), distributed systems, cloud tools, and performance optimization; strong communication skills.
Member of Technical Staff (Software Engineer, Data Platform)
San Francisco or New York City or Palo Alto
$220k-$405k/yrOnsiteFull Time
Perplexity: AI-powered search engine providing conversational answers with citations.
5+ YOE5+ years software engineering experience (8+ for staff), production data infrastructure and batch/streaming experience, Airflow/Dagster, Python plus another backend language (Go/TypeScript), ML/AI workflow support, data quality and observability knowledge.
Balyasny Asset Management: Global multi-strategy investment firm managing diverse alternative asset classes.
3+ YOE3+ years backend development experience (Python preferred). Experience building data platforms (batch and streaming ETL, data lake/warehouse/lakehouse), Parquet and related tools, distributed systems, Git, Docker/Kubernetes, and supporting macro trading businesses.
Data Lead Software Engineer – Python, Pyspark and AWS
New York or Jersey City
$152k-$215k/yrOnsiteFull Time
JPMorgan ChaseNYSE: JPM: Global financial services firm providing banking and investment solutions.
3+ YOE3+ years applied software engineering experience; strong Python and PySpark skills; experience designing batch and streaming data pipelines on AWS (Lambda, S3, Glue, Step Functions, Airflow); advanced SQL and NoSQL knowledge; CI/CD experience (Git, Jenkins, Maven); understanding of AI-assisted engineering and responsible AI practices.
Vertical Relevance: Provides AWS cloud consulting for the financial services industry.
8+ YOE8+ years AWS data engineering/architecture experience, strong SQL Server expertise, experience with AWS DMS/SCT and Terraform, Python and data tooling experience, and strong client-facing communication skills.
The Walt Disney CompanyNYSE: DIS: Produces movies, operates theme parks, and provides streaming services.
5+ YOEExperience building and operating large-scale data/ML systems, strong distributed systems fundamentals, streaming/batch technologies (Kafka, Kinesis, Spark, Flink), Python, plus working knowledge of Java/Scala/Go/C++, cloud-native (AWS, containers, Kubernetes, IaC), observability, and collaboration skills; Bachelor's or Master's required.
Millennium Management: Global alternative investment firm managing diverse investment strategies.
4+ YOEBachelor's in CS/Engineering/Math/Physics, 4+ years software or quant engineering experience. Strong Python, web frameworks (FastAPI/Flask), React/Angular, NumPy/Pandas/PyTorch, SQL, AWS, data visualization, and agentic tooling experience.
New York City or Seattle or Los Angeles or Los Gatos
$388k-$558k/yrOnsiteFull Time
NetflixNASDAQ: NFLX: Provider of global streaming entertainment and video content.
Experience designing and operating large-scale identity graphs and identity resolution (deterministic & probabilistic) in batch and near-real-time; familiarity with ad tech, data governance/privacy, and big data tools such as Spark.
EPAM SystemsNYSE: EPAM: Provides global digital platform engineering and software development services.
4+ YOE4+ years Oracle/SQL experience, MxTest automation, EOD batch validation with Tidal, Sybase-Oracle data reconciliation, and defect management with Jira/Zephyr; flexible across time zones.
NetflixNASDAQ: NFLX: Global video streaming and media production service.
Experience in designing scalable batch and streaming data onboarding systems; proficiency in Java, Python, C++, or similar; familiarity with Kafka, Flink; big data tools like Spark; distributed cloud applications; knowledge of ad tech and privacy considerations.
BrazeNASDAQ: BRZE: Platform for personalized customer engagement and cross-channel messaging.
Expert in distributed system design, enterprise integrations (batch, real-time, streaming), data strategy and governance, stakeholder management, and change management for large-scale marketing platforms.