HiringCafe
Join our community

22 batch data engineer jobs at 18 companies in Queens, NY

PromotedHiringCafe
Founding Machine Learning / AI Search Engineer
Cupertino, CA, US
$160k-$310k/yr On-SiteFull Time
HiringCafe
HiringCafe: Building a 100× better job search engine to take on Indeed and LinkedIn.
Build the ML and AI search behind HiringCafe — ranking, recommenders, retrieval, and LLM agents that surface jobs people would never find on their own.
Python, PyTorch, Elasticsearch, LLMs
Help us #BeatIndeed & #BeatLinkedIn
1mo
Save
Mark Applied
Hide
Lead Data Engineer
New Brunswick or United States or North America
$170k-$190k/yr HybridFull Time
Johnson & Johnson
Johnson & JohnsonNYSE: JNJ: Global healthcare providing pharmaceuticals and medical technologies.
5+ YOEBachelor's in CS/Engineering or related and 5+ years' data engineering experience. Experience designing architecture, building batch and real-time data pipelines, integrating ML models, coaching engineers, and optimizing data infrastructure.
Job PostingView all
1mo
Save
Mark Applied
Hide
Digital - Senior Data Engineer / Data Engineer, Digital Technology
Seattle or Vancouver or Toronto or New York City or Los Angeles
$100k-$300k/yr OnsiteFull Time
Aritzia
AritziaToronto Stock Exchange: ATZ: Designs and sells everyday luxury women's clothing and accessories.
Design and optimize scalable batch and real-time data pipelines; build ETL/ELT workflows; deliver governed data models; enforce data quality, governance, privacy, and security; mentor junior engineers.
SQL, Google Cloud Platform (GCP), BigQuery, Snowflake, Redshift, Airflow, Pub/Sub, Customer Data Platform (CDP)
Job PostingView all
2mo
Save
Mark Applied
Hide
Principal Data Engineer
Boulder or New York
$200k-$240k/yr HybridFull Time
Sovrn
Sovrn: Provides software and data tools for digital publishers to monetize.
10+ years software/data engineering; 5+ years adtech data infra; real-time streaming/batch pipelines; AWS; AI/agentic tooling experience.
Python, PySpark, Kafka, Databricks, AWS
Job PostingView all
2mo
Save
Mark Applied
Hide
Senior Data Engineer
New York City, New York, United States
$160k-$250k/yr OnsiteFull Time
Linero
Linero: AI-native, venture-backed building data infrastructure software.
5+ YOE5+ years data engineering; Airflow, dbt, Spark; streaming and batch processing; ontology design; multi-tenant, high-security data environments; based in or relocate to New York City.
Airflow, dbt, Spark
Job PostingView all
4w
Save
Mark Applied
Hide
Senior Data Engineer
San Francisco or New York City
HybridFull Time
Beast Industries
Beast Industries: Produces digital media and consumer goods for MrBeast brands.
8+ YOE8+ years building production data platforms, expertise in batch and streaming pipelines, data modeling, ETL/ELT, reliability, observability, and privacy-safe foundations for AI/ML.
Job PostingView all
1mo
Save
Mark Applied
Hide
Equities Data Engineer
Chicago or New York City
$175k-$200k/yr OnsiteFull Time
DRW
DRW: Technology-driven principal trading firm operating in global financial markets
5+ YOE5+ years designing ingestion pipelines for batch and real-time market data; experience with equities/futures data, data quality frameworks, observability, on-prem Linux and cloud, CI/CD and MLOps; Parquet/Iceberg familiarity.
Parquet, Iceberg, Linux, CI/CD, MLOps
Job PostingView all
16h
Save
Mark Applied
Hide
Senior Data Engineer
United States or New York
$140k-$160k/yr RemoteFull Time
Hack The Box
Hack The Box: Provides a gamified platform for cybersecurity training and upskilling.
Experienced in designing and operating GCP-native batch and streaming data pipelines, strong SQL and Python, Airflow orchestration, ClickHouse/OLAP, Kafka/Pub/Sub streaming, dbt and data quality practices.
GCP, BigQuery, Bigtable, Cloud Storage, Pub/Sub, Kafka, Dataflow (Apache Beam), Flink, Spark, Airflow (Cloud Composer), ClickHouse, Python, SQL, dbt, Docker, Kubernetes, GitHub Actions, Snowflake, Datastream, Debezium, Vertex AI
Job PostingView all
1mo
Save
Mark Applied
Hide
Staff / Principal Data Engineer
New York, New York, United States
$180k-$270k/yr HybridFull Time
Appgate
Appgate: Provides zero trust cybersecurity and AI-driven fraud prevention solutions.
Extensive experience building and operating large-scale data platforms and lakes; hands-on expertise with Apache Spark and Apache Flink; strong production engineering skills including Kubernetes and CI/CD; experience with batch and streaming pipelines.
Apache Spark, Apache Flink, Kubernetes, CI/CD
Job PostingView all
2mo
Save
Mark Applied
Hide
Senior Software Engineer, Data
New York, New York, United States
$225k-$300k/yr OnsiteFull Time
CLEAR
CLEARNYSE: YOU: Secure biometric identity platform for travel and venue access
6+ YOE6+ years data engineering; strong Python/SQL; experience with batch/streaming pipelines; cloud AWS; data platforms; IAM/secrets; IaC; CI/CD.
Python, SQL, Dagster, Airflow, dbt, Snowflake, Spark, Kafka, Databricks, Terraform, Pulumi, GitHub
Job PostingView all
2w
Save
Mark Applied
Hide
Engineer, Macro and Fixed Income Data Technology
New York, New York, United States
$150k-$200k/yr OnsiteFull Time
Balyasny Asset Management
Balyasny Asset Management: Global multi-strategy investment firm managing diverse financial assets.
3+ YOE3+ years backend development experience (Python preferred), experience building data platforms (batch/streaming ETL, data lake/warehouse/lakehouse), distributed systems, cloud tools, and performance optimization; strong communication skills.
Python, Parquet, AWS Glue, Delta Lake, AWS Athena, Spark, Git, Docker, Kubernetes, Bloomberg, Reuters
Job PostingView all
1mo
Save
Mark Applied
Hide
Member of Technical Staff (Software Engineer, Data Platform)
San Francisco or New York City or Palo Alto
$220k-$405k/yr OnsiteFull Time
Perplexity
Perplexity: AI-powered search engine providing conversational answers with citations.
5+ YOE5+ years software engineering experience (8+ for staff), production data infrastructure and batch/streaming experience, Airflow/Dagster, Python plus another backend language (Go/TypeScript), ML/AI workflow support, data quality and observability knowledge.
Databricks, Snowflake, Spark, Kafka, Flink, Airflow, Dagster, dbt, Iceberg, Delta Lake, ClickHouse, Kinesis, PubSub, Python, Go, TypeScript
Job PostingView all
2w
Save
Mark Applied
Hide
Engineer, Macro and Fixed Income Data Technology
New York, New York, United States
$150k-$200k/yr OnsiteFull Time
Balyasny Asset Management
Balyasny Asset Management: Global multi-strategy investment firm managing diverse alternative asset classes.
3+ YOE3+ years backend development experience (Python preferred). Experience building data platforms (batch and streaming ETL, data lake/warehouse/lakehouse), Parquet and related tools, distributed systems, Git, Docker/Kubernetes, and supporting macro trading businesses.
Python, Parquet, AWS Glue, Delta Lake, AWS Athena, Spark, Git, Docker, Kubernetes, Bloomberg, Reuters
Job PostingView all
3w
Save
Mark Applied
Hide
Data Lead Software Engineer – Python, Pyspark and AWS
New York or Jersey City
$152k-$215k/yr OnsiteFull Time
JPMorgan Chase
JPMorgan ChaseNYSE: JPM: Global financial services firm providing banking and investment solutions.
3+ YOE3+ years applied software engineering experience; strong Python and PySpark skills; experience designing batch and streaming data pipelines on AWS (Lambda, S3, Glue, Step Functions, Airflow); advanced SQL and NoSQL knowledge; CI/CD experience (Git, Jenkins, Maven); understanding of AI-assisted engineering and responsible AI practices.
Python, Spark, PySpark, AWS Lambda, Amazon S3, AWS Glue, AWS Step Functions, Airflow, Snowflake, Databricks, Git, Jenkins, Maven, SQL, NoSQL
Job PostingView all
1mo
Save
Mark Applied
Hide
AWS Data Cloud Consultant
Manhattan, New York, United States
OnsiteFull Time
Vertical Relevance
Vertical Relevance: Provides AWS cloud consulting for the financial services industry.
8+ YOE8+ years AWS data engineering/architecture experience, strong SQL Server expertise, experience with AWS DMS/SCT and Terraform, Python and data tooling experience, and strong client-facing communication skills.
Amazon SageMaker, Terraform, Apache Iceberg, Redshift, Athena, EMR, Glue, Kinesis, Firehose, Databricks, Snowflake, Redis, EKS, Python, Airflow, Kafka, Spark, Hadoop, Parquet, Git, Metaflow, S3, Lambda, Batch, RDS, Aurora, DynamoDB, Step Functions, IAM, CloudTrail, CloudFormation, AWS CLI, AWS CDK, Lake Formation, Data Pipeline, Service Catalog, AWS DMS, SCT, AWS Glue Data Catalog
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Machine Learning Engineer
Glendale or San Francisco or New York
$142k-$199k/yr HybridFull Time
The Walt Disney Company
The Walt Disney CompanyNYSE: DIS: Produces movies, operates theme parks, and provides streaming services.
5+ YOEExperience building and operating large-scale data/ML systems, strong distributed systems fundamentals, streaming/batch technologies (Kafka, Kinesis, Spark, Flink), Python, plus working knowledge of Java/Scala/Go/C++, cloud-native (AWS, containers, Kubernetes, IaC), observability, and collaboration skills; Bachelor's or Master's required.
Kafka, Kinesis, Spark, Flink, Python, Java, Scala, Go, C++, AWS, Kubernetes, containers, IaC tools
Job PostingView all
1mo
Save
Mark Applied
Hide
Full Stack Engineer - Portfolio Team
New York, New York, United States
$150k-$200k/yr OnsiteFull Time
Millennium Management
Millennium Management: Global alternative investment firm managing diverse investment strategies.
4+ YOEBachelor's in CS/Engineering/Math/Physics, 4+ years software or quant engineering experience. Strong Python, web frameworks (FastAPI/Flask), React/Angular, NumPy/Pandas/PyTorch, SQL, AWS, data visualization, and agentic tooling experience.
Python, FastAPI, Flask, React, Angular, NumPy, Pandas, PyTorch, SQL, Cursor, Claude code, Plotly, Matplotlib, Bokeh, Dash, AWS, S3, Athena, SQS, Batch, Lambda, Linux
Job PostingView all
1mo
Save
Mark Applied
Hide
Software Engineer 5 - Ads Identity Graph
New York City or Seattle or Los Angeles or Los Gatos
$388k-$558k/yr OnsiteFull Time
Netflix
NetflixNASDAQ: NFLX: Provider of global streaming entertainment and video content.
Experience designing and operating large-scale identity graphs and identity resolution (deterministic & probabilistic) in batch and near-real-time; familiarity with ad tech, data governance/privacy, and big data tools such as Spark.
Spark, Privacy Enhancing Technologies (PETs)
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Murex MxTest Engineer
New York, New York, United States
$100k-$150k/yr HybridFull Time
EPAM Systems
EPAM SystemsNYSE: EPAM: Provides global digital platform engineering and software development services.
4+ YOE4+ years Oracle/SQL experience, MxTest automation, EOD batch validation with Tidal, Sybase-Oracle data reconciliation, and defect management with Jira/Zephyr; flexible across time zones.
Oracle Database, SQL, MxTest, Murex, Sybase, Tidal scheduler, Jira, Zephyr
Job PostingView all
1mo
Save
Mark Applied
Hide
Software Engineer 5 - Ads Audience Activation
New York or Los Angeles or Los Gatos or Seattle
$388k-$619k/yr OnsiteFull Time
Netflix
NetflixNASDAQ: NFLX: Global video streaming and media production service.
Experience in designing scalable batch and streaming data onboarding systems; proficiency in Java, Python, C++, or similar; familiarity with Kafka, Flink; big data tools like Spark; distributed cloud applications; knowledge of ad tech and privacy considerations.
Kafka, Flink, Spark, Java, Python, C++
Job PostingView all
1w
Save
Mark Applied
Hide
Senior Lead Field Architect
New York City or Chicago
$103k-$154k/yr HybridFull Time
Braze
BrazeNASDAQ: BRZE: Platform for personalized customer engagement and cross-channel messaging.
Expert in distributed system design, enterprise integrations (batch, real-time, streaming), data strategy and governance, stakeholder management, and change management for large-scale marketing platforms.
Snowflake, Salesforce, Adobe, BrazeAI, API, SDK
Job PostingView all

Explore Jobs

Expand Your Job Search