10 batch data engineer jobs at 9 companies in Lockport, NY
🚀PromotedHiringCafe
Founding Machine Learning / AI Search Engineer
Cupertino, CA, US
$160k-$310k/yrOn-SiteFull Time
HiringCafe: Building a 100× better job search engine to take on Indeed and LinkedIn.
Build the ML and AI search behind HiringCafe — ranking, recommenders, retrieval, and LLM agents that surface jobs people would never find on their own.
Ontario Securities Commission: Regulates capital markets and protects investors in Ontario.
10+ YOE10+ years data engineering experience; graduate degree in a quantitative field; strong Databricks, Azure, Python/PySpark and SQL skills; experience building and optimizing large-scale batch and streaming data pipelines and ensuring data quality.
Databricks, Azure Data Factory, Azure Synapse Analytics, Databricks Auto Loader, Delta Live Tables (DLT), YAML, SQL, Python, PySpark, R, Java, PowerShell, Databricks Dashboards, Power BI, Azure DevOps, Databricks Asset Bundles (DAB), Wheel files
Digital - Senior Data Engineer / Data Engineer, Digital Technology
Seattle or Vancouver or Toronto or New York City or Los Angeles
$100k-$300k/yrOnsiteFull Time
AritziaToronto Stock Exchange: ATZ: Designs and sells everyday luxury women's clothing and accessories.
Design and optimize scalable batch and real-time data pipelines; build ETL/ELT workflows; deliver governed data models; enforce data quality, governance, privacy, and security; mentor junior engineers.
SQL, Google Cloud Platform (GCP), BigQuery, Snowflake, Redshift, Airflow, Pub/Sub, Customer Data Platform (CDP)
Mistplay: Loyalty rewards platform for discovering and playing mobile games.
10+ YOE10+ years building and operating production data platforms; strong software engineering (Python/Scala/Go); experience with data warehouse/lakehouse (Snowflake, BigQuery, Databricks), streaming (Kafka, Flink) and batch frameworks (Spark, dbt); platform observability and mentoring experience.
Royal Bank of CanadaTSX: RY: Provides personal, commercial, and investment banking services worldwide.
5+ YOE2+ Mgmt5+ years data engineering experience with 2+ years leading engineers; hands-on with batch and real-time pipelines, Hadoop/Spark/NiFi/Kafka, SQL and Java/Scala/Python; cloud data platform experience (Snowflake, AWS, Azure, GCP); DevOps and agile practices.
CapgeminiEuronext Paris: CAP: Provides global IT consulting and digital transformation services.
Design and build realtime and batch data pipelines for fraud/AML monitoring using Apache Spark, Kafka, Hadoop ecosystem; strong SQL and programming in Python/Scala/Java; Linux experience; knowledge of cloud and NoSQL preferred.
WiproNYSE: WIT: Global technology services and consulting for digital transformation.
3+ YOEDesign and implement scalable batch and real-time data processing, ETL/ELT pipelines, data warehousing, streaming pipelines, performance tuning, and data governance; 3+ years experience.
WiproNYSE: WIT: Global technology services and consulting for digital transformation.
3+ YOEDesign and implement scalable batch and real-time big data solutions using Spark, Hadoop, cloud platforms and ETL tools; 3+ years experience and solution architecture expertise.
Doppel: Provides AI-native defense against digital social engineering and impersonation.
Design, train, and deploy ML models for batch and real-time inference; work on NLP, embeddings, similarity search, and anomaly detection; collaborate with Detection and Infrastructure teams to scale ML systems.
AmazonNASDAQ: AMZN: Global online retail and cloud computing technology provider.
10+ YOE10+ years software development, 7+ years building large-scale distributed systems, experience leading technical strategy for orgs of 30+ engineers, expertise in streaming/batch/columnar data systems, Bachelor's in CS or equivalent.
Core Java (Version 8 or higher), Java, Python, SQL, GIT, Gradle, Jira, Confluence, CI/CD, Spring Boot, Spring Security, Spring Data Repositories, Spring Batch, Spring framework, Web Services, SOAP, REST, STS Spring Tools, Eclipse Integrated Development Environment (IDE), SSL, Google Cloud, Splunk, Kafka, SoapUI