137 spark data engineer jobs at 70 companies in Newfane, NY
1w
Save
Mark Applied
Hide
1w
Data Engineer
Toronto, Ontario, Canada
$119k-$161k/yrHybridFull Time
Clio: Cloud-based legal practice management software and AI solutions.
Experience in software development and data engineering; AWS cloud infrastructure; Python, Scala, or Ruby and SQL; Spark, Kafka, Airflow; Databricks or similar data warehousing; and data pipeline development.
Bally's IntralotAthens Stock Exchange: BYLOT: Global provider of lottery technology and interactive gaming solutions.
3+ YOEMid-level data engineer with strong SQL and Python, data warehousing, cloud experience (AWS/GCP/Azure), and hands-on experience with Spark, DBT, Airflow, Databricks, CI/CD and API integrations.
Gore Mutual: Provides property and casualty insurance through independent broker partners.
4+ YOEBachelor’s or master’s degree in a related field, 4–5 years of data engineering experience, strong Python and SQL skills, Azure and Spark expertise, and 2+ years of ML engineering and MLOps experience.
Konrad Group: Provides digital strategy, design, and software development services.
3+ YOEBachelor's degree, 3+ years data engineering experience, proficiency with Azure Fabric, Databricks, Snowflake, SQL and Python, experience with Spark/Hadoop/Kafka and dbt, strong data modeling and ETL/ELT skills.
LyftNASDAQ: LYFT: Provides an on-demand ride-hailing and multimodal transportation platform.
4+ YOEBachelor's degree in a relevant quantitative or technical field and 4+ years of data engineering experience. Requires Spark, Python, SQL tuning, AWS, Hadoop/S3, Hive, Presto, Airflow, ETL, and data warehousing.
BMOTSX: BMO: Provides personal and commercial banking, investment, and wealth services.
2+ YOE2-5 years IT experience; ETL/ELT and data warehousing; SQL, NoSQL, Python, Spark/PySpark, Scala; cloud (AWS/Azure), SSIS, Glue, Hadoop, Netezza; data modeling and profiling; Agile experience.
Zafin: SaaS platform for bank product and pricing modernization.
5+ YOE5+ years data engineering experience, strong Python/Scala/Java, advanced SQL, experience with Spark, Snowflake, Kafka, Airflow, Kubernetes, building batch and real-time pipelines, data modeling and governance.
White Plains or Greensboro or Charleston or Greenville or Maitland or Harrisonburg or Clearwater or Louisville or Birmingham or Huntsville or Alpharetta or Clayton or Honolulu or Lake Oswego or Gainesville or Fayetteville or Naples or Hibbing or Miami or Myrtle Beach or Houston or Denver or Piscataway or Irvine or Key Largo or Columbia or Little Rock or Austin or Pensacola or Lexington or Bloomington or Fort Myers or Panama City or San Antonio or Rochester or Mobile or Salt Lake City or Bend or Charlotte or Glen Allen or Raleigh or Abilene or Tallahassee or San Ramon or Dallas or Pittsburgh or Boston or Missoula or Cincinnati or Boise or Eugene or McMinnville or Knoxville or Dakota Dunes or Kissimmee or Fort Worth or Grand Forks or Canonsburg or Buffalo or Eastland or Philadelphia or Chicago or Phoenix or Dublin or Jacksonville or St. Louis or Los Angeles or Atlanta or Norwalk or Colchester or Grand Rapids or Richmond or Hoboken or Indianapolis or Kansas City or Chagrin Falls or Orland Park or Anchorage or High Point or Bonita Springs or Rancho Cordova or Las Vegas or Irving or Brandenburg or Minneapolis or Fort Lauderdale or Shreveport or Fargo or Sarasota or Kennesaw or Dayton or Sacramento or Princeton or Durham or Conshohocken or Baton Rouge or Asheville or Chattanooga or Memphis or Nashville or United States
$96k-$168k/yrRemoteFull Time
Marsh McLennanNYSE: MRSH: Global professional services firm providing risk, strategy, and people solutions.
10+ YOERequires 10+ years of enterprise data engineering experience and advanced Azure, Databricks, Spark, Python, SQL, ETL, data modeling, streaming, and cloud architecture expertise.
Microsoft Azure, Azure Databricks, Azure Functions, Azure Data Factory, Databricks, Apache Spark, PySpark, Python, SQL, Scala, Unity Catalog, Microsoft SQL Server, Kafka, Event Hub, Azure DevOps, Git, Terraform, ARM templates, Databricks Genie
TD BankToronto Stock Exchange: TD: Provide retail, commercial, and wholesale banking and financial services.
Hands-on experience building and debugging data pipelines on Azure Databricks, Azure Data Factory, ADLS, Delta Lake using Python, Spark/PySpark; SQL and networking fundamentals; secure, high-performance ETL development.
Azure Databricks, Databricks, Azure Data Factory, ADLS, Delta Lake, Python, Spark, PySpark, SQL
AutodeskNASDAQ: ADSK: Developing software for architecture, engineering, and entertainment industries.
10+ YOE10+ years data engineering experience; strong hands-on Python, Spark/PySpark, and advanced SQL; experience with streaming (Kafka, Flink), modern data platforms, AWS services, data governance, and LLM/RAG ecosystems.
NimbleRx: Digital platform for on-demand prescription delivery and pharmacy management.
5+ YOE5+ years building production data pipelines; strong Python (PySpark) and SQL; distributed compute (Spark/EMR); experience with Iceberg/Trino; CI/CD and Terraform; AI tooling experience.
Python, PySpark, SQL, Java, Spring Boot, Spark, EMR, Kinesis, S3, PostgreSQL, Iceberg, Trino, Terraform, CI/CD, AI
Toronto or Ottawa or Montreal or Vancouver or Canada
$105k-$135k/yrHybridFull Time
Office of the Superintendent of Financial Institutions: Regulates and supervises financial institutions and private pension plans.
5+ YOEDegree or diploma in a relevant field or equivalent combination; recent significant Azure Synapse or Databricks pipeline experience; Python, Spark, cloud data, DevOps, testing, and financial data experience.
ManulifeTSX: MFC: Provides insurance, wealth management, and investment services globally.
Bachelor's in CS or quantitative field; advanced experience with databases, data architecture and engineering; strong Python, SQL and Spark skills; experience with Azure/Databricks and automated pipelines; analytics and visualization experience.
Royal Bank of CanadaTSX: RY: Provides personal, commercial, and investment banking services worldwide.
5+ YOEBachelor's in CS or related, 5+ years in data/software/ML engineering; proficiency with Python, Java, SQL, Spark; experience building LLM/RAG/agentic AI systems, DataOps/MLOps, CI/CD, and large-scale data pipelines.
GFTFrankfurt Stock Exchange: GFT: Develops digital solutions and provides IT consulting for global enterprises.
5+ YOERequires 5–8 years in data engineering, integration, or platform development; Azure Databricks, pipelines, SQL, Python, Spark, Azure data services, data lake architectures, and Agile experience.
Azure, Databricks, Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), Azure SQL, Azure Synapse Analytics, Apache Spark, PySpark, SQL, Python, Delta Lake, Azure DevOps, Git, Kafka, Power BI
Senior Staff Data Engineer - Platform Data and Analytics
Kitchener or Toronto or San Francisco or London or New York City
$228k-$314k/yrHybridFull Time
Faire: Online wholesale marketplace connecting independent retailers with unique brands.
Experienced technical leader in data systems with strong SQL and Python, Snowflake/Airflow/Spark experience, data pipeline and warehousing expertise at scale, architecture and governance experience, and leadership/mentorship skills.
Kumaran Systems: Global provider of digital transformation and legacy modernization solutions.
5+ YOE5+ years building Databricks/Spark ETL pipelines, SQL, cloud (Azure/AWS/GCP), Delta Lake, Unity Catalog, CDC/SCD, data modelling and performance tuning.
AmazonNASDAQ: AMZN: Global online retail and cloud computing technology provider.
1+ YOE1+ years data engineering experience with data modeling, warehousing, ETL, SQL and scripting (Python or KornShell). Preferred experience with Hadoop/Hive/Spark/EMR and ETL tools like Informatica or SSIS.
ZS: Global management consulting and technology firm for healthcare and life sciences.
5+ YOEBachelors in computer/data science, 5+ years data engineering experience, proficiency in SQL and Python, experience with cloud platforms and big data technologies, ETL and data modeling expertise, leadership and travel readiness.
Motorola SolutionsNYSE: MSI: Provides mission-critical communications and public safety technology.
10+ YOE1+ Mgmt10+ years in data engineering/architecture, 5+ years Redshift ecosystem experience, 1+ year at staff/principal level. Mastery of Python, SQL, Spark; experience with Airflow, Terraform/CloudFormation, CI/CD, AWS or Google Cloud.