149 spark data engineer jobs at 73 companies in Sanborn, NY
2w
Save
Mark Applied
Hide
2w
Data Engineer
Toronto, Ontario, Canada
$119k-$161k/yrHybridFull Time
Clio: Cloud-based legal practice management software and AI solutions.
Experience in software development and data engineering; AWS cloud infrastructure; Python, Scala, or Ruby and SQL; Spark, Kafka, Airflow; Databricks or similar data warehousing; and data pipeline development.
Experience in data engineering, warehousing, dimensional modeling, ETL, SQL, and database systems; Apache Airflow and Spark experience; Python or R; bachelor's degree or equivalent experience.
Postgres, Apache Airflow, Spark, SQL, SQL Server Reporting Services (SSRS), SQL Server Integration Services (SSIS), Python, R, XML, REST API, JavaScript, Linux
LyftNASDAQ: LYFT: Provides an on-demand ride-hailing and multimodal transportation platform.
4+ YOEBachelor's degree in a relevant quantitative or technical field and 4+ years of data engineering experience. Requires Spark, Python, SQL tuning, AWS, Hadoop/S3, Hive, Presto, Airflow, ETL, and data warehousing.
BMOTSX: BMO: Provides personal and commercial banking, investment, and wealth services.
2+ YOERequires 2–5 years of relevant experience, IT education or certifications, ETL/ELT, data warehousing, SQL, NoSQL, Python, Spark/PySpark, Scala, SSIS, cloud services, Hadoop, and data modeling experience.
AutodeskNASDAQ: ADSK: Developing software for architecture, engineering, and entertainment industries.
10+ YOE10+ years data engineering experience; strong hands-on Python, Spark/PySpark, and advanced SQL; experience with streaming (Kafka, Flink), modern data platforms, AWS services, data governance, and LLM/RAG ecosystems.
San Francisco or Los Angeles or Denver or Austin or Chicago or New York City or Seattle or Toronto or Santa Barbara or San Diego
$127k-$190k/yrRemoteFull Time
Invoca: AI platform for conversation intelligence and revenue execution.
5+ YOE5+ years in data or software engineering; advanced Python, SQL, Databricks, Spark, and data modeling; experience with orchestration, streaming, cloud infrastructure, data quality, ML datasets, and privacy; bachelor's degree or equivalent.
CapgeminiEuronext Paris: CAP: Provides global IT consulting and digital transformation services.
Experienced data engineer skilled in SQL, Python, Java or Scala, Spark, Beam, GCP data services, Terraform, CI/CD, Git, and infrastructure-as-code; leadership and mentoring responsibilities required.
SQL, Python, Java, Scala, Spark, Apache Beam, BigQuery, Google Cloud Dataflow, Google Cloud Dataproc, Google Cloud Pub/Sub, Cloud Composer, Apache Airflow, Terraform, CI/CD, Git, Cloud Functions, Cloud Storage, Cloud Data Fusion, Cloud Monitoring, Cloud Logging, Vertex AI, Data Catalog, dbt
NimbleRx: Digital platform for on-demand prescription delivery and pharmacy management.
5+ YOE5+ years building production data pipelines; strong Python (PySpark) and SQL; distributed compute (Spark/EMR); experience with Iceberg/Trino; CI/CD and Terraform; AI tooling experience.
Python, PySpark, SQL, Java, Spring Boot, Spark, EMR, Kinesis, S3, PostgreSQL, Iceberg, Trino, Terraform, CI/CD, AI
Toronto or Vancouver or Ottawa or Calgary or Halifax or St. John's or Kelowna or Prince George or Montreal or Quebec City
$83k-$93k/yrHybridFull Time
Canadian Cancer Society: A national cancer organization funding research, supporting people affected by cancer, and advocating for healthier communities.
3+ YOEBachelor's or master's degree in a relevant computing or data field, 3-5 years of related experience, and proficiency with Microsoft Fabric, Apache Spark, SQL, Python, cloud data platforms, integrations, DevOps, and data governance.
Microsoft Fabric, Apache Spark, SQL, Python, Microsoft Azure, Azure DevOps, Microsoft Purview, Salesforce, Delta Lake, OneLake
Konrad Group: Provides digital strategy, design, and software development services.
3+ YOEBachelor's degree or higher in a related field, 3+ years of data engineering experience, proficiency with Azure Fabric, Databricks, Snowflake, SQL or Python, and experience with pipelines, ETL/ELT, data modeling, and big data technologies.
CognizantNasdaq: CTSH: Provides IT consulting and digital business process services.
5+ YOEBachelor's degree and 5+ years of data engineering experience required, including 3+ years building Databricks solutions on AWS; strong Python, PySpark, Spark SQL, SQL, ETL/ELT, and cloud data platform skills.
Senior Staff Data Engineer - Platform Data and Analytics
Kitchener or Toronto or San Francisco or London or New York City
$228k-$314k/yrHybridFull Time
Faire: Online wholesale marketplace connecting independent retailers with unique brands.
Experienced technical leader in data systems with strong SQL and Python, Snowflake/Airflow/Spark experience, data pipeline and warehousing expertise at scale, architecture and governance experience, and leadership/mentorship skills.
Kumaran Systems: Global provider of digital transformation and legacy modernization solutions.
5+ YOE5+ years building Databricks/Spark ETL pipelines, SQL, cloud (Azure/AWS/GCP), Delta Lake, Unity Catalog, CDC/SCD, data modelling and performance tuning.
ScotiabankToronto Stock Exchange: BNS: Provides global personal, commercial, and investment banking services.
Bachelor's or master's degree in computer science, engineering, or related field; strong Python and/or Java skills; experience with Databricks, Unity Catalog, Delta Lake, Apache Spark, cloud platforms, data governance, and infrastructure as code.
CIBCToronto Stock Exchange: CM: Provides personal, commercial, and investment banking and wealth management.
4+ YOE4+ years of data engineering experience with Databricks, Spark, PySpark, Python, and SQL; expertise in scalable pipelines, cloud data platforms, governance, security, and performance optimization.
Azure Databricks, Apache Spark, PySpark, Python, SQL, Azure Data Factory, Feed Hub, Autosys Airflow, GitHub, PowerShell, DevSecOps, CI/CD, GitHub Actions, Artifactory, Vault, Structured Streaming, Unity Catalog, Data Lake, Microsoft Azure
AmazonNASDAQ: AMZN: Global online retail and cloud computing technology provider.
1+ YOE1+ years data engineering experience with data modeling, warehousing, ETL, SQL and scripting (Python or KornShell). Preferred experience with Hadoop/Hive/Spark/EMR and ETL tools like Informatica or SSIS.
Motorola SolutionsNYSE: MSI: Provides mission-critical communications and public safety technology.
10+ YOE1+ Mgmt10+ years in data engineering/architecture, 5+ years Redshift ecosystem experience, 1+ year at staff/principal level. Mastery of Python, SQL, Spark; experience with Airflow, Terraform/CloudFormation, CI/CD, AWS or Google Cloud.
Municipal Property Assessment Corporation: Conducts property assessments and valuations for all Ontario municipalities.
7+ YOEDegree or diploma in a relevant technology field or equivalent; 7 years of enterprise data engineering experience, technical leadership, cloud data platforms, pipelines, databases, governance, and DataOps.
SQL, Python, Java, Groovy, Spring Boot, Spark, Microsoft Fabric, Databricks, Azure Data Factory, Snowflake, PostgreSQL, Redshift, AWS SQS, AWS S3, RabbitMQ, Kubernetes, Rancher, GitLab CI/CD, Git, Bitbucket, Jira, Confluence
RumbleNASDAQ: RUM: Online video sharing platform and cloud services provider.
Senior-level experience building and operating large-scale data platforms and backend systems; advanced SQL, distributed systems, APIs, Kotlin/JVM, and Kubernetes experience; familiarity with data lake formats and query engines.
WiproNYSE: WIT: Global technology services and consulting for digital transformation.
8+ YOE8+ years experience building Azure Databricks-to-Synapse ETL/ELT pipelines, strong Spark SQL and PySpark skills, dimensional data modelling including SCDs, and ability to translate business needs into scalable data models.
Azure Databricks, DataBricks - Data Engineering, Synapse, Delta Lake, PySpark, Spark SQL