25 big data engineer jobs at 18 companies in Lockport, NY
2mo
Save
Mark Applied
Hide
Big Data Engineer
Toronto, Ontario, Canada
$100k-$120k/yr HybridFull Time
5+ YOE5-8 years IT, 4+ years in big data; AWS S3/EC2/EMR; Snowflake; Python/Scala/Java; SQL; data warehousing; Spark/Hive/Presto; Agile; on-call.
AWS, S3, EC2, EMR, Snowflake, Spark, Hive, Presto, Python, Scala, Java, SQL, Airflow
1mo
Save
Mark Applied
Hide
Senior Data Engineer
Toronto or Winnipeg
$100k-$137k/yr HybridFull Time
3+ YOE3+ years building big data pipelines or data warehouses with strong Python and SQL skills, cloud experience (preferably Google Cloud Platform), dbt and Jinja data modeling, data quality/governance, and software engineering practices (Git, CI/CD).
Python, SQL, Google Cloud Platform, dbt, Jinja, Git, CI/CD
2w
Save
Mark Applied
Hide
Ab Initio Developer (Big Data & Hadoop)
Toronto, Ontario, Canada
$89k-$95k/yr HybridFull Time
10+ YOEBachelor's degree,10+ years IT experience with 5+ years in Big Data and data integration, expert Ab Initio and Hadoop skills, strong SQL, shell scripting, Python/Java/Scala, and Git experience.
Ab Initio, Graphical Development Environment (GDE), Co-Operating System, Control Center, Metadata Hub, Enterprise Meta Environment (EME), EME Portal, Acquire>It, Express>It, Conduct>It, Data Quality Environment, Query>It, shell scripting, SQL, Hadoop, Git, Python, Java, Scala, Hive, Spark, Kafka, HBase, Sqoop, Hortonworks, ZooKeeper, Oozie, NoSQL, CI/CD, DevOps
3w
Save
Mark Applied
Hide
Software Engineer - Data
Toronto, Ontario, Canada
$65k-$85k/yr OnsiteFull Time
2+ YOE2-3 years experience in software/data engineering; experience with Microsoft Azure/Fabric, ETL/ELT, Python, big data pipelines, AI/ML and data lifecycle management.
Microsoft Fabric, Azure Data Factory (ADF), Synapse, ADLS Gen2, Power BI, Python, Azure OpenAI, Document Intelligence, Azure ML
6d
Save
Mark Applied
Hide
Data Engineering Specialist - Databricks
Toronto, Ontario, Canada
$95k-$145k/yr OnsiteFull Time
5+ YOEHands-on Databricks and Spark/PySpark experience, 5+ years in AWS/Azure data engineering, Python and SQL expertise, experience with streaming and big data, ETL/ELT pipeline development.
Databricks, Spark, PySpark, Azure Data Factory, Azure Databricks, Azure Data Lake (ADLS), Synapse, Azure SQL Database, Azure SQL Datawarehouse, AWS Glue, Amazon S3, Amazon Redshift, Amazon Athena, Amazon RDS, SQL, Python, Databricks Genie, Airflow, Jenkins, Hive, HDFS, Power BI, DAX, Power Apps, Power Automate, Logic Apps
1w
Save
Mark Applied
Hide
Lead Data Platform Developer - AI Platform
Singapore or Atlanta or Oakville or Toronto
HybridFull Time
10+ YOE3+ MgmtPost-secondary degree in computing,10+ years software development experience with Python 3,3-5 years team management,cloud and containerization experience,knowledge of ML/GenAI platforms and big data tools.
Kubernetes, Apache Flink, Ray, Python 3, Docker, OpenShift, Langgraph, CrewAI, LiteLLM, VertexAI, Bedrock, Google BigQuery, GCP, AWS, Azure
1mo
Save
Mark Applied
Hide
Senior Software Developer (Data & Backend Development)
Toronto or Montreal
$107k-$157k/yr OnsiteFull Time
7+ YOE7+ years software development experience, 2+ years with big data, data streaming experience, proficiency in Python/Java/Scala, building RESTful APIs, relational databases, AWS cloud, observability platforms, and strong debugging/design skills.
Python, Airflow, Snowflake, Hive, MySQL, Kinesis, Kafka, AWS, Java, Scala, PostgreSQL, EMR, Spark, Hadoop, S3, EBS, Lambda, EKS, CloudWatch, Splunk, Datadog
5d
Save
Mark Applied
Hide
Lead System Engineer
Toronto, Ontario, Canada
OnsiteFull Time
Experience in QE/testing methodologies, automated testing, qTest/JIRA/Confluence, Python/Java and SQL, CI/CD with GitHub Actions, cloud and big data testing; strong communication and problem-solving skills.
JIRA, Confluence, qTest, GitHub Actions, GitHub, Python, Java, SQL, SoapUI, ReadyAPI, Postman, Selenium, JMeter, AWS EC2, AWS ECS, AWS Lambda, AWS S3, AWS RDS, Apache Hadoop, GitHub Copilot
2mo
Save
Mark Applied
Hide
Senior Java Engineer
Toronto, Ontario, Canada
RemoteFull Time
Senior Java Engineer with Java, Spring, multi-threading, scalable architecture, microservices, Linux/Windows, and Big Data tools.
Java, Spring, Spring Webflux, Reactor, Netty, Hadoop, Spark, Samza, Kafka, Aerospike, Lucene, Solr, ElasticSearch, Git, Gitlab, IntelliJ, Gradle, Docker, Kubernetes, HDFS, Hive
1w
Save
Mark Applied
Hide
Staff AI Engineer
Toronto, Ontario, Canada
OnsiteFull Time
Proven experience designing and deploying production agentic AI systems, strong software development and system design skills, experience with scalable cloud big-data applications, MS or PhD in science/engineering.
LLMs, RAG, agent frameworks, context engineering
3w
Save
Mark Applied
Hide
Sr. Solutions Engineer - FSI
Toronto, Ontario, Canada
$140k-$192k/yr FieldFull Time
Experienced pre-sales engineer for large enterprise accounts with expertise in big data, cloud (Azure/AWS), production programming (Python,R,Scala,Java), technical leadership, and value selling.
Azure, AWS, Python, R, Scala, Java, Databricks, Snowflake
20h
Save
Mark Applied
Hide
Academic Assistant -CPS853 - Creating Big Data Systems
Toronto, Ontario, Canada
$50-$55/hr OnsiteTemporary
Must be enrolled in TMU Master's or PhD Computer Science program; background in model-driven engineering and experience with MDE tools; prior assistant evaluation if applicable.
MDE
3w
Save
Mark Applied
Hide
Associate Java Developer
Toronto, Ontario, Canada
$85k-$100k/yr HybridFull Time
2+ YOEBachelor's in CS or related,2+ years Core Java,experience with big-data processing,NoSQL stores,Spring,Microservices,Kubernetes,Docker and SQL;strong communication and collaboration skills.
Core Java, Spark, Kafka, KSql, Flink, Apache Beam, Cassandra, Bigtable, MongoDB, Spring Frameworks, Web Services, REST APIs, APIs, Microservices, Kubernetes, Dockers, SQL
2mo
Save
Mark Applied
Hide
Senior Software Engineer
Toronto, Ontario, Canada
$111k-$160k/yr OnsiteFull Time
BS in Computer Science or equivalent; strong Java 17+, Spring; cloud-native development (Azure); REST APIs; CI/CD; DevOps; databases (CosmosDB, Postgres); Big Data tools; Angular/Bootstrap; agile methods.
Java, Spring, Angular, Bootstrap, Azure, CosmosDB, Postgres, Spark, Databricks, Jenkins, CI/CD, Infrastructure as Code, JVM, Linux, REST APIs, DevOps
1mo
Save
Mark Applied
Hide
Software Development Engineer, Employee Listening
Toronto, Ontario, Canada
$115k-$192k/yr OnsiteFull Time
3+ YOE3+ years professional software development, 2+ years system design/architecture, experience programming in at least one language, familiarity with big data and AWS technologies preferred.
AWS Glue, Amazon Athena, AWS Lambda, Amazon S3, Amazon DynamoDB, AWS, Hadoop, Spark, Pig, Hive, Lucene/SOLR, Storm, Samza
1d
Save
Mark Applied
Hide
Sr Applied Scientist, Recommendations
Toronto, Ontario, Canada
$142k-$190k/yr HybridFull Time
3+ YOEMS in CS or related with 3+ yrs (or BS/BA with 5+ yrs) in ML/AI/data engineering, production engineering in an OO language, NLP/deep learning/recommender systems, big data (Hadoop, SQL, Spark, Pyspark), and cloud services.
Scala, Java, Hadoop, SQL, Spark, Pyspark
20h
Save
Mark Applied
Hide
Technology Lead
Mississauga or Toronto
$93k-$123k/yr OnsiteFull Time
4+ YOE4+ years IT experience with big data: Apache Spark, Scala/PySpark, Kafka, Hadoop ecosystem, NoSQL and SQL proficiency; bachelor's degree or equivalent experience required.
Apache Spark, Scala, PySpark, Kafka, Hadoop, HDFS, Hive, Impala, HBase, MongoDB, Couchbase, SQL, Parquet, ORC, Avro, Databricks, AWS, GCP
2mo
Save
Mark Applied
Hide
Sr. Technical Project Manager - Client Service Delivery
Toronto, Ontario, Canada
$120k-$170k/yr RemoteFull Time
Bachelor's in CS/Engineering; experience as a technical Project Manager; strong software, system architecture, SaaS integration; excellent client-facing and communication skills; ability to manage multiple projects; knowledge of fraud at financial or internet industry a plus; experience with real-time, big data, ML a plus.
SaaS integration, Big data, Machine learning, Real-time computing
Explore Jobs