Scotiabank
Posted 3mo ago

Lead Software Engineer (Python | Databricks) (258694)

Scotiabank
Toronto, Ontario, Canada
HybridFull Time
Responsibilities
  • designing solutions
  • writing code
  • modeling data
Requirements
  • 4+ years Python (PySpark
  • Pandas), SQL
  • ETL/data modeling
  • Cloud (Azure/GCP)
  • Databricks or Snowflake
  • Spark/Kafka/ElasticSearch
  • Workflow tools (Airflow/Data Factory)
  • CI/CD (Jenkins, Git)
  • Agile/TDD
  • Bachelor's or equivalent experience
Technical tools mentioned
PythonPySparkPandasSQLPostgresMSSQLOracle DBApache SparkApache KafkaApache ElasticSearchDataBricksSnowflakeAzureGCPAirflowData FactoryJenkinsGitDockerKubernetesAccelerator pipeline

Job description

Requisition ID 258694 - Posted 

 

 

 

Requisition ID: 258694 

Join a purpose driven winning team, committed to results, in an inclusive and high-performing culture.

 

The Team

Global Banking and Markets Engineering (GBME) is the fast-moving, award-winning technology engine that powers Scotiabank’s Corporate, Investment Banking and Capital Markets businesses.

 

The Role

 

GBME is searching for Software Engineers who are continuous learners and are eager to boost capabilities of capital markets products and analytics platforms.

The successful candidate will have a strong technical and engineering mindset.  You will work closely with business teams and cross functional engineering leaders to develop and implement market leading solutions for the various projects within GBME.  

Is this role right for you? In this role you will:

 

  • Work closely with end users, and business teams to understand business needs, conduct gap analysis and requirements assessments as needed
  • Partner with Architecture on the design and integration
  • Deliver and enhance new and current solutions and applications
  • Be involved in the full life cycle of a project, responsible for the design, producing actionable and complete specifications, writing production quality code, and implementation
  • Design, deliver and implement data models, database schema and data pipelines
  • Design test sets and automate where possible, including functional and non functional testing, regression testing as well as performance testing
  • Write deployment scripts and leverage tools such as the Accelerator pipeline to promote code
  • Support the solution in production (as needed)
  • Improve the end user experience by finding scalable solutions and addressing complex ad hoc queries.
  • Effectively communicate with technical and non-technical audiences
  • Able to work with and refactor legacy code (as needed).
  • Coach and train end users (as needed). 
  • Participate and run SCRUM Meetings (as needed).

 

Do you have the skills that will enable you to succeed in this role? We’d love to work with you if you have:

 

  • 4+ years’ experience with Python (PySpark, Pandas),
  • 4+ years’ experience with designing scalable ETL pipelines & data modeling
  • 4+ years’ experience developing, deploying, and maintaining large scale applications with complex integration
  • 4 + years’ experience reading, writing, and running SQL scripts.
  • Working experience with data technologies and databases, preferably in one or more of: Postgres, MSSQL, Oracle DB, Apache Spark, Apache Kafka, Apache ElasticSearch, comfortable working with large datasets
  • Working experience with data platforms:  DataBricks or Snowflake
  • Working experience with cloud platforms (Azure/GCP)
  • Working experience with workflow orchestration tool such as Airflow or Data Factory
  • Working experience with Web Services & API
  • Hands-on experience with DevOps:  CI/CD (Jenkins, Git)
  • Experience working in an Agile environment, with experience and understanding of Test-Driven Development methodology.
  • Bachelor’s degree in computer science, Engineering or relevant experience.

 

Preferred Qualifications (Nice to have)

 

  • Understanding of networking protocols and security principles
  • Capital Markets product knowledge
  • Dockers, Kubernetes experience
  • Experience working with real-time, high availability and low latency systems
  • Experience in multi-threaded applications

 

 

What's in it for you? 

  • Diversity, Equity, Inclusion & Allyship - We strive to create an inclusive culture where every employee is empowered to reach their fullest potential, respected for who they are, and are embraced through bias-free practices and inclusive values across Scotiabank. We embrace diversity and provide opportunities for all employee to learn, grow & participate through our various Employee Resource Groups (ERGs) that span across diverse gender identities, ethnicity, race, age, ability & veterans.
  • Accessibility and Workplace Accommodations - We value the unique skills and experiences each individual brings to the Bank and are committed to creating and maintaining an inclusive and accessible environment for everyone. Scotiabank continues to locate, remove, and prevent barriers so that we can build a diverse and inclusive environment while meeting accessibility requirements.
  • Upskilling through online courses, cross-functional development opportunities, and tuition assistance.
  • Competitive Rewards program including bonus, flexible vacation, personal, sick days, and benefits will start on day one.
  • Community Engagement - no matter where you choose to work from; we offer opportunities for community engagement & belonging with our various programs.

 

#LI-Hybrid

 

Location(s):  Canada : Ontario : Toronto 

Scotiabank is a leading bank in the Americas. Guided by our purpose: "for every future", we help our customers, their families and their communities achieve success through a broad range of advice, products and services, including personal and commercial banking, wealth management and private banking, corporate and investment banking, and capital markets.  

At Scotiabank, we value the unique skills and experiences each individual brings to the Bank, and are committed to creating and maintaining an inclusive and accessible environment for everyone. If you require accommodation (including, but not limited to, an accessible interview site, alternate format documents, ASL Interpreter, or Assistive Technology) during the recruitment and selection process, please let our  Recruitment team know. If you require technical assistance, please click here. Candidates must apply directly online to be considered for this role. We thank all applicants for their interest in a career at Scotiabank; however, only those candidates who are selected for an interview will be contacted.

About Scotiabank

Provides global personal, commercial, and investment banking services.

Similar jobs

Software Engineer roles near Toronto, Ontario
5h
Save
Mark Applied
Hide
Staff Software Engineer, Dashboard
Canada or Toronto or United States or Seattle or South San Francisco
$204k-$305k/yr RemoteFull Time
Stripe
Stripe: Provides global financial infrastructure and payment processing for businesses.
10+ YOEStaff-level frontend engineer with typically 10+ years building complex web applications at scale, deep modern frontend expertise, UI quality leadership, large-codebase experience, and design collaboration skills.
React, Figma
7h
Save
Mark Applied
Hide
Senior Software Engineer
Toronto, Ontario, Canada
$151k-$189k/yr RemoteFull Time
New Relic
New Relic: Provides an observability platform for monitoring and improving software performance.
5+ YOERequires 5+ years of backend software engineering experience, strong Java and Kotlin proficiency, distributed systems, relational databases, SQL, APIs, high-throughput services, and agile development experience.
Java, Kotlin, RESTful APIs, SQL, Kafka, Flink, Spark Streaming, RabbitMQ, gRPC, Kubernetes, Docker, Terraform, AWS, GCP, Azure, React, TypeScript, GraphQL, CSS
10h
Save
Mark Applied
Hide
Senior Software Engineer (12-month contract)
Mississauga, Ontario, Canada
$142k-$158k/yr HybridContract
PointClickCare
PointClickCare: Develops cloud-based healthcare software for senior care providers.
Software engineering experience with Python or Java, microservices, RESTful APIs, AI agentic and multi-agent systems, RAG, MCP servers, databases, cloud environments, Git, and CI/CD; computer science degree required.
Python, Java, RESTful APIs, PostgreSQL, Microsoft SQL Server, Qdrant, Pinecone, pgvector, Weaviate, New Relic, Datadog, Git, Spring Boot, React, Selenium, Docker, Kubernetes, Istio, Ansible, Spinnaker, GitHub Actions, AWS, Azure, Terraform, SAML, OAuth, OpenID Connect, GitHub Copilot, Linux, MCP
10h
Save
Mark Applied
Hide
Sr. Software Engineer
Toronto, Ontario, Canada
$130k-$155k/yr HybridFull Time
DNV
DNV: Provides global risk management, certification, and technical assurance services.
5+ YOEBachelor's or master's degree or equivalent experience; 5+ years developing production software; Python, Django, TypeScript, React, REST APIs, cloud applications, CI/CD, testing, and AI-assisted development experience.
Python, Django, TypeScript, React, REST APIs, AWS, Microsoft Azure, CI/CD, Azure AI Search, Microsoft BenefitsHub, SOC 2 Type II, ISO 27001
10h
Save
Mark Applied
Hide
Intermediate Software Developer I
Etobicoke or Canada
$95k-$105k/yr RemoteFull Time
ThinkOn
ThinkOn: Provider of managed cloud infrastructure and data management services.
2+ YOERequires a bachelor's degree or equivalent experience, 2–4 years of software development experience, Java, object-oriented programming, relational databases, REST APIs, unit testing, Git, and agile development knowledge.
Java, React, Git, JUnit, Mockito, REST API
10h
Save
Mark Applied
Hide
Senior Software Engineer
Toronto or Canada
$140k-$160k/yr RemoteFull Time
commonsku
commonsku: Connected workflow platform for the promotional products industry.
5+ YOERequires 5+ years of software development experience, software engineering and system design expertise, relational databases, APIs, React, PHP or Python, cloud platforms, CI/CD, version control, observability, and mentoring experience.
React, PHP, Python, AWS, Google Cloud Platform (GCP), Microsoft Azure, Datadog
12h
Save
Mark Applied
Hide
Software Engineer
Vancouver or Greater Toronto County
$86k-$169k/yr RemoteFull Time
Microsoft
MicrosoftNASDAQ: MSFT: Develops software, services, devices, and cloud computing solutions.
2+ YOEBachelor's degree in computer science or related technical field and 2+ years of coding experience, or equivalent experience; preferred qualifications include advanced education or additional experience.
C, C++, C#, Java, JavaScript, Python
12h
Save
Mark Applied
Hide
[Confluent] Senior Software Engineer - Hybrid Enterprise Cloud
Markham, Ontario, Canada
$144k-$169k/yr HybridFull Time
IBM
IBMNew York Stock Exchange: IBM: Global technology providing enterprise software, cloud, and consulting.
Bachelor's degree and backend development experience with component design, coding, testing, CI/CD pipelines, debugging, and Agile collaboration. Must be authorized to work in Canada without sponsorship.
CI/CD, DevOps, Agile, Artificial Intelligence (AI), IBM Cloud