CGI
Posted 3w ago

Data Engineering Specialist - Databricks

CGI
Toronto, Ontario, Canada
$95k-$145k/yrOnsiteFull Time
Responsibilities
  • building pipelines
  • transforming data
  • collaborating clients
Requirements
  • Hands-on Databricks and Spark/PySpark experience
  • 5+ years in AWS/Azure data engineering
  • Python and SQL expertise
  • Experience with streaming and big data
  • ETL/ELT pipeline development
Technical tools mentioned
DatabricksSparkPySparkAzure Data FactoryAzure DatabricksAzure Data Lake (ADLS)SynapseAzure SQL DatabaseAzure SQL DatawarehouseAWS GlueAmazon S3Amazon RedshiftAmazon AthenaAmazon RDSSQLPythonDatabricks GenieAirflowJenkinsHiveHDFSPower BIDAXPower AppsPower AutomateLogic Apps

Job description

Position Description:

Are you an experienced Data Engineering professional interested in working in a talented and collaborative team developing Cloud, Data and AI solutions for leading global clients? Do you regularly find yourself in conversations on disparate and dispersed data sources and feel the need to create a robust data engineering infrastructure to sort that mess out? If you have that technical expertise of building pipelines and enabling data engineering or ETL in organizations, a genuine flair for solving problems, and the mindset to collaborate with diverse clients and team members alike, we're looking for you.

Mandatory Skills: Databricks and Spark/PySpark (hands-on experience required).
Experience Level: Intermediate and Senior candidates are encouraged to apply.
Role Type: Hands-on individual contributor position focused on data engineering, development, and solution delivery.
 






Your future duties and responsibilities:

As an Data Engineer (Databricks) on this team your responsibilities will include:
·    Delivering on areas of data preparation and transformations and ETL or ELT development on Azure Azure Data Factory (ADF), Azure Databricks, Azure Data Lake (ADLS), Synapse, Azure SQL database, Azure SQL Datawarehouse or AWS AWS Glue, Amazon S3, Amazon Redshift, Amazon Athena, and Amazon RDS
·    Building Batch and Streaming data pipelines with Databricks
·    Working in a business environment with large scale, complex and big data datasets and dispersed data sources
·    Using SQL or Advanced SQL and Python skills as necessary
·    Gathering client requirements, coding and building Data Engineering pipelines in Azure
·    Implementing proof of concepts to show value and then package and scale to full data engineering scale on both on prem and cloud environments
·    Strategically collaborating with the clients to explore data sources and build Power BI dashboards with Azure/AWS Data Engineering
Supporting and collaborating with the other Data Engineers or Data Scientists in the team with technical knowledge







Required qualifications to be successful in this role:

Essential skillsets and expertise needed:
·    Azure/AWS + Databricks, Spark/Pyspark experience is mandatory
·    Minimum 5+ years' experience in AWS/Azure Data Engineering is required to apply to this role
·    Experience with building streaming pipelines on Azure/AWS
·    Data analysis, storage, data pipelines, and orchestration
·    Expert Python and SQL skills
·    Experience working on Big Data
Nice to Have Qualifications
·    Experience with Databricks Genie
·    Experience with data engineering with ML projects
·    Experience with data pipeline and workflow management tools eg. Airflow, Jenkins etc.
·    Experience working with Spark/ Hive/HDFS
·    Experience in building strong Power BI Dashboards with DAX queries, Power Apps, Power Automate, and Logic Apps 

CGI is providing a reasonable estimate of the pay range for this role. The determination of this range includes factors such as skill set level, geographic market, experience and training, and licenses and certifications. Compensation decisions depend on the facts and circumstances of each case. A reasonable estimate of the current range is $95,000-$145,000. This role is a future opening.

#LI-AB19














Use of the term ‘engineering’ in this job posting refers to the technical sense related to Information Technology (IT) and does not imply that the individual practices engineering or possesses the requisite license as prescribed by the applicable provincial or territorial engineering regulator. We are seeking individuals with expertise in IT engineering-related functions, but licensure from an engineering regulator is not a prerequisite for this position. Engineering is a regulated profession in Canada which is restricted in terms of use of titles and designation.









Skills:

  • Data Engineering
  • Data Engineering
  • Data Migration
  • Data Modeling
  • Data Validation
  • Data Warehousing
  • English






What you can expect from us:

Together, as owners, let’s turn meaningful insights into action.

Life at CGI is rooted in ownership, teamwork, respect and belonging. Here, you’ll reach your full potential because…

You are invited to be an owner from day 1 as we work together to bring our Dream to life. That’s why we call ourselves CGI Partners rather than employees. We benefit from our collective success and actively shape our company’s strategy and direction.

Your work creates value. You’ll develop innovative solutions and build relationships with teammates and clients while accessing global capabilities to scale your ideas, embrace new opportunities, and benefit from expansive industry and technology expertise.

You’ll shape your career by joining a company built to grow and last. You’ll be supported by leaders who care about your health and well-being and provide you with opportunities to deepen your skills and broaden your horizons.

At CGI, we value the strength that diversity brings and are committed to fostering a workplace where everyone belongs. We collaborate with our clients to build more inclusive communities and empower all CGI partners to thrive. As an equal-opportunity employer, being able to perform your best during the recruitment process is important to us. If you require an accommodation, please inform your recruiter.

That same commitment to fairness extends to how we use technology. To support our recruitment team, AI tools may be used to help assess applications though they never replace human judgement. All hiring decisions remain entirely in the hands of our recruitment professionals.

To learn more about accessibility at CGI, contact us via email. Please note that this email is strictly for accessibility requests and cannot be used for application status inquiries.

Come join our team—one of the largest IT and business consulting services firms in the world.

About CGI

Provides information technology and business consulting services.

Similar jobs

Data Engineer roles near Toronto, Ontario
22h
Save
Mark Applied
Hide
Data Engineer (271040)
Toronto, Ontario, Canada
OnsiteFull Time
Scotiabank
ScotiabankToronto Stock Exchange: BNS: Provides global personal, commercial, and investment banking services.
Bachelor’s or master’s degree in computer science, engineering, or related field; strong Python or Java skills; Databricks ecosystem experience; cloud, data governance, security, and distributed systems expertise.
Python, Java, Databricks, Unity Catalog, Delta Lake, Apache Spark, Atlan, Alation, Collibra, DataHub, OpenMetadata, Azure, GCP, Terraform, Kafka
1d
Save
Mark Applied
Hide
[Wattpad] Data Engineer - Maternity Cover
Toronto, Ontario, Canada
$100k-$140k/yr HybridContract
Wattpad
WattpadNASDAQ: WBTN: Platform for reading and writing original digital stories.
4+ YOERequires 4+ years of data engineering experience, Python and PySpark, database and software engineering knowledge, batch and streaming systems experience, and expertise in at least two listed data technologies.
Python, PySpark, AWS DMS, HBase, EMR, Redshift, S3, Kafka, Airflow, Spark, AWS EMR, AWS Glue, Sagemaker
1d
Save
Mark Applied
Hide
Senior Data Engineer
Toronto, Ontario, Canada
$120k-$145k/yr HybridFull Time
Konrad Group
Konrad Group: Provides digital strategy, design, and software development services.
4+ YOEBachelor's degree or higher in a relevant field and 4+ years of data engineering experience. Requires SQL or Python, data platforms, pipelines, cloud services, big data technologies, and analytical skills.
Azure Fabric, Databricks, Snowflake, SQL, Python, Spark, Hadoop, Kafka, DevOps, CI/CD
2d
Save
Mark Applied
Hide
AWS Data Engineer
Mississauga or Canada
$98k-$110k/yr RemoteFull Time
Cognizant
CognizantNasdaq: CTSH: Provides IT consulting and digital business process services.
5+ YOEBachelor's degree and 5+ years of data engineering experience required, including 3+ years building Databricks solutions on AWS; strong Python, PySpark, Spark SQL, SQL, ETL/ELT, and cloud data platform skills.
Databricks, PySpark, Python, SQL, Delta Lake, AWS, Amazon S3, AWS Glue, AWS Lambda, AWS Identity and Access Management (IAM), Amazon Redshift, Amazon SNS, Amazon SQS, Amazon CloudWatch, Git, Terraform, Jenkins, Azure DevOps, Spark SQL, Unity Catalog
2d
Save
Mark Applied
Hide
Principal Data Engineer
Toronto, Ontario, Canada
$95k-$176k/yr OnsiteFull Time
BMO
BMOTSX: BMO: Provides personal and commercial banking, investment, and wealth services.
15+ YOE15+ years relevant experience, post-secondary education or equivalent, bachelor's degree in computer/data science or engineering, principal engineering experience, and expertise in data architecture, cloud, AI, security, and integration.
Python, Spark, Scala, RAG, MLOps, LLMOps
2d
Save
Mark Applied
Hide
Consultant, Data Developer
Toronto, Ontario, Canada
OnsiteFull Time
CIBC
CIBCToronto Stock Exchange: CM: Provides personal, commercial, and investment banking and wealth management.
7+ YOERequires 7+ years with Databricks, Azure Data Factory, Informatica, Oracle DB, Azure, Python, SQL, CI/CD, GitHub, batch scheduling, and SFTP; bachelor's degree or equivalent and technical leadership experience.
Databricks, Azure Data Factory, Informatica, Oracle Database, Microsoft Azure, Python, SQL, CI/CD, GitHub, AutoSys, SFTP, REST APIs, Databricks Unity Catalog, Informatica Cloud, Informatica PowerExchange
3d
Save
Mark Applied
Hide
Data Engineer
Toronto or Vancouver or Ottawa or Calgary or Halifax or St. John's or Kelowna or Prince George or Montreal or Quebec City
$83k-$93k/yr HybridFull Time
Canadian Cancer Society
Canadian Cancer Society: A national cancer organization funding research, supporting people affected by cancer, and advocating for healthier communities.
3+ YOEBachelor's or master's degree in a relevant computing or data field, 3-5 years of related experience, and proficiency with Microsoft Fabric, Apache Spark, SQL, Python, cloud data platforms, integrations, DevOps, and data governance.
Microsoft Fabric, Apache Spark, SQL, Python, Microsoft Azure, Azure DevOps, Microsoft Purview, Salesforce, Delta Lake, OneLake
3d
Save
Mark Applied
Hide
Senior Data Engineer - Krembil Centre for Neuroinformatics
Toronto, Ontario, Canada
$86k-$107k/yr HybridFull Time, Contract
Centre for Addiction and Mental Health
Centre for Addiction and Mental Health: Canada's largest mental health and addiction teaching hospital.
5+ YOEMaster’s or PhD in a relevant technical discipline or equivalent experience; 5+ years in data or ML engineering; Python, SQL, production pipelines, MLOps, cloud, databases, Linux, Git, and CI/CD expertise.
Python, SQL, Docker, Kubernetes, Linux, Git, Microsoft Azure, AWS, Google Cloud, Snowflake, CI/CD, MLOps, ETL/ELT, APIs