CGI
Posted 4mo ago

Big Data Developer (Java / Scala) - AML Tech

CGI
Toronto, Ontario, Canada
$95k-$145k/yrHybridFull Time
Responsibilities
  • designing pipelines
  • developing ETL
  • ensuring quality
Requirements
  • 5+ years with big data ETL (Hadoop, Spark, Hive)
  • Snowflake
  • Strong SQL and Java/Scala
  • Experience with ETL tools
  • Cloud (preferably AWS)
  • CI/CD and containerization
  • Bachelor\u0002s in CS or related field
Technical tools mentioned
HadoopSparkHiveSnowflakeSQLJavaScalaPythonInformaticaTalendApache AirflowAWSGit ActionsGitHubGitDockerKubernetesOCP4Shell ScriptSQLite

Job description











Position Description:

We are Canada's largest independent information technology services firm, and after 45 years, we're still growing! Join Canada's largest IT Company as a "Big Data Developer (Java / Scala) - AML Tech" in our Banking Services Division.

This is a hybrid role requiring on-site presence at the Toronto or client office a minimum of 4 days per week (subject to change).






Your future duties and responsibilities:

• Work within an Agile cross functional team to design, develop and maintain data ingestion flows and evolve the platform to orchestrate them.
• Design and implement data pipelines, framework, and ETL processes.
• Ensure data quality, security, and performance.
• Develop and optimize SQL queries, stored procedures, and views.
• Integrate Snowflake with other data sources and BI tools.
• Monitor and troubleshoot data jobs and platform issues.
• Develop and maintain comprehensive documentation for data pipelines, transformations, and data models.







Required qualifications to be successful in this role:

• 5+ years of Experience with Big Data technologies used for ETL: Hadoop, Spark, Hive
• Well versed with Snowflake Platform.
• Strong SQL skills and knowledge of data modeling.
• Programming Experience with Scala or Java an API Development.
• Experience with ETL tools (e.g., Informatica, Talend, Apache Airflow).
• Familiarity with any of the cloud platforms (Preferably AWS).
• Knowledge on Gen AI to generate code and improve developer proficiency
• Knowledge of Python or other scripting languages is a plus.
• Excellent problem-solving and communication skills.
• Knowledge of SCM, Infrastructure-as-code, and CI/CD pipelines.
• Bachelor’s or master’s degree in computer science, Data Engineering and, or a related field.

Nice to Have
• AWS Cloud Knowledge, Glue It
• Experience with workflow management tools like: Apache Airflow
• Experience with Continuous Integration tools – Git Actions, GitHub, Automated Testing tools, Git, or similar tools.
• Experience with Docker/Kubernetes/Containers/OCP4
• Shell Scripting

CGI is providing a reasonable estimate of the pay range for this role. The determination of this range includes factors such as skill set level, geographic market, experience and training, and licenses and certifications. Compensation decisions depend on the facts and circumstances of each case. A reasonable estimate of the current range is $95,000–$145,000. This role is an existing vacancy.

#LI-BN















Skills:

  • Financial Services
  • Hadoop Hive
  • Java
  • Python
  • Scala
  • Snowflake
  • SQLite
  • GIT
  • Shell Script






What you can expect from us:

Together, as owners, let’s turn meaningful insights into action.

Life at CGI is rooted in ownership, teamwork, respect and belonging. Here, you’ll reach your full potential because…

You are invited to be an owner from day 1 as we work together to bring our Dream to life. That’s why we call ourselves CGI Partners rather than employees. We benefit from our collective success and actively shape our company’s strategy and direction.

Your work creates value. You’ll develop innovative solutions and build relationships with teammates and clients while accessing global capabilities to scale your ideas, embrace new opportunities, and benefit from expansive industry and technology expertise.

You’ll shape your career by joining a company built to grow and last. You’ll be supported by leaders who care about your health and well-being and provide you with opportunities to deepen your skills and broaden your horizons.

At CGI, we value the strength that diversity brings and are committed to fostering a workplace where everyone belongs. We collaborate with our clients to build more inclusive communities and empower all CGI partners to thrive. As an equal-opportunity employer, being able to perform your best during the recruitment process is important to us. If you require an accommodation, please inform your recruiter.

To learn more about accessibility at CGI, contact us via email. Please note that this email is strictly for accessibility requests and cannot be used for application status inquiries.

Come join our team—one of the largest IT and business consulting services firms in the world.

About CGI

Provides information technology and business consulting services.

Similar jobs

Big Data Developer roles near Toronto, Ontario
4d
Save
Mark Applied
Hide
Big Data Developer
Mississauga, Ontario, Canada
OnsiteFull Time
Tata Consultancy Services
Tata Consultancy ServicesNational Stock Exchange of India: TCS: Global provider of IT services, consulting, and business solutions.
5+ YOERequires strong experience with Kafka, Spark, Scala, SQL, Hive, Impala, Hadoop, Splunk, and AutoSys; an undergraduate qualification is listed.
AutoSys, Kafka, Spark, Scala, SQL, Hive, Impala, Hadoop, Splunk
1mo
Save
Mark Applied
Hide
Senior Big Data Developer - Vice President
Mississauga, Ontario, Canada
$121k-$171k/yr HybridFull Time
Citi
CitiNYSE: C: A global financial services providing banking and credit services.
6+ YOERequires 6–10 years of Big Data application development experience, management and leadership skills, project management experience, and a bachelor's degree or equivalent experience.
Hadoop, Cloudera, Hive, Impala, Kafka, HBase, Spark, Scala, Java, Oracle, SQL Server, MongoDB, Couchbase, Jenkins, TeamCity, SonarQube, OpenShift, ECS, Kubernetes, AWS EMR, S3, AWS, Snowflake, GCP, JSON, XML, Hypermedia, Apache Hadoop, Apache Hive, Apache Impala, Apache Kafka, Apache Spark, Oracle Database, Python, RDBMS
1mo
Save
Mark Applied
Hide
Senior Big Data Developer - Vice President
Mississauga, Ontario, Canada
$121k-$171k/yr HybridFull Time
Citi
CitiNYSE: C: Global diversified financial services holding.
6+ YOE6+ years Big Data application development experience, team and stakeholder management, strong Hadoop ecosystem (Hive, Impala, Kafka, HBase, Spark), Scala/Java, SQL/NoSQL databases, CI/CD and cloud integration experience.
Apache Hadoop, Cloudera, Hortonworks, Apache Hive, Apache Impala, Apache Kafka, Apache HBase, Apache Spark, Scala, Java, Python, Oracle Database, SQL Server, MongoDB, Couchbase, NoSQL, Jenkins, TeamCity, SonarQube, OpenShift, ECS, Kubernetes, AWS EMR, S3, Snowflake, GCP, JSON, XML
1mo
Save
Mark Applied
Hide
Senior Big Data Developer- Vice President
Mississauga, Ontario, Canada
$121k-$171k/yr HybridFull Time
Citi
CitiNYSE: C: Providing global banking, investment, and wealth management services.
4+ YOE4-5+ years hands-on data engineering experience; strong Spark, ETL, SQL, Linux/AIX shell skills; experience with DevOps tools (BitBucket, TeamCity, uDeploy, JIRA), cloud/microservice design; leadership and architecture experience; bachelor\u0002s degree or equivalent.
Spark, BitBucket, TeamCity, uDeploy, JIRA, SQL, Linux, AIX, Unix Shell scripting, Windows, MAVEN, ANT, GIT, Hibernate, Ajax, IBM WebSphere MQ, C/C++, Perl, Python, Spring, Camel, Autosys, Talend, Load balancer, SSL
5mo
Save
Mark Applied
Hide
Big Data Engineer
Toronto, Ontario, Canada
$100k-$120k/yr HybridFull Time
TMX Group
TMX GroupToronto Stock Exchange: X: Operates global financial markets and exchange trading platforms.
5+ YOE5-8 years IT experience; 4+ years in Big Data; strong AWS; Spark, Hive, Presto; Python/Scala/Java; SQL; data warehousing; Agile; on-call.
AWS, Spark, Hive, Presto, Snowflake, Python, Scala, Shell, Java, Airflow, SQL, Git, Terraform