CGI
Posted 1mo ago

Senior Software Engineer- Azure Databricks Developer

CGI
Bengaluru or Hyderabad
OnsiteFull Time
Responsibilities
  • designing pipelines
  • developing pipelines
  • optimizing jobs
Requirements
  • 5+ years Apache Spark/PySpark and Azure Databricks experience
  • Working with ADLS Gen2, ADF, Synapse
  • Proficiency in Python and SQL
  • Experience with Git and CI/CD
  • Strong data engineering and ETL skills
Technical tools mentioned
Apache SparkPySparkAzure DatabricksADLS Gen2ADFSynapsePythonSQLGitCI/CD

Job description

Position Description:

Company Profile:
Founded in 1976, CGI is among the largest independent IT and business consulting services firms in the world. With 94,000 consultants and professionals across the globe, CGI delivers an end-to-end portfolio of capabilities, from strategic IT and business consulting to systems integration, managed IT and business process services and intellectual property solutions. CGI works with clients through a local relationship model complemented by a global delivery network that helps clients digitally transform their organizations and accelerate results. CGI Fiscal 2024 reported revenue is CA$14.68 billion and CGI shares are listed on the TSX (GIB.A) and the NYSE (GIB). Learn more at cgi.com.

Job Title: Intermediate Azure Databricks Developer
Position: Software Engineer
Experience: 5- 10 Years
Category: Software Development/ Engineering
Main location: Bangalore, Hyderabad
Employment Type: Full Time
#LI-AD12






Your future duties and responsibilities:

Intermediate data bricks developer with 5-9 years of experience

We are seeking a skilled Azure Databricks Developer to design, develop, and optimize big data pipelines using Databricks on Azure. The ideal candidate will have strong expertise in PySpark, Azure Data Lake, and data engineering best practices in a cloud environment.
Key Responsibilities:
Design and implement ETL/ELT pipelines using Azure Databricks and PySpark.
Work with structured and unstructured data from diverse sources (e.g., ADLS Gen2, SQL DBs, APIs).
Optimize Spark jobs for performance and cost-efficiency.
Collaborate with data analysts, architects, and business stakeholders to understand data needs.
Develop reusable code components and automate workflows using Azure Data Factory (ADF).
Implement data quality checks, logging, and monitoring.
Participate in code reviews and adhere to software engineering best practices.







Required qualifications to be successful in this role:

Must Have:
5+ years of experience in Apache Spark / PySpark.
5+ years working with Azure Databricks and Azure Data Services (ADLS Gen2, ADF, Synapse).

Good to Have:
Strong understanding of data warehousing, ETL, and data lake architectures.
Proficiency in Python and SQL.
Experience with Git, CI/CD tools, and version control practices.
CGI is an equal opportunity employer. In addition, CGI is committed to providing accommodation for people with disabilities in accordance with provincial legislation. Please let us know if you require reasonable accommodation due to a disability during any aspect of the recruitment process and we will work with you to address your needs.

#LI-SK38

Life at CGI:
It is rooted in ownership, teamwork, respect and belonging. Here, you’ll reach your full potential because…
You are invited to be an owner from day 1 as we work together to bring our Dream to life. That’s why we call ourselves CGI Partners rather than employees. We benefit from our collective success and actively shape our company’s strategy and direction
Your work creates value. You’ll develop innovative solutions and build relationships with teammates and clients while accessing global capabilities to scale your ideas, embrace new opportunities, and benefit from expansive industry and technology expertise
You’ll shape your career by joining a company built to grow and last. You’ll be supported by leaders who care about your health and well-being and provide you with opportunities to deepen your skills and broaden your horizons. Come join our team, one of the largest IT and business consulting services firms in the world















Skills:

  • ETL
  • SQL






What you can expect from us:

Together, as owners, let’s turn meaningful insights into action.

Life at CGI is rooted in ownership, teamwork, respect and belonging. Here, you’ll reach your full potential because…

You are invited to be an owner from day 1 as we work together to bring our Dream to life. That’s why we call ourselves CGI Partners rather than employees. We benefit from our collective success and actively shape our company’s strategy and direction.

Your work creates value. You’ll develop innovative solutions and build relationships with teammates and clients while accessing global capabilities to scale your ideas, embrace new opportunities, and benefit from expansive industry and technology expertise.

You’ll shape your career by joining a company built to grow and last. You’ll be supported by leaders who care about your health and well-being and provide you with opportunities to deepen your skills and broaden your horizons.

Come join our team—one of the largest IT and business consulting services firms in the world.

About CGI

Provides information technology and business consulting services.

Similar jobs

Software Engineer roles near Bengaluru, Karnataka
4h
Save
Mark Applied
Hide
Senior Spring Boot Developer - Hibernate (IN)
Bengaluru, Karnataka, India
OnsiteFull Time
HCLTech
HCLTechNational Stock Exchange of India: HCLTECH: Global technology providing digital, engineering, and cloud services.
2+ YOERequires Java, Spring Boot, Hibernate, SQL, Eclipse BIRT, REST APIs, microservices, debugging, Agile, and DevOps knowledge; 2–3 years relevant experience and 5+ years total experience preferred.
Java, Eclipse BIRT, SQL, Spring Boot, Hibernate, RESTful APIs, Microservices, Agile, DevOps, CMMI
4h
Save
Mark Applied
Hide
Senior Software Engineer - Confluent Kafka
Bangalore, Karnataka, India
RemoteFull Time
IBM
IBMNew York Stock Exchange: IBM: Global technology providing enterprise software, cloud, and consulting.
4+ YOERequires 4+ years of cloud infrastructure or networking experience, distributed systems expertise, large-scale cloud systems experience, and proficiency in Java, Scala, Go, or another statically typed language.
Java, Scala, Go, JVM, AWS, Azure, GCP, Apache Kafka, Kafka, Flink, Kafka Connect
4h
Save
Mark Applied
Hide
Software Developer
Bengaluru, Karnataka, India
HybridFull Time
SITA
SITA: Provides IT and communication services for the air transport industry.
Bachelor's or master's degree in computer science or engineering, strong C# and software design knowledge, experience with web services, MVC, WPF, XAML, hardware SDK integration, networking, Git, and technical estimation.
C#, XML Web Services, SOAP, REST, MVC, WPF, XAML, Git, LinkedIn Learning
5h
Save
Mark Applied
Hide
Software Developer
Bangalore, Karnataka, India
OnsiteFull Time
Siemens
SiemensXETRA: SIE: Manufactures industrial automation, infrastructure, and energy technology systems.
3+ YOERequires 3–6 years of software development experience, C# and .NET Framework expertise, object-oriented design, debugging, performance testing, automated testing, version control, CI/CD, and Agile experience.
C#, .NET Framework, TFS, Git, CI/CD
5h
Save
Mark Applied
Hide
Senior Software Engineer, Technology
Bengaluru, Karnataka, India
OnsiteFull Time
Point72
Point72: Global alternative investment firm managing capital and venture investments.
6+ YOERequires 6+ years of software development experience, strong Java, SQL, Python, Databricks, AWS, Kubernetes, REST, microservices, Angular, React, and financial systems expertise.
Java, SQL, Python, Databricks, Kubernetes, AWS, Angular, React, Redis, MongoDB, RESTful services, CI/CD
6h
Save
Mark Applied
Hide
Software Engineer I
Bengaluru, Karnataka, India
OnsiteFull Time
American Express
American ExpressNYSE: AXP: Global financial services and credit card payment network.
Bachelor’s degree in computer science or computer engineering, or comparable experience, with software development, application design, object-oriented coding, distributed systems, databases, Agile methods, and automated testing experience.
NoSQL, Scrum, Kanban
7h
Save
Mark Applied
Hide
Senior Software Engineer, Technology
Bengaluru, Karnataka, India
OnsiteFull Time
Point72
Point72: Global multi-strategy asset management and investment advisory firm.
6+ YOERequires 6+ years of software development experience, strong Java expertise, financial products knowledge, SQL and data warehouse experience, Python, Databricks, REST, Kubernetes, AWS, Angular, React, Redis, and MongoDB.
Java, SQL, Python, Databricks, RESTful services, Kubernetes, AWS, Angular, React, Redis, MongoDB, DevOps, CI/CD
7h
Save
Mark Applied
Hide
Software Engineer - Cloud Native Protection
Bengaluru, Karnataka, India
OnsiteFull Time
Rubrik
RubrikNYSE: RBRK: Secures enterprise data across cloud and on-premises environments.
2+ YOEBachelor’s or master’s degree in computer science or related field, 2+ years of relevant experience, programming proficiency, cloud technology experience preferred, and knowledge of distributed systems and software engineering principles.
Go, Java, C, C++, Scala, Python, AWS, Azure, GCP, Docker, Kubernetes