CGI
Posted 1mo ago

Sr. Databricks Developer / Lead

CGI
Bengaluru or Chennai
HybridFull Time
Responsibilities
  • designing data
  • building pipelines
  • leading teams
Requirements
  • 5+ years data engineering experience
  • 3+ years Databricks
  • Strong PySpark/SQL/Python
  • Deep AWS knowledge
  • Databricks Lakehouse
  • Delta Lake
  • Unity Catalog
  • Terraform
  • DevOps
  • MLflow and Power BI experience
Technical tools mentioned
PySparkSQLPythonDatabricksDelta LakeUnity CatalogWorkflowsSQL WarehousesS3GlueLambdaEMRStep FunctionsCloudWatchVPCTerraformGitReposDatabricks CLI/SDKCI/CDPhotonServerlessMLflowFeature StoreModel ServingMicrosoft Power BIDAXGitHubSQLiteAWS AI Services

Job description

Position Description:

Founded in 1976, CGI is among the world's largest independent IT and business consulting services firms. With 94,000 consultants and professionals globally, CGI delivers an end-to-end portfolio of capabilities, from strategic IT and business consulting to systems integration, managed IT and business process services, and intellectual property solutions. CGI works with clients through a local relationship model complemented by a global delivery network that helps clients digitally transform their organizations and accelerate results. CGI Fiscal 2024 reported revenue is CA$14.68 billion, and CGI shares are listed on the TSX (GIB.A) and the NYSE (GIB). Learn more at cgi.com.

Job Title: Sr. Databricks Developer / Lead
Position: LA / AC
Experience: 7+ years of experience
Job location: Bangalore / Chennai
Position ID: J0526-2138
Work Type: Hybrid
Employment Type: Full Time / Permanent
Qualification: Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.

Looking for Databricks expert with strong data engineering skills and deep AWS cloud expertise. To lead the design, build, and deployment of data products on the Databricks Lakehouse platform, ensuring scalability, governance, security, and business value delivery. 

The role requires mastery in Databricks features, Delta Lake, AWS ecosystem integration, and modern Data Engineering best practices.

Primary Responsibilities
.    Design, build, and manage data products and event driven architecture using Databricks Lakehouse principles.
.    Design end-to-end data pipelines using PySpark, Databricks SQL.
.    Define Data Product blueprint including domain boundaries, ownership, SLAs, documentation, quality rules.
.    Implement modern ingestion frameworks using Auto Loader, Delta Live Tables, Workflows.
.    Develop multi-zone medallion architecture (Bronze/Silver/Gold) using Delta Lake.
.    Lead Databricks on AWS integration including S3 access, IAM roles, VPC networking.
.    Implement Unity Catalog governance frameworks, fine-grained permissions, lineage tracking.
.    Drive automation & DevOps practices using Git, Repos, Databricks CLI/SDK, CI/CD pipelines.
.    Build and optimize Spark workloads for performance and cost control (Photon/Serverless tuning).
.    Lead performance reviews, code quality checks, and data engineering guidance for teams.
.    Operationalize Machine Learning and advanced analytics with MLflow/Feature Store/Model Serving.
.    Monitor and enhance reliability using job monitoring, observability dashboards, alerts.
.    Hands-on development of Power BI dashboards, DAX measures, data models, direct Query/Import mode
.    Evaluate new Databricks features and adopt innovation into technical roadmap.

Technical Skills Required
. Strong programming experience in PySpark, SQL & Python for production-grade data pipelines.
. Deep mastery in Databricks, Delta Lake, Unity Catalog, Workflows, SQL Warehouses.
. Expert knowledge of AWS services: S3, Glue, Lambda, EMR, Step Functions, CloudWatch, VPC networking.
. Experience building data products with versioning, discoverability, contracts, metadata & lineage.
. Good understanding of Infra-as-Code: Terraform (workspace, clusters, UC policies, jobs, service principals).
. Strong foundation in data modeling, schema design, Lakehouse & Data Mesh principles.
. Familiar with governance & security frameworks (encryption, tokenization, row/column controls).
. Experience with enterprise integrations (Power BI).

Qualifications
. 5–10 years of professional Data Engineering experience.
. Minimum 3+ years hands-on with Databricks (production scale).
. Proven experience in delivering Data Products on cloud Lakehouse platforms.

Soft Skills
. Strong ownership mindset with Data Product thinking.
. Excellent communication and ability to translate architecture for business stakeholders.
. Ability to lead engineering teams and influence architecture decisions.
. Continuous innovation mindset with focus on automation, performance & reusability.

CGI is an equal opportunity employer. In addition, CGI is committed to providing accommodation for people with disabilities in accordance with provincial legislation. Please let us know if you require reasonable accommodation due to a disability during any aspect of the recruitment process and we will work with you to address your needs.

#LI-GB9






















Skills:

  • AWS AI Services
  • Databricks
  • DevOps
  • GitHub
  • SQLite






What you can expect from us:

Together, as owners, let’s turn meaningful insights into action.

Life at CGI is rooted in ownership, teamwork, respect and belonging. Here, you’ll reach your full potential because…

You are invited to be an owner from day 1 as we work together to bring our Dream to life. That’s why we call ourselves CGI Partners rather than employees. We benefit from our collective success and actively shape our company’s strategy and direction.

Your work creates value. You’ll develop innovative solutions and build relationships with teammates and clients while accessing global capabilities to scale your ideas, embrace new opportunities, and benefit from expansive industry and technology expertise.

You’ll shape your career by joining a company built to grow and last. You’ll be supported by leaders who care about your health and well-being and provide you with opportunities to deepen your skills and broaden your horizons.

That same commitment to fairness extends to how we use technology. To support our recruitment team, AI tools may be used to help assess applications though they never replace human judgement. All hiring decisions remain entirely in the hands of our recruitment professionals.

Come join our team—one of the largest IT and business consulting services firms in the world.

About CGI

Provides information technology and business consulting services.

Similar jobs

Databricks Developer roles near Bengaluru, Karnataka
1w
Save
Mark Applied
Hide
Lead Assistant Manager
Bengaluru, Karnataka, India
HybridFull Time
EXL
EXLNASDAQ: EXLS: Provides data analytics and digital operations solutions to businesses.
6+ YOEBachelor’s or master’s degree and 6+ years in data or software engineering, including 3+ years with Databricks, 4+ years with PySpark, expert SQL, Python, cloud platforms, and distributed computing.
Databricks, Databricks Workspaces, Databricks Clusters, Databricks Jobs, Databricks Workflows, Databricks Repos, Unity Catalog, Delta Live Tables (DLT), Delta Lake, Databricks SQL Warehouses, SQL Analytics, Databricks Photon, PySpark, Spark SQL, RDD, SQL, Python, Azure, ADLS Gen2, ADF, Azure Databricks, AWS, S3, EMR, Glue, AWS Databricks, GCP, GCS, BigQuery, Dataproc, Kafka, Event Hubs, Kinesis, MLflow, Databricks Feature Store, Mosaic AI, Azure Key Vault, AWS Secrets Manager, Azure DevOps, GitHub Actions, GitLab CI, Databricks Asset Bundles (DABs), Terraform, Fivetran, dbt, Airbyte, Great Expectations
1w
Save
Mark Applied
Hide
Databricks Developer
Bangalore, Karnataka, India
OnsiteFull Time
UST
UST: Global provider of digital transformation and IT services.
5+ YOERequires 5+ years in data engineering, with hands-on Databricks, Apache Spark, Python, SQL, CI/CD, data modeling, ETL/ELT, automation, distributed systems, and Databricks Genie experience.
Databricks, Apache Spark, PySpark, Delta Lake, Spark SQL, Python, SQL, Git, GitHub Actions, Jenkins, Databricks Genie
1w
Save
Mark Applied
Hide
Senior Consultant | Azure Databricks | Bengaluru | Engineering | Data Modernization & Migration
Bengaluru, Karnataka, India
OnsiteFull Time
Deloitte
Deloitte: Professional services firm providing audit, consulting, and advisory services.
5+ YOERequires 5+ years of relevant experience, Databricks, PySpark, SQL, cloud platform experience, data architecture, Delta Lake, ETL/ELT, DevOps, and strong stakeholder communication skills.
Databricks, PySpark, SQL, Microsoft Azure, Amazon Web Services (AWS), Google Cloud Platform (GCP), Delta Lake, Delta Live Tables (DLT), Unity Catalog, Databricks Workflows, Serverless Compute, Genie, Mosaic AI, Databricks Data Intelligence Platform, GitHub, CI/CD, DevOps, Python, ETL, ELT, Spark
4w
Save
Mark Applied
Hide
Databricks Engineer
Bangalore, Karnataka, India
OnsiteFull Time
NTT DATA
NTT DATA: Global provider of IT and business consulting services.
Experience with SQL, Python, Databricks, Snowflake, Delta Lake, data pipeline development, Git, unit testing, validation, and delivery of cloud data engineering migrations.
SQL, Python, Databricks, Snowflake, Delta Lake, Git
1mo
Save
Mark Applied
Hide
Databricks SR Engineer
Bengaluru, Karnataka, India
OnsiteFull Time
Tata Consultancy Services
Tata Consultancy ServicesNational Stock Exchange of India: TCS: Global provider of IT services, consulting, and business solutions.
3+ YOE3+ years experience in Databrick data modelling, ELT/ETL, data migration to cloud data warehouse, data security and access controls; Agile experience and strong communication skills.
Databrick, Databrick SQL, Microsoft Azure, RDBMS, ELT, ETL, DWH
1mo
Save
Mark Applied
Hide
Databricks Engineer, Data Platform & Data Science Tooling
Bangalore, Karnataka, India
OnsiteFull Time
Magna International
Magna InternationalNYSE: MGA: Designs and manufactures automotive systems and complete vehicle assemblies.
4+ YOE4+ years data engineering experience, 2+ years Azure Databricks, 3+ years hands-on PySpark/Delta Lake/Databricks/Unity Catalog/Workflows, strong SQL and Python skills, CI/CD experience (Azure DevOps or GitHub Actions), familiarity with Terraform and Power BI.
PySpark, Delta Lake, Workflows, Unity Catalog, Databricks, Databricks Delta Live Tables, Databricks SQL, SQL, Python, Power BI, Azure DevOps, GitHub Actions, Terraform
2mo
Save
Mark Applied
Hide
Principal Databricks Developer
Bengaluru, Karnataka, India
HybridFull Time
Astellas Pharma
Astellas PharmaTokyo Stock Exchange: 4503: Global developing and manufacturing pharmaceutical therapies for patients.
12+ YOE12+ years data engineering experience (5+ on Databricks), bachelor’s in CS/Engineering or equivalent, deep Delta Lake and Databricks expertise, Python/PySpark/SQL proficiency, cloud and warehouse experience, Git and DevOps tooling.
Databricks, PySpark, Python, SQL, Spark SQL, Auto Loader, Delta Live Tables, Delta Sharing, Unity Catalog, MLflow, Synapse, Snowflake, Redshift, Informatica, Talend, Azure, AWS, GCP, Azure DevOps, GitHub, Bitbucket, Databricks Workflows, Databricks Asset Bundles (DABs), Photon, Streamlit, Shiny, Gradio, YAML, Git
8mo
Save
Mark Applied
Hide
Databricks Developer (m/f/d)
Bengaluru, Karnataka, India
OnsiteFull Time, Part Time
Deutsche Telekom
Deutsche TelekomFrankfurt Stock Exchange: DTE: Provides global telecommunications, mobile connectivity, and IT infrastructure services.
5+ YOE5+ years in DevOps/cloud operations or data platform support; proficiency with Azure, Databricks, Python/Bash, CI/CD, and infrastructure-as-code; strong troubleshooting and security awareness.
Databricks, Azure, Data Lake, Synapse, Key Vault, Terraform, ARM templates, Azure Monitor, Log Analytics, Prometheus, Databricks Security Analysis Tool (SAT), Azure DevOps, GitHub Actions, Python, Bash, Unity Catalog, RBAC