HiringCafe
Virtusa
Posted 2w ago

Databricks Data Engineer

Virtusa
virtusa.comView all open roles
Bengaluru, Karnataka, India
OnsiteFull Time
Responsibilities
  • designing pipelines
  • developing pipelines
  • optimizing performance
Requirements
  • Hands-on experience with Azure Databricks
  • Apache Spark (PySpark)
  • Spark SQL
  • Delta Lake
  • ETL/ELT
  • Lakehouse architecture
  • Python and SQL
  • Familiarity with Azure Data Lake Storage
  • Unity Catalog
  • Kafka/Event Hubs
  • Git CI/CD, and Terraform
Technical tools mentioned
Azure DatabricksApache Spark (PySpark)Spark SQLDelta LakeAzure Data Lake StorageUnity CatalogKafkaEvent HubsPythonSQLGitTerraformAzure

Job description

















"We are seeking a Databricks Data Engineer to design, develop, and optimize scalable data pipelines supporting enterprise analytics, AI/ML, and Agentic AI solutions.
The ideal candidate should have strong hands-on experience with Azure Databricks, Apache Spark (PySpark), Spark SQL, and Delta Lake for building batch and streaming data pipelines. 
Experience with Azure Data Lake Storage, Unity Catalog, Kafka/Event Hubs, and data integration patterns is essential. The role requires expertise in ETL/ELT development, Lakehouse architecture, and data quality best practices. 
Candidates should be proficient in Python, SQL, Git-based CI/CD, and Terraform.
Experience with Azure cloud services and performance tuning of Spark workloads is highly desirable. 
The engineer will collaborate with data scientists, MLOps engineers, and platform teams to deliver reliable, governed, and scalable data solutions.
Strong analytical, troubleshooting, and communication skills are essential in a collaborative enterprise environment."










"We are seeking a Databricks Data Engineer to design, develop, and optimize scalable data pipelines supporting enterprise analytics, AI/ML, and Agentic AI solutions.
The ideal candidate should have strong hands-on experience with Azure Databricks, Apache Spark (PySpark), Spark SQL, and Delta Lake for building batch and streaming data pipelines. 
Experience with Azure Data Lake Storage, Unity Catalog, Kafka/Event Hubs, and data integration patterns is essential. The role requires expertise in ETL/ELT development, Lakehouse architecture, and data quality best practices. 
Candidates should be proficient in Python, SQL, Git-based CI/CD, and Terraform.
Experience with Azure cloud services and performance tuning of Spark workloads is highly desirable. 
The engineer will collaborate with data scientists, MLOps engineers, and platform teams to deliver reliable, governed, and scalable data solutions.
Strong analytical, troubleshooting, and communication skills are essential in a collaborative enterprise environment."



















About Virtusa

Global provider of digital engineering and IT outsourcing services.

Year founded
1996
Employees
30000
Industries
Information TechnologyBusiness Consulting
Activities
Software EngineeringDigital Transformation ServicesIT OutsourcingApplication DevelopmentIT Consulting
Organization type
Private
Latest investment
Private Equity (2021) — led by Baring Private Equity Asia
Headquarters
US

Similar jobs

Data Engineer roles near Bengaluru, Karnataka
8h
Save
Mark Applied
Hide
Data Engineering Snowflake Lead Engineer _ Vice President _Data Engineering
Bengaluru, Karnataka, India
OnsiteFull Time
Morgan Stanley
Morgan StanleyNYSE: MS: Global financial services firm providing investment and wealth management.
8+ YOERequires 8+ years in data engineering or a related field, with Python, Snowflake Cortex, Databricks, SQL/NoSQL, data modeling, cloud platforms, and data pipeline experience.
Snowflake, Python, SQL/PLSQL, Snowflake Cortex, Apache Spark, Hadoop, SQL, NoSQL, Databricks, AWS, Azure, Kafka, Git, Jupyter, Tableau, Power BI, Collibra
Job PostingView all
18h
Save
Mark Applied
Hide
Data Engineer
Bengaluru or India
OnsiteFull Time
Accenture
AccentureNYSE: ACN: Global professional services firm providing consulting and technology solutions.
3+ YOEMinimum 3 years of experience, 15 years of full-time education, and Databricks expertise. Requires Python, SQL, Spark/PySpark, cloud data engineering, ETL/ELT, orchestration, streaming, and performance tuning skills.
Databricks Unified Data Analytics Platform, PySpark, Apache Spark, AWS, Microsoft Azure, Google Cloud Platform (GCP), Python, SQL, Amazon S3, Azure Blob Storage, Google BigQuery, Amazon Redshift, Apache Airflow, Parquet, Avro, JSON, Apache Kafka, dbt (Data Build Tool), Informatica, Talend, Matillion
Job PostingView all
18h
Save
Mark Applied
Hide
Data Engineer, YouTube Business Organization
Bengaluru, Karnataka, India
OnsiteFull Time
Google
GoogleNASDAQ: GOOGL: Provides online search, advertising, cloud computing, and consumer electronics.
3+ YOEBachelor's degree or equivalent practical experience, 3+ years coding and building data pipelines, dimensional models, data infrastructure, and exploratory queries; SQL and data platform experience required.
Flume, Dataflow, Apache Spark, SQL, Extract, Transform, Load (ETL)
Job PostingView all
20h
Save
Mark Applied
Hide
Data Engineer-I, SmartCommerce
Bengaluru, Karnataka, India
OnsiteFull Time
Amazon
AmazonNASDAQ: AMZN: Global online retail and cloud computing technology provider.
1+ YOEBachelor's degree, 1+ year of data engineering experience, data modeling, warehousing, ETL pipeline development, query and scripting language experience; AWS and ETL tools preferred.
SQL, PL/SQL, DDL, MDX, HiveQL, SparkSQL, Scala, Python, KornShell, AWS, Redshift, Amazon S3, AWS Glue, EMR, Kinesis, Firehose, AWS Lambda, IAM, Informatica, ODI, SSIS, BODI, Datastage
Job PostingView all
20h
Save
Mark Applied
Hide
Software Engineer - Data Engineer - Bangalore, India
Bangalore, Karnataka, India
OnsiteFull Time, Contract
Societe Generale
Societe GeneraleEuronext Paris: GLE: Global provider of retail, investment, and private banking services.
5+ YOERequires at least 5 years of data engineering and 3 years of Azure experience, with expertise in ETLs, SQL, databases, data modeling, Azure services, scripting, and data architectures.
Microsoft Office, Microsoft Azure, Microsoft Azure DevOps, CI/CD, Azure Synapse, Databricks, PowerShell, Python, Bash, Microsoft Fabric, Microsoft Power BI, Microsoft Power Automate, SQL, SQL Server, ETLs
Job PostingView all
20h
Save
Mark Applied
Hide
Associate Principal - Data Engineering
Bengaluru, Karnataka, India
OnsiteFull Time
LTIMindtree
LTIMindtreeNational Stock Exchange of India: LTIM: Global technology consulting and digital solutions.
11+ YOERequires 11–15 years of experience designing Microsoft Fabric data engineering solutions, pipelines, real-time streaming, warehousing, governance, security, performance tuning, and technical leadership.
Microsoft Fabric
Job PostingView all
22h
Save
Mark Applied
Hide
DE&A - Core - Advanced Data Engineering - Advanced Data Engineering (Other)
Bangalore or India
OnsiteFull Time
Zensar
ZensarNational Stock Exchange of India: ZENSARTECH: Global technology firm providing digital transformation and infrastructure services.
4+ YOERequires 4–7 years of experience designing, modeling, developing, building, and deploying data engineering solutions and pipelines on GCP, including BigQuery; strong communication skills preferred AI/ML knowledge.
Google Cloud Platform (GCP), BigQuery, AI/ML, Agentic AI
Job PostingView all
23h
Save
Mark Applied
Hide
Engineer, Data Engineering
Bangalore, Karnataka, India
OnsiteFull Time
News Corp
News CorpNasdaq: NWSA: Global media, publishing, and digital information services.
2+ YOERequires 2–4 years of data engineering experience, GCP expertise, BigQuery, Dataform, Cloud Composer, Dataproc, Python, SQL, data modeling, CI/CD, and infrastructure-as-code experience.
Google Cloud Platform (GCP), BigQuery, BigLake, PySpark, Dataproc, Python, SQL, Cloud Composer, Airflow, Terraform, CircleCI, GitHub, Dataform, Cloud Storage, Cloud Functions
Job PostingView all