HiringCafe
Tata Consultancy Services
Posted 6d ago

Senior Data Engineer (DataBricks)

Tata Consultancy Services
tcs.comView all open roles
Melbourne, Victoria, Australia
OnsiteFull Time
Responsibilities
  • engineering data
  • developing pipelines
  • implementing analytics
Requirements
  • Degree in engineering
  • Computer science, or related technology
  • 10+ years as a software or data engineer
  • Azure certification
  • Strong SQL/T-SQL, Spark, CI/CD, and engineering practices
Technical tools mentioned
SQLT-SQLSparkCI/CDMicrosoft AzureAzure SynapseAzure SQL Data WarehouseAzure DatabricksAzure Data FactoryAzure Analysis ServicesAzure Machine LearningAzure Cosmos DBAzure Event HubsPower BI

Job description

  • Educated to minimum of degree level in engineering, computer
    science or related technology discipline
  • 10+  years’ experience as a software or data engineer
  • Azure certifications(s) or equivalent
  • Strong level SQL/TSQL
  • Strong level Spark
  • Strong CI/CD experience
  • Strong engineering practices
  • Microsoft Azure data services skills, specifically:
    • Azure Synapse/Azure SQL DW (Useful)
    • Azure DataBricks/Spark (Mandatory)
    • Azure Data Factory (Mandatory)
    • Azure Analysis Services (Useful)
    • Azure ML (Nice to have)
    • Azure Cosmos DB (Useful)
    • Azure EventHubs (Useful)
    • PowerBI (Useful)

About Tata Consultancy Services

Global provider of IT services, consulting, and business solutions.

Year founded
1968
Employees
600000
Industries
Information TechnologyBusiness Services
Activities
IT consultingSoftware developmentBusiness process outsourcingCloud computing servicesDigital transformation services
Organization type
Public
Headquarters
IN

Similar jobs

Data Engineer roles near Melbourne, Victoria
10h
Save
Mark Applied
Hide
Staff Data Engineer
Sydney or Melbourne
HybridFull Time, Part Time
Commonwealth Bank
Commonwealth BankASX: CBA: Provides comprehensive retail, business, and institutional financial services.
Requires AWS data engineering experience, strong Python, PySpark, SQL, Spark, Scala, and distributed processing skills, plus AWS platforms, governance, security, automation, CI/CD, and data mesh expertise.
AWS Cloud, Python, PySpark, Scala, SQL, Spark, AWS Glue, AWS Lambda, Amazon Redshift, Amazon Athena, Amazon Kinesis, Amazon EMR, AWS DataZone, AWS Lake Formation, IAM, Cline, Roo, Aider, AWS Marketplace, Amazon API Gateway, Terraform, AWS CloudFormation, GitOps, Snowflake, Apache Iceberg
Job PostingView all
1d
Save
Mark Applied
Hide
Data Engineer
Melbourne, Victoria, Australia
HybridFull Time, Contract
Infosys
InfosysNYSE: INFY: Global provider of digital services and IT business consulting.
Expertise in AWS, advanced SQL, Python or Java, CI/CD, Databricks, MLOps, data pipelines, data platforms, and Power BI or Tableau; collaboration with technical and business stakeholders required.
AWS, SQL, Python, CI/CD, Databricks, MLOps, Power BI, Tableau, GitHub, GitHub Actions, Java
Job PostingView all
2d
Save
Mark Applied
Hide
Databricks Data Engineer Senior Analyst
Brisbane or Sydney or Melbourne
OnsiteFull Time
Avanade
Avanade: Provider of digital and cloud services on Microsoft platforms.
2+ YOE2+ years of Azure Databricks experience; proficiency in Spark, PySpark, Python or Scala, ETL/ELT, data modeling, and data warehousing. Australian citizenship and security-clearance eligibility required.
Azure Databricks, Azure Data Factory, Apache Spark, PySpark, Azure Synapse, Azure Blob Storage, Delta Lake, Python, Scala, Azure DevOps, Git, Terraform, SQL, NoSQL
Job PostingView all
2d
Save
Mark Applied
Hide
Databricks Data Engineer Senior Analyst
Brisbane or Melbourne or Sydney
OnsiteFull Time
Avanade
Avanade: Provides Microsoft-focused IT consulting and digital transformation services.
2+ YOERequires 2+ years of Azure Databricks experience, Spark/PySpark, Azure data services, Python or Scala, ETL/ELT, SQL/NoSQL, governance, and Agile experience. Australian citizenship and security-clearance eligibility required.
Azure Databricks, Azure Data Factory, Apache Spark, PySpark, Azure Synapse, Azure Blob Storage, Delta Lake, Python, Scala, Azure DevOps, Git, Terraform, SQL, NoSQL
Job PostingView all
3d
Save
Mark Applied
Hide
Senior Data Engineer (DBT and Databricks/Snowflake)
Melbourne, Victoria, Australia
OnsiteFull Time
NCS Australia
NCS AustraliaSGX: Z74: Provides IT consulting, cloud services, and digital transformation solutions.
5+ YOERequires Databricks or Snowflake, dbt, SQL, cloud platforms, Git, CI/CD, workflow orchestration, modern data architecture, analytical skills, stakeholder management, and technical leadership.
Databricks, PySpark, Spark SQL, Snowflake, dbt Core, dbt Cloud, SQL, Azure, AWS, GCP, Git, CI/CD, Airflow, Azure Data Factory
Job PostingView all
3d
Save
Mark Applied
Hide
Data Engineer
Melbourne, Victoria, Australia
HybridFull Time
Service Stream
Service StreamAustralian Securities Exchange: SSM: Provides essential network services for telecommunications, utilities, and transport.
3+ YOERequires 3–4 years of data engineering experience, end-to-end pipeline and data modeling expertise, Microsoft Fabric or Azure experience, Delta Lake, Power BI, and strong stakeholder communication skills.
Microsoft Fabric, Data Factory, Lakehouse, Notebooks, Delta tables, Python, Spark SQL, Power BI, Direct Lake, Git, OneLake, Azure, Synapse, Databricks, Delta Lake, DP-700, DP-900
Job PostingView all
1w
Save
Mark Applied
Hide
Senior Associate Data Engineering
Melbourne, Victoria, Australia
OnsiteFull Time
Publicis Groupe
Publicis GroupeEuronext Paris: PUB: Global advertising and digital transformation agency holding.
Expertise in modern data architecture, cloud platforms, scalable data pipelines, Snowflake or Databricks, Python, SQL, distributed systems, CI/CD, automated testing, and infrastructure as code.
Terraform, CloudFormation, Azure Resource Manager, Helm, Google Cloud Deployment Manager, Snowflake, Databricks, Python, SQL, CI/CD
Job PostingView all
1w
Save
Mark Applied
Hide
Data Engineer - Senior
Melbourne, Victoria, Australia
HybridContract
Worldline
WorldlineEuronext Paris: WLN: Global provider of payment and digital transaction services.
Significant data engineering experience with enterprise pipelines, SQL, ETL/ELT, integrations, data modelling, reporting, analytics, and stakeholder communication. An IT, computer science, or data engineering degree is required.
SQL, Microsoft Azure, Amazon Web Services (AWS), Microsoft Fabric, Azure Data Factory, Microsoft Power BI, Python, ServiceNow
Job PostingView all