EPAM Systems
Posted 1w ago

Lead Data Engineer

EPAM Systems
Australia
RemoteFull Time
Responsibilities
  • modeling data
  • building pipelines
  • documenting decisions
Requirements
  • Requires dimensional modeling
  • Python
  • Databricks, dbt, SQL, ETL
  • Data warehousing
  • End-to-end delivery
  • Documentation
  • Stakeholder communication, and autonomous working skills
Technical tools mentioned
DatabricksdbtPythonSQLConfluenceBI

Job description

We are seeking a Lead Data Engineer to own end-to-end data modeling and pipeline delivery as a major enterprise data lake is re-architected. You will work hands-on with Databricks and dbt, partner closely with US-based stakeholders and collaborate with an India-based engineering team. You thrive with high autonomy, clear documentation and strong ownership.

Responsibilities

  • Own dimensional data models from requirements through deployment using Kimball-aligned patterns
  • Design, build and maintain pipelines in Databricks and dbt to support a modernised data lake
  • Translate business requirements into scalable datasets, anticipating future reporting and analytics needs
  • Lead end-to-end delivery including development, unit testing, UAT support and release coordination
  • Produce clear technical documentation in Confluence and maintain decision records and data definitions
  • Partner with US-based stakeholders to align outcomes, scope and delivery expectations
  • Collaborate with an India-based engineering team to coordinate build, reviews and handovers
  • Support basic dashboarding and validation to confirm data meets business expectations

Requirements

  • Dimensional modeling capability including star schema, fact and dimension design and aggregate awareness
  • Hands on experience with python programming
  • Databricks experience for data engineering development and operational support dbt (data build tool) experience including modular modelling, testing and deployment practices
  • SQL proficiency for analytics-grade transformations and performance-aware querying
  • Traditional ETL and data warehousing foundation adapted to modern cloud data stacks
  • End-to-end delivery ownership across requirements, build, testing, UAT and deployment
  • Clear communication and strong documentation habits for non-technical stakeholder engagement
  • Self-directed working style with comfort operating under light-touch leadership

Nice to have

  • Experience re-architecting enterprise data lakes or data warehouses in multi-phase programs
  • Familiarity with release planning across distributed teams and time zones
  • Exposure to basic BI development or semantic layer design to support reporting consumption

We offer/Benefits

  • By choosing EPAM, you're getting a job at Great Place To Work-Certified™ in 2024, Glassdoor’s Top 100 Best Places to Work in 2023 & one of Most Loved Workplace, as recognized by Newsweek, 2021 - 2023.

  • Employee ideas are the main driver of our business. We have a very supportive environment where your voice matters.

  • You will be challenged while working side-by-side with the best talent globally. We work with top-notch technologies, constantly seeking new industry trends and best practices.

  • We offer a transparent career path and an individual roadmap to engineer your future & accelerate your journey.

  • At EPAM, you can find vast opportunities for self-development: online courses and libraries, mentoring programs, partial grants of certification, and experience exchange with colleagues around the world. You will learn, contribute, and grow with us.

Life at EPAM

- We are a leading global provider of digital platform engineering and development services that has rapidly grown in Australia since 2013.

- We adopt a global growth strategy, thinking and acting like start-ups, working in multi-disciplinary teams, and delivering results. With a multinational talented team, we have been delivering innovative solutions for cloud migration, cyber security, digital transformation, etc.  

- You will work in an open and friendly work environment where your professional skills and experience can stand out.

• Here, we summarize the typical journey to finding a job within EPAM.

• Apply and tell us about yourself!

• Go through some standard interviews:

  • General interview with a recruiter
  • Technical interview with our technology experts
  • Manager interview or Offer interview with a hiring manager

• Get ready to join the team!

• Not sure if you meet all the requirements? No problem. Let's talk anyway and find out more!

• It takes 1 min of application to start the journey with us. Apply now!

About EPAM Systems

Provides global digital platform engineering and software development services.

Similar jobs

Data Engineer roles
20h
Save
Mark Applied
Hide
Staff Data Engineer
Sydney or Melbourne
HybridFull Time, Part Time
Commonwealth Bank
Commonwealth BankASX: CBA: Provides comprehensive retail, business, and institutional financial services.
Requires AWS data engineering experience, strong Python, PySpark, SQL, Spark, Scala, and distributed processing skills, plus AWS platforms, governance, security, automation, CI/CD, and data mesh expertise.
AWS Cloud, Python, PySpark, Scala, SQL, Spark, AWS Glue, AWS Lambda, Amazon Redshift, Amazon Athena, Amazon Kinesis, Amazon EMR, AWS DataZone, AWS Lake Formation, IAM, Cline, Roo, Aider, AWS Marketplace, Amazon API Gateway, Terraform, AWS CloudFormation, GitOps, Snowflake, Apache Iceberg
1d
Save
Mark Applied
Hide
Data Engineer
Melbourne, Victoria, Australia
HybridFull Time, Contract
Infosys
InfosysNYSE: INFY: Global provider of digital services and IT business consulting.
Expertise in AWS, advanced SQL, Python or Java, CI/CD, Databricks, MLOps, data pipelines, data platforms, and Power BI or Tableau; collaboration with technical and business stakeholders required.
AWS, SQL, Python, CI/CD, Databricks, MLOps, Power BI, Tableau, GitHub, GitHub Actions, Java
1d
Save
Mark Applied
Hide
Senior Data Engineer
Sydney, New South Wales, Australia
OnsiteFull Time
Healius
HealiusASX: HLS: Provides diagnostic pathology and medical imaging services across Australia.
10+ YOERequires 10+ years in senior data engineering, advanced SQL and Python, enterprise data platform experience, data governance expertise, Kubernetes administration, and DevOps automation skills.
SQL, Python, JSON, YAML, Snowflake, Informatica, PostgreSQL, Kubernetes, Azure Data Services, Neo4j, SAP, Bash, Windows Server, Power BI Gateway, CI/CD, DevOps, infrastructure-as-code, Medallion
1d
Save
Mark Applied
Hide
Lead Data Engineer - Azure
Sydney or Darling Park
HybridFull Time
Rabobank
Rabobank: Global banking services specializing in food and agricultural financing.
10+ YOE10+ years in data engineering or warehousing; advanced Azure data platform experience, SQL, data modeling, Python/PySpark/Scala, governance, security, DevOps, and scalable pipeline design.
Microsoft Azure, Azure Data Factory, Azure Synapse Analytics, Azure Databricks, Azure Data Lake Storage, Microsoft Fabric, Azure SQL, SQL, Python, PySpark, Scala, Git, Azure DevOps, Microservices, APIs
1d
Save
Mark Applied
Hide
Graduate Data Engineer
Tonsley, South Australia, Australia
OnsiteFull Time
Chrysos
ChrysosAustralian Securities Exchange (ASX): C79: Providing rapid and sustainable mineral analysis technology for mining.
Degree in computer science, software or data engineering, or data science; programming skills in Python or SQL; database and data structure knowledge; and demonstrated software or systems development interest.
Snowflake, AWS, Amazon S3, AWS Glue, AWS Lambda, Python, Power BI, Grafana, Git, dbt, SQL
1d
Save
Mark Applied
Hide
Lead Data Engineer
Brisbane, Queensland, Australia
OnsiteFull Time
CIMIC Group
CIMIC Group: International engineering, construction, and mining services provider.
Experience leading data engineering teams and building enterprise-scale cloud data platforms, lakehouses, integrations, models, analytics solutions, governance frameworks, and delivery practices.
CI/CD, DevOps
1d
Save
Mark Applied
Hide
Lead Data Engineer
Brisbane, Queensland, Australia
OnsiteFull Time
Thiess
Thiess: Providing contract mining services for open cut and underground operations
Experience leading data engineering teams and building enterprise-scale cloud data platforms, lakehouses, integrations, models, governance, and analytics solutions in complex operational environments.
CI/CD, DevOps
2d
Save
Mark Applied
Hide
Principal Data Engineer (Apache Spark, dbt, Airflow)
Sydney, New South Wales, Australia
HybridFull Time
ASX
ASXASX: ASX: Operates Australia's primary securities exchange and financial market infrastructure.
10+ YOE10+ years of data engineering experience, large-scale AWS data platforms, Apache Spark, dbt, Airflow, distributed processing, modern data architecture, Terraform, and governance experience.
Apache Spark, dbt, Airflow, AWS, Redshift, Apache Iceberg, Terraform, JSON, Parquet, Avro, XML, Confluence, JIRA, ServiceNow