Encora
Posted 1mo ago

Lead Data Engineer

Encora
Brazil
RemoteFull Time
Responsibilities
  • leading team
  • designing architecture
  • building pipelines
Requirements
  • Hands-on experience with Snowflake
  • Azure Databricks, DBT
  • Python and SQL
  • Terraform, CI/CD and Git
  • Experience leading data platform design
  • Cloud-to-cloud migrations and managing engineering teams
Technical tools mentioned
DBTPythonSQLSnowflakeDatabricksAzure DatabricksSSISTerraformGitAWSAzureKafkaEvent HubsDelta Live TablesCI/CD

Job description

Job Title: Lead Data Engineer

Key Skills: DBT, Python, SQL, Snowflake, Databricks

Location: Brazil

Mode: Remote

We at Coforge are hiring Lead Data Engineer with the following skill set.

Key Responsibilities

  • Lead and mentor a team of data engineers, setting technical direction, conducting code reviews, and promoting engineering excellence.
  • Own the end-to-end architecture and design of the data platform, ensuring scalability, reliability, and alignment with business needs.
  • Take full ownership of implementation delivery, from design through deployment, ensuring high-quality, production-ready solutions.
  • Define and drive the data migration strategy from Snowflake / SSIS to Azure Databricks and DBT, including architecture decisions and execution oversight.
  • Collaborate closely with cross-functional stakeholders (data, product, architecture, and business teams) to translate requirements into robust technical designs.
  • Design and oversee the development of scalable data pipelines and data models, ensuring best practices in performance and maintainability.
  • Lead the implementation of infrastructure-as-code using Terraform, enforcing consistency and automation across environments.
  • Establish and enforce architectural standards, design patterns, and engineering best practices across the data ecosystem.
  • Ensure reliable and efficient data integration between Legacy system and Azure environments, with strong focus on data quality and observability.
  • Drive CI/CD adoption and oversee release processes for data pipelines and platform components.
  • Act as the primary technical owner for troubleshooting complex issues and ensuring long-term stability of the platform.
  • Maintain comprehensive documentation of architecture, design decisions, and implementation standards.

 

Required Skills & Qualifications

  • Proven experience owning system design and leading implementations of large-scale data platforms.
  • Strong hands-on expertise with Snowflake, Azure Databricks, and DBT with strong Python.
  • Will have worked on large scale data transformations comprising of thousands of DBT models and data pipelines handling terabytes of data daily
  • Deep understanding of data architecture, data modelling, and distributed data systems.
  • Extensive experience with Terraform and infrastructure-as-code principles.
  • Demonstrated experience leading cloud-to-cloud data migration projects (AWS to Azure preferred).
  • Strong experience with CI/CD pipelines and Git-based version control.
  • Advanced SQL skills and deep knowledge of ETL/ELT frameworks.
  • Strong problem-solving skills with the ability to make architectural trade-offs and decisions.
  • Excellent communication skills, with the ability to influence both technical and non-technical stakeholders.
  • Ability to thrive in a fast-paced, ownership-driven environment.
  • Previous experience in the insurance or financial sector industry, with strong understanding of core domains such as claims, policies, underwriting, and risk.
  • Will have manged teams with a level of maturity and able to demonstrate key success outcomes with these teams.
  • Will have managed low, mid and top performers within the team to get the best from them via mentoring, development and training needs where needed.

 

Preferred Skills:

  • Experience implementing data governance, observability, and quality frameworks.
  • Strong knowledge of security and compliance standards in insurance or financial services.
  • Experience with real-time and streaming data technologies (Kafka, Event Hubs, Delta Live Tables).
  • Familiarity with lakehouse architecture and cost/performance optimization strategies.
  • Experience operating in multi-cloud or hybrid cloud environments.


Posted On: 14-07-2026

At Coforge, we hire professionals based solely on their skills and do not discriminate based on age, disability, religion, gender, sexual orientation, socioeconomic status, or nationality.

About Encora

Provides global digital engineering and software product development services.

Similar jobs

Data Engineer roles
11h
Save
Mark Applied
Hide
Engenheiro(a) de Dados Júnior
São Paulo, São Paulo, Brazil
HybridFull Time
XP Inc.
XP Inc.NASDAQ: XP: Technology platform for investment brokerage and financial services.
Requires SQL, basic Python, data modeling and manipulation, basic Git and code versioning, and interest in data engineering, analytics, and AI. Databricks, Spark, ADF, or Airflow are advantages.
SQL, Python, Git, Databricks, Spark, Azure Data Factory (ADF), Airflow, Data Lake, Delta Lake, Lakehouse, Mindsight, Predictive Index
12h
Save
Mark Applied
Hide
DATA ENGINEER III
Belo Horizonte or Curitiba or Recife or São Paulo
OnsiteFull Time
Inter&Co
Inter&CoNASDAQ: INTR: Provides digital banking and e-commerce through a mobile app.
Requires Python, SQL, Spark, AWS, Kafka, Airflow, databases, data lake and warehouse architecture, distributed systems, streaming, security, troubleshooting, Git, and communication skills.
Python, SQL, Spark, PySpark, AWS, Apache Spark, Apache Kafka, Apache Airflow, Amazon S3, AWS Glue, EMR, MySQL, PostgreSQL, NoSQL, MongoDB, Amazon Redshift, Terraform, Git, Datahub, Kubernetes
13h
Save
Mark Applied
Hide
Analista Sênior de Engenharia de Dados
Nova Lima or São Paulo or Brazil
HybridFull Time
Accenture
AccentureNYSE: ACN: Global professional services firm providing consulting and technology solutions.
5+ YOEBachelor's degree in a relevant field, 5–10 years of experience, advanced SQL, ETL/ELT, APIs, Python or Java, relational and non-relational databases, Git, cloud, data warehouses, lakes, orchestration, and monitoring.
SQL, Python, Java, ETL, ELT, REST, SOAP, Git, Power Automate, Data Warehouse, Data Lake
14h
Save
Mark Applied
Hide
Engenheiro de Dados Jr
São Paulo, São Paulo, Brazil
OnsiteFull Time
Capco
Capco: Global consultancy providing business and technology services.
Requires Power BI, Microsoft Fabric, Databricks, ETL/ELT, advanced SQL, data warehouse modeling, and intermediate Python/PySpark skills, plus foundational data science knowledge.
Microsoft Power BI, Microsoft Fabric, OneLake, Lakehouse, Databricks, Azure Databricks, SQL Warehouses, PowerCenter, SSIS, Azure Data Factory (ADF), SQL, Python, PySpark, DAX, Power Query (M)
21h
Save
Mark Applied
Hide
Engenheiro de Dados SR - Pipeline
Brazil
RemoteFull Time
Stefanini
Stefanini: Global provider of digital transformation and IT solutions.
Higher education in information technology or a related degree with postgraduate study in informatics; practical SQL, database, ETL, data warehouse, data mart, BI, analytics, and Microsoft Power BI knowledge.
Python, Pandas, NumPy, PySpark, Polars, DuckDB, SQLAlchemy, Airflow, Spark, Flink, Kafka, Parquet, SQL, Microsoft Power BI
21h
Save
Mark Applied
Hide
Engenheiro de Dados SR - Pipeline
Brazil
RemoteFull Time
Stefanini
Stefanini: Global provider of IT consulting and digital business solutions.
Higher education in information technology or a degree with postgraduate training in informatics; practical SQL, databases, ETL, multidimensional databases, data warehouses, business intelligence, analytics, and Microsoft Power BI knowledge.
Python, Pandas, NumPy, PySpark, Polars, DuckDB, SQLAlchemy, Airflow, Spark, Flink, Kafka, Parquet, SQL, Microsoft Power BI
1d
Save
Mark Applied
Hide
Staff Engineer - Data Engineer
Rio de Janeiro, Rio de Janeiro, Brazil
HybridFull Time
Nagarro
NagarroFrankfurt Stock Exchange: NA9: Global provider of digital engineering and IT consulting services
5+ YOERequires 5+ years in data, information, or data architecture; unstructured data and knowledge management experience; data modeling, metadata, security classification, modern catalog, and Databricks expertise.
Databricks Unity Catalog, Databricks, Glean, Microsoft SharePoint, ServiceNow, Delta Lake, Delta Sharing, Lakehouse Federation
1d
Save
Mark Applied
Hide
Engenheiro de Dados
São Bernardo do Campo, São Paulo, Brazil
OnsiteFull Time
DXC Technology
DXC TechnologyNYSE: DXC: Global provider of IT services and business technology solutions.
Degree in progress in computing, engineering, information systems, data analysis, or related fields; experience with Azure Data Platform, Databricks, Power BI, SQL, ETL/ELT, data modeling, and Python.
Azure Data Platform, Databricks, Power BI, SQL, ETL, ELT, Python, Oracle, SQL Server, PostgreSQL, MySQL