GCP Data Engineer/Developer

@ Tata Consultancy Services

Thiruvananthapuram, Kerala, India

OnsiteFull Time

Responsibilities:designing pipelines, developing pipelines, maintaining workflows

Requirements Summary:5+ years experience building ETL/ELT pipelines using Airflow, Python; experience with dbt or similar, BigQuery/GCS on GCP, Terraform, Git, and collaborative agile workflows. Bachelor of Engineering required.

Technical Tools Mentioned:Airflow, dbt, BigQuery, GCS, Python, Terraform, Git, Spark SQL, Dataform

Design, develop, and maintain ETL/ELT pipelines using
Airflow and transformation tools like dbt (or similar)

Build and maintain data storage and processing workflows,
preferably on Google Cloud Platform (GCP) using BigQuery and
GCS (or equivalent tools in other cloud environments)

Collaborate with data analysts, scientists, and engineers to
deliver clean, tested, and reliable datasets

Follow best practices for coding, testing, documentation, and
version control

Strong proficiency in Python for data processing and
scripting

Familiarity with data transformation tools such as dbt, or
comparable tools like Spark SQL, Dataform, etc.

Understanding of Terraform and infrastructure-as-code
practices

Comfortable working in collaborative, agile environments with
Git-based workflows