🏢 Offshore Consulting Shops

All Generation Tech is a technology services and staff augmentation provider hiring for client-facing billable projects.

This company was flagged and excluded from default search results. Proceed with caution.

AG
Posted 4mo ago

Data Engineer

All Generation Tech
India
RemoteContract
Responsibilities
  • Design pipelines
  • Build pipelines
  • Ensure quality
Requirements
  • Design, build, and maintain data pipelines for Data Warehouses using AWS/GCP
  • Strong SQL
  • Dbt, BigQuery
  • Airflow
  • CI/CD
  • Agile delivery
Technical tools mentioned
AWSGoogle Cloud PlatformSQLdbtBigQueryAirflowGitHubBitbucketJIRAConfluenceCI/CD

Job description

We are looking for a skilled Data Engineer to join our dynamic team. You will be responsible for designing, building, and maintaining high-quality data pipelines and workflows, ensuring reliable and accurate data for our Data Warehouses. This is an exciting opportunity to work with cutting-edge cloud technologies and data tools in a collaborative environment.


Time Zones: Sydney, AUS & London
Duration: 4-6 Months
Experience: 7years+

What You'll Do:

  • Design, develop, and maintain data pipelines for Data Warehouses.
  • Build scalable solutions using AWS and GCP.
  • Write efficient and optimized SQL, including analytical and window functions.
  • Transform and model data using dbt and BigQuery.
  • Orchestrate workflows using Airflow.
  • Ensure data quality and implement testing for pipelines.
  • Work in an Agile Delivery environment using JIRA and Confluence.
  • Follow CI/CD best practices using GitHub or Bitbucket.

What We're Looking For:

  • Strong proficiency in AWS and GCP.
  • Hands-on experience delivering data pipelines for Data Warehouses.
  • Advanced SQL skills, including analytical/window functions.
  • Experience with dbt and BigQuery.
  • Workflow orchestration experience using Airflow.
  • Knowledge of CI/CD processes and tools.
  • Familiarity with data quality checks and testing of pipelines.
  • Experience working in an Agile framework.

Why AGT

  • Competitive CTC commensurate with experience
  • Performance-based annual bonus
  • Comprehensive salary structure including HRA, LTA, Medical, Transport, and Education allowances
  • Provident Fund contributions
  • Group medical insurance coverage
  • Paid leaves including casual, sick, and earned leave
  • Fully paid training and probation period

Similar jobs

Data Engineer roles
4h
Save
Mark Applied
Hide
Data Engineer-Data Platforms-SnowFlake
Hyderabad, Telangana, India
HybridFull Time
IBM
IBMNew York Stock Exchange: IBM: Global technology providing enterprise software, cloud, and consulting.
Bachelor's degree required; master's preferred. Experience with Snowflake, data engineering, cloud computing, and implementing and optimizing data and AI use cases.
Snowflake, cloud computing
12h
Save
Mark Applied
Hide
Data Engineer
Bengaluru or India
OnsiteFull Time
Accenture
AccentureNYSE: ACN: Global professional services firm providing consulting and technology solutions.
3+ YOERequires 3+ years of Performance Testing Strategy experience, 15 years of full-time education, and skills in data pipelines, integration, quality validation, ETL, databases, and workflow optimization.
Performance Testing Strategy, ETL, Continuous Integration (CI) Tools, Data Build Tool, Data Warehouse Tools
14h
Save
Mark Applied
Hide
Senior Snowflake Data Engineer
Noida, Uttar Pradesh, India
HybridFull Time
Ibex
IbexNASDAQ: IBEX: Provides technology-enabled customer experience and business process outsourcing services.
7+ YOERequires 7+ years in data engineering, Snowflake, advanced SQL, Python, Snowpark, ELT/ETL, dbt, cloud platforms, Git, CI/CD, testing, and data modeling.
Snowflake, SQL, Python, Snowpark, Dynamic Tables, Streams, Tasks, dbt, AWS, Azure, GCP, Git, CI/CD, Fivetran, Kafka, Airflow, Terraform, Snowflake Iceberg Tables, Snowflake Cortex, Cortex Analyst, Cortex Search, Cortex LLM
14h
Save
Mark Applied
Hide
Associate Staff Engineer (Data Engineer -Apache Kafka, Flink, Java)
Chennai, Tamil Nadu, India
OnsiteFull Time
Nagarro
NagarroFrankfurt Stock Exchange: NA9: Global provider of digital engineering and IT consulting services
4+ YOE4+ years in data engineering and real-time streaming; strong Java, Apache Kafka, and Apache Flink experience; distributed systems, APIs, microservices, cloud, and containerization knowledge; bachelor's or master's degree required.
Java, Apache Kafka, Apache Flink, Kafka Connect, REST APIs
15h
Save
Mark Applied
Hide
Senior Data Engineer I
Chennai, Tamil Nadu, India
HybridFull Time
American Express
American ExpressNYSE: AXP: Global financial services and credit card payment network.
6+ YOEBachelor's degree in computer science, engineering, or related field; 6+ years software development and 3+ years ETL tool and API experience. Requires GCP, Java/Python/Scala, SQL, Spark, and database expertise.
Google Cloud Platform (GCP), BigQuery, Dataflow, Dataproc, Pub/Sub, Cloud Storage, Composer, Java, Python, Scala, SQL, Hive, MySQL, PostgreSQL, NoSQL, Spark, Git, APIs, Spring Boot, XLR, Jenkins, Stash, Jira, Confluence, Splunk, Agile, SAFe, DevOps, Generative AI, Large Language Models (LLMs)
15h
Save
Mark Applied
Hide
Senior Data Engineer - Enterprise Data Team
Hyderabad, Telangana, India
HybridFull Time
Quantium
Quantium: Provides data science and artificial intelligence solutions.
4+ YOE4+ years designing end-to-end data solutions; strong SQL and Python; Azure, ETL/ELT, data warehousing, ADF, SQL Server, Git, CI/CD, Terraform, Linux, Bash, and a relevant bachelor's degree.
Azure, SQL, Python, Terraform, ADF, SQL Server, Git, CI/CD, GNU/Linux, Bash, Docker, Kubernetes, GitHub Copilot, Claude Code, Cursor
16h
Save
Mark Applied
Hide
Data Engineer
Bengaluru, Karnataka, India
OnsiteFull Time
Google
GoogleNASDAQ: GOOGL: Provides online search, advertising, cloud computing, and consumer electronics.
4+ YOEBachelor's degree or equivalent practical experience, 4 years in data engineering, infrastructure, or analytics, database administration or data engineering, and software development in Java, C++, Python, Go, or JavaScript.
Java, C++, Python, Go, JavaScript, SQL, Google ADK
16h
Save
Mark Applied
Hide
Data Engineering
Pune or India
RemoteFull Time
Zensar
ZensarNational Stock Exchange of India: ZENSARTECH: Global technology firm providing digital transformation and infrastructure services.
6+ YOERequires 6 years of data engineering experience, strong Python, SQL, PySpark, Spark, Databricks, cloud, ETL/ELT, data warehousing, backend API, orchestration, and production support experience.
Python, SQL, PySpark, Apache Spark, Databricks, Airflow, Matillion, DBT, Delta Lake, AWS, Azure, Snowflake, Redshift, PostgreSQL, SQL Server, MySQL, Oracle, OpenSearch, Flask, FastAPI, Git, GitHub, Jenkins, Docker, CodePipeline, UCD, ECS, AWS S3, Glue, Lambda, EMR, RDS, EC2, SQS, Azure Blob Storage, ADLS, Cosmos DB, Azure AI Search, Key Vault, Application Insights, Log Analytics, Kubernetes, ChromaDB, FAISS, Pinecone, Weaviate, Milvus, OpenAI, Azure OpenAI, Claude, AWS Bedrock, Hugging Face, REST APIs