Accenture
Posted 2mo ago

Data Engineer

Accenture
Bengaluru, Karnataka, India
OnsiteFull Time
Responsibilities
  • design pipelines
  • build pipelines
  • ensure quality
Requirements
  • 5+ years of data engineering experience
  • Strong Python, ETL/ELT, SQL/NoSQL
  • Multi-cloud (AWS/Azure/GCP)
  • Airflow
  • CI/CD
  • Docker
  • Data quality and governance
Technical tools mentioned
PythonSQLNoSQLApache AirflowAWSAzureGoogle CloudJenkinsGitDockerETL/ELTCI/CD

Job description

Project Role : Data Engineer
Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems.
Must have skills : Python Frameworks
Good to have skills : Ab Initio
Minimum 5 year(s) of experience is required
Educational Qualification : 15 years full time education

Project Role Description
As a Python Data Engineer, you will be responsible for designing, developing, and maintaining highly scalable data pipelines, backend data services, and cloud-based data solutions. Your typical day will involve working with cross-functional teams to ingest, process, and transform large volumes of data across multiple systems, ensuring high performance, reliability, and data quality.
You will leverage Python and multi-cloud technologies to build robust and efficient data workflows, with a strong focus on scalability, optimization, and low-latency processing. A cloud-first and agile mindset, combined with continuous improvement, will be key to delivering enterprise-grade data solutions.

Roles & Responsibilities:
Expected to be an SME.
Collaborate and manage the team to perform.
Responsible for team decisions.
Engage with multiple teams and contribute to key decisions.
Provide solutions to problems for their immediate team and across multiple teams.
Design and develop highly scalable data pipelines and ETL/ELT processes for large-scale data processing.
Build and maintain data services/APIs for seamless data consumption across systems.
Ensure data quality, validation, and consistency across pipelines.
Optimize data workflows for scalability, performance, and cost efficiency.
Handle high-volume and high-velocity datasets with efficient processing strategies.
Mentor junior team members to foster their professional growth and development.
Continuously evaluate and improve data engineering processes to enhance team productivity.

Professional & Technical Skills:
Must To Have Skills: Proficiency in Python (Programming Language).
Strong experience in building scalable data pipelines and distributed data processing systems.
Solid understanding of databases (SQL and NoSQL) and advanced query optimization techniques.
Experience with ETL/ELT frameworks and data integration patterns.
Hands-on experience with multi-cloud platforms (AWS, Azure, or Google Cloud) and cloud-native data services.
Experience with workflow orchestration tools (e.g., Apache Airflow or equivalent).
Familiarity with CI/CD tools (Git, Jenkins) and containerization (Docker).
Strong understanding of performance tuning, scalability, and distributed system design principles.
Understanding of data quality, data lineage, and governance frameworks.
Good To Have Skills: Exposure to programming languages such as Java or Scala in distributed environments.

Additional Information:
The candidate should have a minimum of 8 years of experience in Python (Programming Language).
A 15 years full-time education is required.

15 years full time education

About Accenture

Accenture is a leading global professional services company that helps the world’s leading businesses, governments and other organizations build their digital core, optimize their operations, accelerate revenue growth and enhance citizen services—creating tangible value at speed and scale. We are a talent- and innovation-led company with approximately 791,000 people serving clients in more than 120 countries. Technology is at the core of change today, and we are one of the world’s leaders in helping drive that change, with strong ecosystem relationships. We combine our strength in technology and leadership in cloud, data and AI with unmatched industry experience, functional expertise and global delivery capability. Our broad range of services, solutions and assets across Strategy & Consulting, Technology, Operations, Industry X and Song, together with our culture of shared success and commitment to creating 360° value, enable us to help our clients reinvent and build trusted, lasting relationships. We measure our success by the 360° value we create for our clients, each other, our shareholders, partners and communities.

Visit us at www.accenture.com 

Equal Employment Opportunity Statement


We believe that no one should be discriminated against because of their differences. All employment decisions shall be made without regard to age, race, creed, color, religion, sex, national origin, ancestry, disability status, military veteran status, sexual orientation, gender identity or expression, genetic information, marital status, citizenship status or any other basis as protected by applicable law. Our rich diversity makes us more innovative, more competitive, and more creative, which helps us better serve our clients and our communities.

About Accenture

Global provider of management consulting and technology services.

Similar jobs

Data Engineer roles near Bengaluru, Karnataka
7h
Save
Mark Applied
Hide
Data Engineer
Bengaluru or India
OnsiteFull Time
Accenture
AccentureNYSE: ACN: Global professional services firm providing consulting and technology solutions.
3+ YOEMinimum 3 years of experience, 15 years of full-time education, and Databricks expertise. Requires Python, SQL, Spark/PySpark, cloud data engineering, ETL/ELT, orchestration, streaming, and performance tuning skills.
Databricks Unified Data Analytics Platform, PySpark, Apache Spark, AWS, Microsoft Azure, Google Cloud Platform (GCP), Python, SQL, Amazon S3, Azure Blob Storage, Google BigQuery, Amazon Redshift, Apache Airflow, Parquet, Avro, JSON, Apache Kafka, dbt (Data Build Tool), Informatica, Talend, Matillion
8h
Save
Mark Applied
Hide
Data Engineer, YouTube Business Organization
Bengaluru, Karnataka, India
OnsiteFull Time
Google
GoogleNASDAQ: GOOGL: Provides online search, advertising, cloud computing, and consumer electronics.
3+ YOEBachelor's degree or equivalent practical experience, 3+ years coding and building data pipelines, dimensional models, data infrastructure, and exploratory queries; SQL and data platform experience required.
Flume, Dataflow, Apache Spark, SQL, Extract, Transform, Load (ETL)
10h
Save
Mark Applied
Hide
Data Engineer-I, SmartCommerce
Bengaluru, Karnataka, India
OnsiteFull Time
Amazon
AmazonNASDAQ: AMZN: Global online retail and cloud computing technology provider.
1+ YOEBachelor's degree, 1+ year of data engineering experience, data modeling, warehousing, ETL pipeline development, query and scripting language experience; AWS and ETL tools preferred.
SQL, PL/SQL, DDL, MDX, HiveQL, SparkSQL, Scala, Python, KornShell, AWS, Redshift, Amazon S3, AWS Glue, EMR, Kinesis, Firehose, AWS Lambda, IAM, Informatica, ODI, SSIS, BODI, Datastage
10h
Save
Mark Applied
Hide
Associate Principal - Data Engineering
Bengaluru, Karnataka, India
OnsiteFull Time
LTIMindtree
LTIMindtreeNational Stock Exchange of India: LTIM: Global technology consulting and digital solutions.
11+ YOERequires 11–15 years of experience designing Microsoft Fabric data engineering solutions, pipelines, real-time streaming, warehousing, governance, security, performance tuning, and technical leadership.
Microsoft Fabric
11h
Save
Mark Applied
Hide
DE&A - Core - Advanced Data Engineering - Advanced Data Engineering (Other)
Bangalore or India
OnsiteFull Time
Zensar
ZensarNational Stock Exchange of India: ZENSARTECH: Global technology firm providing digital transformation and infrastructure services.
4+ YOERequires 4–7 years of experience designing, modeling, developing, building, and deploying data engineering solutions and pipelines on GCP, including BigQuery; strong communication skills preferred AI/ML knowledge.
Google Cloud Platform (GCP), BigQuery, AI/ML, Agentic AI
12h
Save
Mark Applied
Hide
Engineer, Data Engineering
Bangalore, Karnataka, India
OnsiteFull Time
News Corp
News CorpNasdaq: NWSA: Global media, publishing, and digital information services.
2+ YOERequires 2–4 years of data engineering experience, GCP expertise, BigQuery, Dataform, Cloud Composer, Dataproc, Python, SQL, data modeling, CI/CD, and infrastructure-as-code experience.
Google Cloud Platform (GCP), BigQuery, BigLake, PySpark, Dataproc, Python, SQL, Cloud Composer, Airflow, Terraform, CircleCI, GitHub, Dataform, Cloud Storage, Cloud Functions
13h
Save
Mark Applied
Hide
GCP Data Engineer
Bengaluru, Karnataka, India
OnsiteFull Time
Tata Consultancy Services
Tata Consultancy ServicesNational Stock Exchange of India: TCS: Global provider of IT services, consulting, and business solutions.
5+ YOEBachelor of Technology required; 5–8 years of experience designing GCP data pipelines, ETL/ELT workflows, data lakes, warehouses, BigQuery solutions, CI/CD, and data governance.
GCP, BigQuery, CI/CD, DevOps
17h
Save
Mark Applied
Hide
Data Engineer - AI Labs
Bengaluru or Bangalore
₹2500k-₹3582k/yr OnsiteFull Time
IDFC First Bank
IDFC First BankNational Stock Exchange of India / BSE Limited: IDFCFIRSTB / 539437: Provides universal banking and financial services to individuals and businesses.
2+ YOEBachelor’s or master’s degree in computer science, data engineering, information systems, or related field; 2+ years building data pipelines and architectures; experience with big data, cloud platforms, GenAI, and unstructured data.
MapReduce, Hive, HDFS, YARN, HBase, MongoDB, DynamoDB, AWS, GCP, Azure, Git, APIs, Apache Spark