Accenture
Posted 3w ago

Data Engineer

Accenture
Bengaluru, Karnataka, India
OnsiteFull Time
Responsibilities
  • designing pipelines
  • maintaining solutions
  • monitoring pipelines
Requirements
  • 3+ years PySpark experience
  • Ability to design and maintain data pipelines
  • Familiarity with data processing frameworks and cloud data platforms
  • 15 years full-time education
Technical tools mentioned
PySpark

Job description

Project Role : Data Engineer
Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems.
Must have skills : PySpark
Good to have skills : NA
Minimum 3 year(s) of experience is required
Educational Qualification : 15 years full time education

Summary:
As a Data Engineer, a typical day involves designing, developing, and maintaining comprehensive data solutions that support the generation, collection, and processing of data. The role includes creating efficient data pipelines to facilitate smooth data flow, ensuring the accuracy and quality of data throughout its lifecycle, and implementing processes to extract, transform, and load data across various systems. This position requires continuous collaboration with different teams to optimize data handling and support organizational data needs effectively.

Roles & Responsibilities:
- Expected to perform independently and become an SME.
- Required active participation/contribution in team discussions.
- Contribute in providing solutions to work related problems.
- Collaborate with cross-functional teams to understand data requirements and deliver scalable solutions.
- Monitor and troubleshoot data pipelines to ensure reliability and performance.
- Document data processes and workflows to maintain clarity and support knowledge sharing.
- Assist junior team members by providing guidance and support in their tasks.

Professional & Technical Skills:
- Must To Have Skills: Proficiency in PySpark.
- Experience in building and optimizing data pipelines and workflows using PySpark.
- Strong knowledge of data processing frameworks and distributed computing concepts.
- Ability to work with large datasets and perform data transformation and cleansing.
- Familiarity with cloud-based data storage and processing platforms.
- Understanding of data integration techniques and best practices.

Additional Information:
- The candidate should have minimum 3 years of experience in PySpark.
- This position is based at our Bengaluru office.
- A 15 years full time education is required.

15 years full time education

About Accenture

Accenture is a leading global professional services company that helps the world’s leading businesses, governments and other organizations build their digital core, optimize their operations, accelerate revenue growth and enhance citizen services—creating tangible value at speed and scale. We are a talent- and innovation-led company with approximately 791,000 people serving clients in more than 120 countries. Technology is at the core of change today, and we are one of the world’s leaders in helping drive that change, with strong ecosystem relationships. We combine our strength in technology and leadership in cloud, data and AI with unmatched industry experience, functional expertise and global delivery capability. Our broad range of services, solutions and assets across Strategy & Consulting, Technology, Operations, Industry X and Song, together with our culture of shared success and commitment to creating 360° value, enable us to help our clients reinvent and build trusted, lasting relationships. We measure our success by the 360° value we create for our clients, each other, our shareholders, partners and communities.

Visit us at www.accenture.com 

Equal Employment Opportunity Statement


We believe that no one should be discriminated against because of their differences. All employment decisions shall be made without regard to age, race, creed, color, religion, sex, national origin, ancestry, disability status, military veteran status, sexual orientation, gender identity or expression, genetic information, marital status, citizenship status or any other basis as protected by applicable law. Our rich diversity makes us more innovative, more competitive, and more creative, which helps us better serve our clients and our communities.

About Accenture

Global provider of management consulting and technology services.

Similar jobs

Data Engineer roles near Bengaluru, Karnataka
3h
Save
Mark Applied
Hide
Snowflake Senior Data Engineer
Bengaluru, Karnataka, India
OnsiteFull Time
HCLTech
HCLTechNational Stock Exchange of India: HCLTECH: Global technology providing digital, engineering, and cloud services.
Proficiency in Snowflake, SQL, and Python; experience with data modeling and ETL; strong analytical, problem-solving, communication, and collaboration skills. SnowPro Core preferred.
Snowflake, SQL, Python
12h
Save
Mark Applied
Hide
Data Engineer Sr. Consultant
Bengaluru, Karnataka, India
OnsiteFull Time
NTT DATA
NTT DATA: Global provider of IT and business consulting services.
Strong Varicent configuration and development, rules and calculations, integrations, SQL, data engineering, APIs, ETL/ELT, transformation, validation, troubleshooting, and communication skills.
Varicent, SQL, APIs, ETL, ELT
12h
Save
Mark Applied
Hide
Data Engineering Snowflake Lead Engineer _ Vice President _Data Engineering
Bengaluru, Karnataka, India
OnsiteFull Time
Morgan Stanley
Morgan StanleyNYSE: MS: Global financial services firm providing investment and wealth management.
8+ YOERequires 8+ years in data engineering or a related field, with Python, Snowflake Cortex, Databricks, SQL/NoSQL, data modeling, cloud platforms, and data pipeline experience.
Snowflake, Python, SQL/PLSQL, Snowflake Cortex, Apache Spark, Hadoop, SQL, NoSQL, Databricks, AWS, Azure, Kafka, Git, Jupyter, Tableau, Power BI, Collibra
12h
Save
Mark Applied
Hide
Senior Consultant | Databricks | Mumbai | Engineering
Mumbai or Bangalore
OnsiteFull Time
Deloitte
Deloitte: Professional services firm providing audit, consulting, and advisory services.
5+ YOERequires 5+ years of relevant data engineering experience, Databricks, PySpark, SQL, cloud platform, data architecture, ETL/ELT, DevOps, troubleshooting, and communication skills.
Databricks, PySpark, SQL, Azure, AWS, GCP, Delta Lake, Delta Live Tables (DLT), Unity Catalog, Databricks Workflows, Serverless Compute, GitHub, CI/CD, DevOps, Genie, Mosaic AI, Databricks Data Intelligence Platform, Python
12h
Save
Mark Applied
Hide
Lead Engineer - Data
Bangalore or Chennai
OnsiteFull Time
Kyndryl
KyndrylNYSE: KD: Manages and modernizes mission-critical IT infrastructure systems.
10+ YOE10+ years in data engineering and warehousing with Oracle, SQL/PLSQL, ODI, SAP BODS, Python, Dataiku, Unix/Linux, and TWS; experience in banking risk and regulatory reporting, production support, and data operations.
Oracle, SQL/PLSQL, Python, Business Object, Oracle Data Integrator (ODI), TWS, Shell Scripting, Data IKU, Dataiku, SAP BODS, Unix/Linux, AWS, Azure, Power BI, MicroStrategy, Business Objects, Jira, ServiceNow, Git, DevOps, Microsoft, Google, Amazon
22h
Save
Mark Applied
Hide
Data Engineer
Bengaluru or India
OnsiteFull Time
Accenture
AccentureNYSE: ACN: Global professional services firm providing consulting and technology solutions.
3+ YOEMinimum 3 years of experience, 15 years of full-time education, and Databricks expertise. Requires Python, SQL, Spark/PySpark, cloud data engineering, ETL/ELT, orchestration, streaming, and performance tuning skills.
Databricks Unified Data Analytics Platform, PySpark, Apache Spark, AWS, Microsoft Azure, Google Cloud Platform (GCP), Python, SQL, Amazon S3, Azure Blob Storage, Google BigQuery, Amazon Redshift, Apache Airflow, Parquet, Avro, JSON, Apache Kafka, dbt (Data Build Tool), Informatica, Talend, Matillion
22h
Save
Mark Applied
Hide
Data Engineer, YouTube Business Organization
Bengaluru, Karnataka, India
OnsiteFull Time
Google
GoogleNASDAQ: GOOGL: Provides online search, advertising, cloud computing, and consumer electronics.
3+ YOEBachelor's degree or equivalent practical experience, 3+ years coding and building data pipelines, dimensional models, data infrastructure, and exploratory queries; SQL and data platform experience required.
Flume, Dataflow, Apache Spark, SQL, Extract, Transform, Load (ETL)
1d
Save
Mark Applied
Hide
Data Engineer-I, SmartCommerce
Bengaluru, Karnataka, India
OnsiteFull Time
Amazon
AmazonNASDAQ: AMZN: Global online retail and cloud computing technology provider.
1+ YOEBachelor's degree, 1+ year of data engineering experience, data modeling, warehousing, ETL pipeline development, query and scripting language experience; AWS and ETL tools preferred.
SQL, PL/SQL, DDL, MDX, HiveQL, SparkSQL, Scala, Python, KornShell, AWS, Redshift, Amazon S3, AWS Glue, EMR, Kinesis, Firehose, AWS Lambda, IAM, Informatica, ODI, SSIS, BODI, Datastage