PwC
Posted 1w ago

IN_Senior Associate – AWS Data Engineer – Data and Analytics – Advisory – Bangalore

PwC
Bengaluru, Karnataka, India
OnsiteFull Time
Responsibilities
  • developing pipelines
  • building frameworks
  • managing scalability
Requirements
  • Requires 3+ years relevant experience
  • Typically 5+ in data engineering or integration
  • Expert SQL
  • Python
  • PySpark
  • ETL pipelines, AWS
  • Production readiness, CDC, and scalable ingestion
Technical tools mentioned
Amazon Web Services (AWS)SQLPythonPySparkAWS GlueAWS Step FunctionsAWS LambdaAWS Database Migration Service (DMS)AuroraSAP ODPPostgreSQLApache KafkaApache AirflowApache HadoopAzure Data FactoryDatabricks Unified Data Analytics PlatformDatabase Management System (DBMS)

Job description

Line of Service

Advisory

Industry/Sector

Not Applicable

Specialism

Data, Analytics & AI

Management Level

Senior Associate

Job Description & Summary

At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabling informed decision-making and driving business growth.

In data engineering at PwC, you will focus on designing and building data infrastructure and systems to enable efficient data processing and analysis. You will be responsible for developing and implementing data pipelines, data integration, and data transformation solutions.

Why PWC

At PwC, you will be part of a vibrant community of solvers that leads with trust and creates distinctive outcomes for our clients and communities. This purpose-led and values-driven work, powered by technology in an environment that drives innovation, will enable you to make a tangible impact in the real world. We reward your contributions, support your wellbeing, and offer inclusive benefits, flexibility programmes and mentorship that will help you thrive in work and life. Together, we grow, learn, care, collaborate, and create a future of infinite experiences for each other. Learn more about us.

At PwC, we believe in providing equal employment opportunities, without any discrimination on the grounds of gender, ethnic background, age, disability, marital status, sexual orientation, pregnancy, gender identity or expression, religion or other beliefs, perceived differences and status protected by law. We strive to create an environment where each one of our people can bring their true selves and contribute to their personal growth and the firm’s growth. To enable this, we have zero tolerance for any discrimination and harassment based on the above considerations.

Job Description & Summary: 

We are looking for an experienced AWS Data Engineer with strong expertise in SQL, Python, and PySpark to design, build, and optimize scalable data ingestion and ETL/ELT pipelines. The role requires hands-on experience with AWS services such as Glue, Step Functions, Lambda, and DMS, along with a strong understanding of data engineering best practices, production readiness, and high-volume data processing. 

 

Responsibilities: 

  • Develop ETL/ELT pipelines using AWS services such as Glue, Step Functions, Lambda, and DMS. 

  • Implement direct-to-Aurora ingestion strategies for snapshots and delta loads. 

  • Ensure referential integrity, correct processing order, idempotency, and recovery mechanisms. 

  • Build monitoring, validation, and reconciliation frameworks for production data pipelines. 

  • Manage scalability and throughput during high-volume EOD ingestion workloads. 

Mandatory skill sets: 

  • Expert-level SQL development and performance optimization. 

  • Strong proficiency in SQL, Python, and PySpark. 

  • Hands-on experience with ETL pipelines and orchestration frameworks. 

  • Solid understanding of ACID-compliant data ingestion principles. 

  • Experience with schema evolution and CDC (Change Data Capture) patterns. 

  • Experience owning production readiness and end-to-end solution delivery. 

  • Exposure to cloud-native architectures and AWS tools such as Glue, Step Functions, Lambda, and DMS. 

Preferred skill sets: 

  • Experience with SAP ODP or enterprise data replication technologies. 

  • Familiarity with distributed PostgreSQL systems. 

  • Exposure to event-driven architectures such as Kafka. 

Years of experience required: 

Experience: 5–8 years 

  • Minimum 3 years of relevant work experience, typically reflecting 5+ years in data engineering, data integration, or related roles. 

  • Proven track record of building resilient and idempotent ingestion frameworks. 

  • Experience supporting high-volume, time-sensitive processing, especially EOD workloads. 

  • Strong operational mindset, including monitoring, alerting, and maintaining runbooks. 

Education Qualification:

BE, B.Tech, ME, M.Tech, MBA, MCA or equivalent qualification preferred

Education (if blank, degree and/or field of study not specified)

Degrees/Field of Study required: Bachelor of Engineering, Bachelor of Technology, MBA (Master of Business Administration)

Degrees/Field of Study preferred:

Certifications (if blank, certifications not specified)

Required Skills

Amazon Web Services (AWS), Data Engineering

Optional Skills

Accepting Feedback, Accepting Feedback, Active Listening, Agile Scalability, Amazon Web Services (AWS), Analytical Thinking, Apache Airflow, Apache Hadoop, Azure Data Factory, Communication, Creativity, Data Anonymization, Data Architecture Development, Database Administration, Database Management System (DBMS), Database Optimization, Database Security Best Practices, Databricks Unified Data Analytics Platform, Data Engineering, Data Engineering Platforms, Data Infrastructure, Data Integration, Data Lake, Data Modeling, Data Pipeline {+ 27 more}

Desired Languages (If blank, desired languages not specified)

Travel Requirements

Available for Work Visa Sponsorship?

Government Clearance Required?

Job Posting End Date

August 24, 2026

About PwC

Global provider of professional audit, tax, and consulting services.

Year founded
1998
Employees
364000
Organization type
Private
Subsidiaries
Headquarters
GB

Similar jobs

Data Engineer roles near Bengaluru, Karnataka
4h
Save
Mark Applied
Hide
Sr Data Engineer (DE III), Prime Video Advertising
Bengaluru, Karnataka, India
OnsiteFull Time
Amazon
AmazonNASDAQ: AMZN: Global online retail and cloud computing technology provider.
5+ YOERequires 5+ years of data engineering experience, data modeling, warehousing, ETL pipelines, SQL, a modern programming language, and mentoring experience. Big data experience preferred.
Amazon Web Services (AWS), Python, Java, Scala, NodeJS, EMR, Spark, Iceberg, Airflow, Glue, Athena, Redshift, SQL, Hadoop, Hive, Kiro, Claude Code, CI/CD
4h
Save
Mark Applied
Hide
Engineer, Data Engineering
Bangalore, Karnataka, India
OnsiteFull Time
News Corp
News CorpNasdaq: NWSA: Global media, publishing, and digital information services.
2+ YOERequires 2–4 years of data engineering experience, GCP expertise, BigQuery, Dataform, Cloud Composer, Dataproc, Python, SQL, data modeling, CI/CD, and infrastructure-as-code experience.
Google Cloud Platform (GCP), BigQuery, BigLake, PySpark, Dataproc, Python, SQL, Cloud Composer, Airflow, Terraform, CircleCI, GitHub, Dataform, Cloud Storage, Cloud Functions
4h
Save
Mark Applied
Hide
GCP Data Engineer
Bengaluru, Karnataka, India
OnsiteFull Time
Tata Consultancy Services
Tata Consultancy ServicesNational Stock Exchange of India: TCS: Global provider of IT services, consulting, and business solutions.
5+ YOEBachelor of Technology required; 5–8 years of experience designing GCP data pipelines, ETL/ELT workflows, data lakes, warehouses, BigQuery solutions, CI/CD, and data governance.
GCP, BigQuery, CI/CD, DevOps
13h
Save
Mark Applied
Hide
Azure Data Engineer - Java
Bangalore, Karnataka, India
OnsiteFull Time
Embitel Technologies
Embitel Technologies: A product engineering firm specializing in automotive and e-commerce software.
Experience designing Azure data pipelines and ETL/ELT solutions, with Java or C#/.NET development, SQL, data modeling, REST APIs, microservices, DevOps, and cloud data services.
Azure Data Factory, Azure Databricks, Spark, PySpark, Azure Data Lake Storage, Azure Synapse Analytics, Azure Functions, Event Hub, Kafka, Java, C#, .NET, REST APIs, Azure DevOps, CI/CD Pipelines, Git, Docker, Kubernetes, SQL Server, Azure SQL Database, Cosmos DB, MongoDB
13h
Save
Mark Applied
Hide
Engineer, Data Engineering
Bangalore, Karnataka, India
OnsiteFull Time
News Corp
News CorpNASDAQ: NWSA: Provides global news, information, and digital media services.
2+ YOERequires 2–4 years of data engineering experience, GCP expertise, BigQuery, Dataform, Cloud Composer, Python, SQL, data modeling, CI/CD, and Infrastructure-as-Code experience.
Google Cloud Platform (GCP), BigQuery, BigLake, PySpark, Dataproc, Python, SQL, Cloud Composer, Airflow, Terraform, CircleCI, GitHub, Dataform, Cloud Storage, Cloud Functions, Materialized Views, CI/CD
13h
Save
Mark Applied
Hide
Senior Data Engineer
Bangalore, Karnataka, India
HybridFull Time
Equifax
EquifaxNYSE: EFX: Global provider of credit reporting and data analytics solutions.
5+ YOE4+ MgmtBachelor's degree in computer science, engineering, or related field; 5+ years in data management, engineering, or analysis; 4+ years managing small or midsize teams; SQL and BigQuery knowledge.
SQL, BigQuery, GCP, Ignite, Graph database, AI/ML
13h
Save
Mark Applied
Hide
Senior Data Engineer
Bangalore, Karnataka, India
HybridFull Time
Equifax
EquifaxNew York Stock Exchange: EFX: Provides consumer credit reporting and data analytics services globally.
5+ YOE4+ MgmtBachelor's degree in computer science, engineering, or related field; 5+ years in data management, engineering, or analysis; 4+ years managing small or mid-size teams; SQL, BigQuery, programming, and communication skills.
Google Cloud Platform (GCP), Ignite, SQL, BigQuery, Graph database, AI/ML
13h
Save
Mark Applied
Hide
TTT - SQL Fabric - Tax Senior
Bengaluru, Karnataka, India
OnsiteFull Time
EY
EY: Global firm providing audit, tax, and professional consulting services.
4+ YOERequires 4–7 years of SQL/database programming and data engineering experience, including SQL Server, Azure SQL, Microsoft Fabric, data modeling, warehousing, ETL, Azure data services, and performance optimization.
SQL Server, Azure SQL, Microsoft Fabric, Azure Data Factory, Databricks, OneLake, UDFs