Capco
Posted 3w ago

AWS Data Engineer

Capco
Bengaluru or Pune or Chennai or Gurugram or Mumbai
OnsiteFull Time
Responsibilities
  • developing pipelines
  • migrating data
  • designing architectures
Requirements
  • 8+ years building scalable ETL pipelines with Python/PySpark
  • SQL/ Spark SQL
  • DBT and Databricks
  • AWS data services experience
  • CI/CD and IaC familiarity
  • Strong communication and technical leadership
Technical tools mentioned
PythonPySparkSpark SQLSQLDBT (Data Build Tool)DatabricksCI/CDTerraformCloudFormationGitS3GlueRedshiftAthenaEMRLambdaIAM

Job description

Job Title: AWS data Engineer

 

 About Us

“Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the  British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by Avtar & Seramount. With our presence across 32 cities across globe, we support 100+ clients across banking, financial and Energy sectors. We are recognized for our deep transformation execution and delivery. 

WHY JOIN CAPCO? 

You will work on engaging projects with the largest international and local banks, insurance companies, payment service providers and other key players in the industry. The projects that will transform the financial services industry.

MAKE AN IMPACT

Innovative thinking, delivery excellence and thought leadership to help our clients transform their business. Together with our clients and industry partners, we deliver disruptive work that is changing energy and financial services.

#BEYOURSELFATWORK

Capco has a tolerant, open culture that values diversity, inclusivity, and creativity.

CAREER ADVANCEMENT

With no forced hierarchy at Capco, everyone has the opportunity to grow as we grow, taking their career into their own hands.

DIVERSITY & INCLUSION

We believe that diversity of people and perspective gives us a competitive advantage.

 

Job Description:

Role: AWS Data Engineer

Location : Bangalore, Pune, Chennai, Gurgaon, Mumbai

Number of Positions: 6

 

 

Responsibilities:

  • Strong expertise in Python, PySpark, Spark SQL, and SQL for developing scalable data pipelines and ETL processes.
  • Experience with DBT  (Data Build Tool) for data transformation, modelling, testing, and documentation.
  • Proficiency in Databricks for data engineering and optimization, with Databricks certification considered an advantage.
  • Knowledge of CI/CD, Infrastructure as Code (Terraform or CloudFormation), Git, and Agile delivery to support automated and reliable deployments.
  • Proven experience migrating data from legacy platforms to AWS, including designing modern cloud based data architectures.
  • Hands on experience with AWS data services including S3, Glue, Redshift, Athena, EMR, Lambda, and IAM.

Qualifications:

  • Bachelor's degree in computer science, Engineering, or related field, or equivalent work experience.
  • Proven 8 -12 years of experience as a AWS Data Engineer or similar role.Strong problem solving and analytical skills.
  • Excellent verbal communication skills.
  • Good interpersonal skills.
  • Ability to provide technical leadership for the team.


    

 

 

About Capco

Global consultancy providing business and technology services.

Similar jobs

Data Engineer roles near Bengaluru, Karnataka
7h
Save
Mark Applied
Hide
Snowflake Senior Data Engineer
Bengaluru, Karnataka, India
OnsiteFull Time
HCLTech
HCLTechNational Stock Exchange of India: HCLTECH: Global technology providing digital, engineering, and cloud services.
Proficiency in Snowflake, SQL, and Python; experience with data modeling and ETL; strong analytical, problem-solving, communication, and collaboration skills. SnowPro Core preferred.
Snowflake, SQL, Python
16h
Save
Mark Applied
Hide
Data Engineering Snowflake Lead Engineer _ Vice President _Data Engineering
Bengaluru, Karnataka, India
OnsiteFull Time
Morgan Stanley
Morgan StanleyNYSE: MS: Global financial services firm providing investment and wealth management.
8+ YOERequires 8+ years in data engineering or a related field, with Python, Snowflake Cortex, Databricks, SQL/NoSQL, data modeling, cloud platforms, and data pipeline experience.
Snowflake, Python, SQL/PLSQL, Snowflake Cortex, Apache Spark, Hadoop, SQL, NoSQL, Databricks, AWS, Azure, Kafka, Git, Jupyter, Tableau, Power BI, Collibra
16h
Save
Mark Applied
Hide
Senior Consultant | Databricks | Mumbai | Engineering
Mumbai or Bangalore
OnsiteFull Time
Deloitte
Deloitte: Professional services firm providing audit, consulting, and advisory services.
5+ YOERequires 5+ years of relevant data engineering experience, Databricks, PySpark, SQL, cloud platform, data architecture, ETL/ELT, DevOps, troubleshooting, and communication skills.
Databricks, PySpark, SQL, Azure, AWS, GCP, Delta Lake, Delta Live Tables (DLT), Unity Catalog, Databricks Workflows, Serverless Compute, GitHub, CI/CD, DevOps, Genie, Mosaic AI, Databricks Data Intelligence Platform, Python
16h
Save
Mark Applied
Hide
Lead Engineer - Data
Bangalore or Chennai
OnsiteFull Time
Kyndryl
KyndrylNYSE: KD: Manages and modernizes mission-critical IT infrastructure systems.
10+ YOE10+ years in data engineering and warehousing with Oracle, SQL/PLSQL, ODI, SAP BODS, Python, Dataiku, Unix/Linux, and TWS; experience in banking risk and regulatory reporting, production support, and data operations.
Oracle, SQL/PLSQL, Python, Business Object, Oracle Data Integrator (ODI), TWS, Shell Scripting, Data IKU, Dataiku, SAP BODS, Unix/Linux, AWS, Azure, Power BI, MicroStrategy, Business Objects, Jira, ServiceNow, Git, DevOps, Microsoft, Google, Amazon
16h
Save
Mark Applied
Hide
Data Engineer Sr. Consultant
Bengaluru, Karnataka, India
OnsiteFull Time
NTT DATA
NTT DATA: Global provider of IT and business consulting services.
Strong Varicent configuration and development, rules and calculations, integrations, SQL, data engineering, APIs, ETL/ELT, transformation, validation, troubleshooting, and communication skills.
Varicent, SQL, APIs, ETL, ELT
1d
Save
Mark Applied
Hide
Data Engineer
Bengaluru or India
OnsiteFull Time
Accenture
AccentureNYSE: ACN: Global professional services firm providing consulting and technology solutions.
3+ YOEMinimum 3 years of experience, 15 years of full-time education, and Databricks expertise. Requires Python, SQL, Spark/PySpark, cloud data engineering, ETL/ELT, orchestration, streaming, and performance tuning skills.
Databricks Unified Data Analytics Platform, PySpark, Apache Spark, AWS, Microsoft Azure, Google Cloud Platform (GCP), Python, SQL, Amazon S3, Azure Blob Storage, Google BigQuery, Amazon Redshift, Apache Airflow, Parquet, Avro, JSON, Apache Kafka, dbt (Data Build Tool), Informatica, Talend, Matillion
1d
Save
Mark Applied
Hide
Data Engineer, YouTube Business Organization
Bengaluru, Karnataka, India
OnsiteFull Time
Google
GoogleNASDAQ: GOOGL: Provides online search, advertising, cloud computing, and consumer electronics.
3+ YOEBachelor's degree or equivalent practical experience, 3+ years coding and building data pipelines, dimensional models, data infrastructure, and exploratory queries; SQL and data platform experience required.
Flume, Dataflow, Apache Spark, SQL, Extract, Transform, Load (ETL)
1d
Save
Mark Applied
Hide
Data Engineer-I, SmartCommerce
Bengaluru, Karnataka, India
OnsiteFull Time
Amazon
AmazonNASDAQ: AMZN: Global online retail and cloud computing technology provider.
1+ YOEBachelor's degree, 1+ year of data engineering experience, data modeling, warehousing, ETL pipeline development, query and scripting language experience; AWS and ETL tools preferred.
SQL, PL/SQL, DDL, MDX, HiveQL, SparkSQL, Scala, Python, KornShell, AWS, Redshift, Amazon S3, AWS Glue, EMR, Kinesis, Firehose, AWS Lambda, IAM, Informatica, ODI, SSIS, BODI, Datastage