Job Summary
- Develop automated scripts to validate source-to-target data movements, ensuring schema consistency, completeness, and timeliness.
- Build robust, reusable testing utilities using Python, native AWS services that integrate seamlessly into DataOps workflows.
- Set up continuous data drift monitoring, schema validation, and data quality dashboards to proactively catch pipeline failures.
- Partner with data engineers, BI teams, and software engineers to translate business rules into strict data quality KPIs and SLAs.
Key Responsibilities
- Develop automated scripts to validate source-to-target data movements, ensuring schema consistency, completeness, and timeliness.
- Build robust, reusable testing utilities using Python, native AWS services that integrate seamlessly into DataOps workflows.
- Set up continuous data drift monitoring, schema validation, and data quality dashboards to proactively catch pipeline failures.
- Partner with data engineers, BI teams, and software engineers to translate business rules into strict data quality KPIs and SLAs.
Skill Requirements
- Deep proficiency in AWS data and storage services like Amazon S3, AWS Glue, Amazon Redshift, and AWS Lambda.
- Advanced proficiency in Python for building automation frameworks and orchestrating data tests.
- Experience with orchestration tools (e.g., Apache Airflow), data transformation, and data quality monitoring frameworks (e.g., Amazon Deequ).
- Strong command of SQL and UNIX/Linux scripting for querying and analyzing large-scale, distributed datasets
Other Requirements
Certifications: Candidate with AWS Certified Data Engineer – Associate - Highly preferred
99000
59000
Apply now
Why HCLTech?
At HCLTech, you'll supercharge your potential. You'll find your career. And you'll find your spark. All at a place that knows that helping its customers stay on top starts by putting its people first.
HCLTech is a global technology company, home to more than 223,000 people across 60 countries, delivering industry-leading capabilities centered around digital, engineering, cloud and AI, powered by a broad portfolio of technology services and products. We work with clients across all major verticals, providing industry solutions for Financial Services, Manufacturing, Life Sciences and Healthcare, Technology and Services, Telecom and Media, Retail and CPG, and Public Services. Consolidated revenues as of 12 months ending June 2026 totaled $14.8 billion.
Compensation and Benefits
A candidate’s pay within the range will depend on their skills, experience, education, and other factors permitted by law. This role may also be eligible for performance-based bonuses subject to company policies. In addition, this role is eligible for the following benefits subject to company policies: medical, dental, vision, pharmacy, life, accidental death & dismemberment, and disability insurance; employee assistance program; 401(k) retirement plan; 10 days of paid time off per year (some positions are eligible for need-based leave with no designated number of leave days per year); and 10 paid holidays per year.
