HiringCafe
Save Job
Posted 6d ago

Azure DataBricks Engineer

@ Tata Consultancy Services
View All Jobs
Denver, Colorado, United States
$130k-$140k/yrOnsiteFull Time
Responsibilities:designing pipelines, orchestrating ETL, mentoring team
Requirements Summary:6+ years data engineering experience with Azure Databricks, PySpark, Spark SQL, Delta Lake; strong SQL, data governance, CI/CD with Git; leadership and hybrid onsite–offshore delivery experience.
Technical Tools Mentioned:Azure Databricks, PySpark, Spark SQL, Delta Lake, Git, Azure Synapse, Azure Fabric, Azure Data Factory, SQL
Save
Mark Applied
Hide Job
Report & Hide
Job Description

Azure DataBricks Engineer


Must Have Technical/Functional Skills

• Design, build, and orchestrate ETL/ELT pipelines using Azure Databricks. 

• Implement batch data ingestion and transformations using PySpark and Spark SQL. 

• Architect and maintain Lakehouse and analytical warehouse models (fact and dimension schemas) leveraging Delta Lake. 

• Ensure data quality, reliability, lineage, and governance across the data platform. 

• Collaborate with security and platform teams to enforce data access controls and best practices. 

• Experience on CI/CD pipelines using Git for Databricks 


Roles & Responsibilities

• Act as the onsite lead for Azure Databricks data engineering initiatives. 

• Supervise and guide an offshore development team, assigning work, reviewing deliverables, and ensuring adherence to best practices. 

• Perform code reviews, design reviews, and solution walkthroughs for offshore-developed components. 

• Ensure alignment between offshore execution and onsite architecture, security, and business requirements. 

• Proactively identify risks, gaps, and improvement opportunities across the data platform. 

• Prior experience working in a hybrid onsite–offshore delivery model 

• 6-10 years of hands on experience in data engineering. 

• Strong, proven expertise in Azure Databricks and Delta Lake. 

• Advanced proficiency in SQL with a solid understanding of distributed data processing concepts. 

• Demonstrated experience leading, mentoring, or supervising data engineering teams. 

• Strong experience performing code reviews and solution design validations. 

• knowledge of data security, and access management (RBAC).

• Preferred / Nice to Have Skills: Experience with Azure Synapse / Fabric, Azure Data Factory. 


TCS Employee Benefits Summary:

Discretionary Annual Incentive.

Comprehensive Medical Coverage: Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans.

Family Support: Maternal & Parental Leaves.

Insurance Options: Auto & Home Insurance, Identity Theft Protection.

Convenience & Professional Growth: Commuter Benefits & Certification & Training Reimbursement.

Time Off: Vacation, Time Off, Sick Leave & Holidays.

Legal & Financial Assistance: Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing.


Salary Range- $130,000-$140,000 a year

#LI-OJ1