Tata Consultancy Services
Posted 1mo ago

Azure DataBricks Engineer

Tata Consultancy Services
Denver, Colorado, United States
$130k-$140k/yrOnsiteFull Time
Responsibilities
  • designing pipelines
  • orchestrating ETL
  • mentoring team
Requirements
  • 6+ years data engineering experience with Azure Databricks
  • PySpark
  • Spark SQL
  • Delta Lake
  • Strong SQL, data governance, CI/CD with Git
  • Leadership and hybrid onsite–offshore delivery experience
Technical tools mentioned
Azure DatabricksPySparkSpark SQLDelta LakeGitAzure SynapseAzure FabricAzure Data FactorySQL

Job description

Azure DataBricks Engineer


Must Have Technical/Functional Skills

• Design, build, and orchestrate ETL/ELT pipelines using Azure Databricks. 

• Implement batch data ingestion and transformations using PySpark and Spark SQL. 

• Architect and maintain Lakehouse and analytical warehouse models (fact and dimension schemas) leveraging Delta Lake. 

• Ensure data quality, reliability, lineage, and governance across the data platform. 

• Collaborate with security and platform teams to enforce data access controls and best practices. 

• Experience on CI/CD pipelines using Git for Databricks 


Roles & Responsibilities

• Act as the onsite lead for Azure Databricks data engineering initiatives. 

• Supervise and guide an offshore development team, assigning work, reviewing deliverables, and ensuring adherence to best practices. 

• Perform code reviews, design reviews, and solution walkthroughs for offshore-developed components. 

• Ensure alignment between offshore execution and onsite architecture, security, and business requirements. 

• Proactively identify risks, gaps, and improvement opportunities across the data platform. 

• Prior experience working in a hybrid onsite–offshore delivery model 

• 6-10 years of hands on experience in data engineering. 

• Strong, proven expertise in Azure Databricks and Delta Lake. 

• Advanced proficiency in SQL with a solid understanding of distributed data processing concepts. 

• Demonstrated experience leading, mentoring, or supervising data engineering teams. 

• Strong experience performing code reviews and solution design validations. 

• knowledge of data security, and access management (RBAC).

• Preferred / Nice to Have Skills: Experience with Azure Synapse / Fabric, Azure Data Factory. 


TCS Employee Benefits Summary:

Discretionary Annual Incentive.

Comprehensive Medical Coverage: Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans.

Family Support: Maternal & Parental Leaves.

Insurance Options: Auto & Home Insurance, Identity Theft Protection.

Convenience & Professional Growth: Commuter Benefits & Certification & Training Reimbursement.

Time Off: Vacation, Time Off, Sick Leave & Holidays.

Legal & Financial Assistance: Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing.


Salary Range- $130,000-$140,000 a year

#LI-OJ1

About Tata Consultancy Services

Global leader in IT services, consulting, and business solutions.

Similar jobs

Databricks Engineer roles near Denver, Colorado
1mo
Save
Mark Applied
Hide
Databricks Data Engineer
United States or Arlington or Tysons or Washington or New York City or Chicago or Austin or Atlanta or Boston or Boulder
$113k-$188k/yr RemoteFull Time
Guidehouse
Guidehouse: Global consulting firm serving public and commercial sectors.
3+ YOEBachelor's degree,3+ years data engineering experience,proficiency with Python/PySpark/SQL,Databricks/Spark/Delta Lake experience,knowledge of data pipelines,governance,and cloud platforms.
Databricks, PySpark, Python, SQL, Delta Lake, Unity Catalog, Spark, CI/CD, Terraform, Azure, AWS, GCP