Tata Consultancy Services
Posted 3w ago

Databricks Data Engineer with a Solution Architect

Tata Consultancy Services
Dublin, Ohio, United States
$140k-$150k/yrOnsiteFull Time
Responsibilities
  • designing platforms
  • leading architecture
  • optimizing pipelines
Requirements
  • Expertise in Databricks, Spark
  • Delta Lake
  • Unity Catalog
  • Cloud architecture
  • IaC and Terraform
  • 8+ years data engineering/architecture experience
  • Strong leadership and platform design skills
Technical tools mentioned
DatabricksSparkDelta LakeUnity CatalogTerraformDatabricks Asset Bundles (DABs)Structured StreamingAzureAWSGCP

Job description

Must Have Technical/Functional Skills

As a Databricks Data Engineer with a Solution Architect background, you will lead the design of enterprise-scale data solutions, establish engineering standards and best practices, optimize platform performance and cost, and provide technical leadership for cloud modernization, real-time analytics, AI/ML enablement, and data governance initiatives. This role requires strong expertise in Spark, Delta Lake, Unity Catalog, cloud architecture, Infrastructure as Code (IaC), and modern data platform engineering principles to deliver secure, resilient, and highly scalable solutions.

We are seeking a highly skilled and experienced Senior Solution Architect to lead the implementation and adoption of the Databricks Lakehouse Platform as part of our enterprise data strategy. This role will serve as the technical leader and subject matter expert for Databricks, supporting multiple business segments and strategic initiatives across the organization


Roles & Responsibilities

Responsibilities

• Applies advanced expertise in Databricks, Spark, Delta Lake, and cloud-native architectures to design and govern large-scale enterprise data platforms.

• Leads architecture decisions for cloud-based data and analytics solutions, ensuring scalability, security, resiliency, and operational excellence across Azure, AWS, or GCP environments.

• Establishes and evolves platform standards, best practices, and governance frameworks for data engineering, streaming, AI/ML, and analytics workloads.

• Recommends innovative technologies, architectural patterns, and optimization strategies to improve platform performance, reliability, and cost efficiency.

• Works on and may lead highly complex, cross-functional initiatives involving cloud modernization, data platform transformation, and enterprise architecture adoption.

• Designs and optimizes high-volume batch and real-time data pipelines, leveraging deep knowledge of Spark internals, Structured Streaming, and distributed computing principles.

• Provides architectural leadership for Delta Lake, Unity Catalog, security, data governance, and data-sharing capabilities across multiple business domains.

• Drives Infrastructure as Code (IaC), DevOps, and CI/CD adoption using Terraform, Databricks Asset Bundles (DABs), and modern software engineering practices.

• Independently determines architectural approaches, technology choices, and implementation strategies for new and evolving platform capabilities.

• Receives guidance on strategic business objectives while exercising significant discretion in technical and architectural decision-making.

• Provides expert consultation to leadership, engineering teams, and business stakeholders, delivering solutions that may establish enterprise-wide standards and precedents.

• Acts as a technical mentor and thought leader, elevating engineering capabilities and promoting architecture best practices across the organization.

• Influences long-term cloud, data, and AI platform strategy, ensuring solutions align with b usiness goals, regulatory requirements, and future growth needs





Salary Range: $140,000- $150,000 a year


TCS Employee Benefits Summary:

Discretionary Annual Incentive.

Comprehensive Medical Coverage: Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans.

Family Support: Maternal & Parental Leaves.

Insurance Options: Auto & Home Insurance, Identity Theft Protection.

Convenience & Professional Growth: Commuter Benefits & Certification & amp; Training Reimbursement.

Time Off: Vacation, Time Off, Sick Leave & Holidays.

Legal & Financial Assistance: Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing.


#LI-SP1

About Tata Consultancy Services

Global provider of IT services, consulting, and business solutions.

Similar jobs

Data Engineer roles near Dublin, Ohio
2d
Save
Mark Applied
Hide
Senior Data Engineer (AWS, Azure, GCP)
Columbus, Ohio, United States
HybridFull Time
CapTech
CapTech: Provides technology and management consulting services to large enterprises.
5+ YOERequires 5+ years delivering cloud data engineering solutions, ETL, databases, SQL, programming, distributed systems, and technical leadership experience with AWS, Azure, or GCP.
AWS, Azure, GCP, Azure Data Factory, SSIS, Informatica, Alteryx, Ab Initio, Pentaho, Talend, Matillion, Snowflake, Redshift, Databricks, PostgreSQL, MySQL, SQL Server, Oracle, Aurora, Presto, BigQuery, SQL, NoSQL, Python, Java, R, C, C#, C++, Shell, Git, Jenkins, CI/CD, Jira
5d
Save
Mark Applied
Hide
Google Senior Data Engineer
Albany or Arlington or Atlanta or Austin or Beaverton or Bentonville or Boston or Carmel or Charlotte or Chicago or Cincinnati or Cleveland or Columbus or Culver City or Denver or Des Moines or Detroit or Hartford or Houston or Irving or Kirkland or Miami or Milwaukee or Minneapolis or Morristown or Mountain View or Nashville or New York City or Oklahoma City or Overland Park or Philadelphia or Pittsburgh or Raleigh or Redmond or Sacramento or San Diego or San Francisco or Scottsdale or Seattle or St. Louis or St. Petersburg or Walnut Creek or United States
$80k-$266k/yr HybridFull Time
Accenture
AccentureNYSE: ACN: Global professional services firm providing consulting and technology solutions.
5+ YOERequires 5+ years in data engineering, analytics, or ML; 4+ years with GCP; 5+ years with SQL and pipelines; 3+ years with Python or AI tools; and a bachelor's degree or equivalent.
Google Cloud Platform (GCP), BigQuery, Looker, Vertex AI, Gemini Foundation Models, Gemini Enterprise, Dataflow, Dataproc, Pub/Sub, Cloud Storage, Looker Studio, Model APIs, Embeddings, Dataplex, IAM, SQL, Python, Git
6d
Save
Mark Applied
Hide
Data Engineer - Databricks
Chicago or Indianapolis or Fort Wayne or Columbus or Lansing or Denver or Dallas or Atlanta
RemoteFull Time
Resultant
Resultant: Provides data analytics and technology consulting services to organizations.
2+ YOEBachelor's degree or equivalent, 2+ years of production data engineering experience, Databricks, PySpark, Spark SQL, Delta Lake, SQL, cloud data services, data modeling, and strong client communication skills.
Databricks, PySpark, Spark SQL, Delta Lake, Delta Live Tables (DLT), Auto Loader, Structured Streaming, Databricks Workflows, Airflow, Azure Data Factory, Unity Catalog, MLflow, Photon, Git, Azure DevOps, GitHub Actions, GitLab, Terraform, dbt, Kafka, Event Hubs, Power BI, Tableau, Docker, Kubernetes, SQL Server, Postgres, Oracle, Snowflake, Azure, AWS, GCP
1w
Save
Mark Applied
Hide
Data Engineer Lead
Columbus, Ohio, United States
OnsiteFull Time
Huntington
HuntingtonNASDAQ: HBAN: Provides regional commercial, consumer, and mortgage banking services.
7+ YOEBachelor's degree or relevant experience, 7+ years in data management and data engineering, database programming, advanced analytics, pipelines, data quality, and team leadership.
AWS Glue, Landa, Amazon Athena, AWS, BI software, DevOps, version control, Agile
1w
Save
Mark Applied
Hide
GCP Data Engineer
Charlotte or Chicago or Columbus or Hartford
$101k-$151k/yr HybridFull Time
The Hartford
The HartfordNYSE: HIG: Provides property and casualty insurance and financial products.
Requires hands-on GCP experience, Python and SQL proficiency, enterprise data pipeline experience, secure cloud solution design, software engineering practices, and strong problem-solving and collaboration skills.
Google Cloud Platform, BigQuery, Google Cloud Storage, Cloud Composer, Dataplex, GitHub Copilot, Python, SQL, Informatica IDMC/CDGC, Collibra, Snowflake, Terraform, CI/CD, DataOps, DevSecOps, IAM, APIs, ETL/ELT, Infrastructure-as-Code
1w
Save
Mark Applied
Hide
PIIM Data Engineer
New Albany, Ohio, United States
OnsiteFull Time
Bechtel
Bechtel: Designs and constructs large-scale industrial and infrastructure projects.
5+ YOEBachelor's degree and 5+ years data engineering experience. Strong SQL, ETL/ELT, Python, data modeling, Power BI, data lake architectures, Azure Databricks/Delta Lake, data integration, governance, and stakeholder communication skills.
SQL, Python, Power BI, Azure Databricks, Delta Lake
1w
Save
Mark Applied
Hide
GCP Data Engineer
Charlotte or Columbus or Hartford or Chicago
$101k-$151k/yr HybridFull Time
The Hartford
The HartfordNYSE: HIG: Provides business and personal insurance, group benefits, and investments.
Hands-on experience with GCP, BigQuery, Python and SQL; building production data pipelines, CI/CD, and secure cloud solutions; strong collaboration and communication; authorized to work in the U.S. without sponsorship.
Google Cloud Platform, BigQuery, GCS, Composer, Dataplex, APIs, IAM, GitHub Copilot, Python, SQL, Snowflake, Terraform, Informatica IDMC/CDGC, Collibra
1w
Save
Mark Applied
Hide
Engineer - Data
Dublin, Ohio, United States
$74k-$126k/yr RemoteFull Time
The Wendy's Company
The Wendy's CompanyNASDAQ: WEN: Operator and franchisor of fast-food hamburger restaurants.
2+ YOEBachelor's required; 2+ years software implementation/data management preferred. Strong SQL and Python, experience with Looker and Power BI, Google Cloud (BigQuery) and SnapLogic. Strong communication and organizational skills.
SQL, Python, Looker, Power BI, Google Cloud Platform (GCP), BigQuery, SnapLogic