🏢 Offshore Consulting Shops

Enable Data is an IT services firm that provides consulting and staff augmentation, and these roles are for billable client projects rather than internal corporate functions.

This company was flagged and excluded from default search results. Proceed with caution.

Enable Data Incorporated
Posted 1mo ago

Lead Data Engineer/ Data Architect

Enable Data Incorporated
Hyderabad or Asia
RemoteFull Time
Responsibilities
  • designing architecture
  • developing solutions
  • mentoring developers
Requirements
  • Senior individual contributor with technical leadership
  • 10+ years in data engineering (15+ overall)
  • Deep Azure data services expertise
  • PySpark/Python/SQL
  • Databricks
  • Data architecture
  • CI/CD and Git experience
Technical tools mentioned
PySparkPythonSQLAzure DatabricksAzure Data LakeAzure Data FactoryAzure SynapseMicrosoft AzureCI/CDGitAgileETL/ELT

Job description

Enable Data seeking an experienced Azure Data Architect with strong hands-on engineering expertise to design, develop, optimize, and modernize enterprise-scale data platforms. The role combines solution architecture, technical leadership, and individual contributor responsibilities, requiring deep expertise in Azure data services, data engineering best practices, and large-scale data processing using PySpark, Python, SQL, and Azure Databricks.

The ideal candidate will be responsible for analyzing existing data products and pipelines, identifying improvement opportunities, leading refactoring and redesign initiatives, and implementing scalable, reliable, and high-performance data solutions on Azure.

Responsibilities

  • Architecture & Solution Design
  • Overall 15+ years of experience with 10+ years of experience in Data Engineering and Analytics solutions.
  • Design end-to-end data architectures on Microsoft Azure.
  • Define data ingestion, transformation, storage, governance, and consumption strategies.
  • Create scalable, secure, and cost-effective data solutions aligned with business objectives.
  • Establish architectural standards, design patterns, and best practices for data engineering teams.
  • Collaborate with business stakeholders, product owners, and technical teams to translate requirements into technical solutions.
  • Design, develop, and modernize enterprise data platforms on Azure. Analyze, refactor, and redesign existing data pipelines and products while building new scalable data solutions.
  • Act as a hands-on individual contributor with technical leadership responsibilities, including mentoring junior developers and driving best practices.
  • Strong hands-on experience in PySpark, Python, and SQL
  • Expertise in Azure Databricks and Azure data ecosystem
  • Experience designing and implementing scalable data architectures
  • Ability to analyze, optimize, refactor, and redesign existing data pipelines
  • Develop and maintain ETL/ELT solutions and data products
  • Performance tuning, troubleshooting, and data quality implementation
  • Mentor and guide junior developers and conduct code reviews
  • Collaborate with cross-functional teams to deliver end-to-end data solutions
    Required Experience

Requirements

  • Azure Data Lake, Azure Data Factory, Azure Synapse
  • Data warehousing, lakehouse architecture, and cloud migration
  • CI/CD, Git, and Agile development practices
  • Role Type: Senior Individual Contributor with Technical Leadership responsibilities.

Similar jobs

Data Engineer / Data Architect roles near Hyderabad, Telangana
1mo
Save
Mark Applied
Hide
Lead Data Engineer / Data Architect
Hyderabad, Telangana, India
OnsiteFull Time
WS Audiology
WS Audiology: Develops and manufactures hearing aids and audiology solutions.
8+ YOE8+ years in data engineering/architecture, cloud data platform design, Azure Databricks/Spark experience, strong Python and SQL, data governance and leadership experience.
Azure Databricks, Apache Spark, Azure Data Lake Storage Gen2, Delta Lake, Python, SQL, Databricks Workflows, Databricks Asset Bundles, Azure DevOps, Bicep, CI/CD, Microsoft Purview, Microsoft Entra ID, Azure Key Vault, Azure Monitor, Log Analytics
1mo
Save
Mark Applied
Hide
Lead Data Engineer / Data Architect
Hyderabad, Telangana, India
OnsiteFull Time
WS Audiology
WS Audiology: Developer and manufacturer of hearing aids and audiology solutions.
8+ YOE8+ years in data engineering/architecture, experience building enterprise cloud data platforms on Azure, strong Python and SQL, data governance and AI/ML readiness, technical leadership and mentoring experience.
Azure Databricks, Apache Spark, Azure Data Lake Storage Gen2, Delta Lake, Medallion Architecture, Python, SQL, Databricks Workflows, Databricks Asset Bundles, Azure DevOps, CI/CD, Bicep, Microsoft Purview, Microsoft Entra ID, Azure Key Vault, Azure Monitor, Log Analytics
1w
Save
Mark Applied
Hide
Architect - Data Engineer
Hyderabad, Telangana, India
HybridFull Time
TransUnion
TransUnionNYSE: TRU: Provides global credit reporting and risk management information solutions.
10+ YOE10+ years in software, data engineering, or distributed systems; strong Apache Spark expertise; Scala, Java, or Python; distributed data platforms, cloud architecture, batch and streaming pipelines, and AWS or GCP experience.
Apache Spark, Spark SQL, Structured Streaming, DataFrames, Dataset APIs, Scala, Java, Python, Hadoop, Hive, Iceberg, AWS EMR, AWS Glue, Google Cloud Dataproc, BigQuery, AWS, Google Cloud Platform, Amazon S3, AWS Lambda, Amazon EKS, Amazon ECS, AWS Step Functions, Amazon CloudWatch, Google Cloud Storage, Google Cloud Dataflow, Google Cloud Pub/Sub, Cloud Composer, CI/CD, DevOps, infrastructure-as-code, SDLC