UPS
Posted 1y ago

Senior Data Developer - Azure Databricks+cosmos DB + SQL + ETL+SSIS

UPS
Chennai, Tamil Nadu, India
HybridFull Time
Responsibilities
  • Design pipelines
  • Develop transformations
  • Mentor teammates
Requirements
  • 8-12 years of data engineering experience with Azure
  • Databricks
  • Cosmos DB
  • SQL/Python
  • ETL
  • Mentoring
  • Strong collaboration
Technical tools mentioned
Azure Data FactoryAzure DatabricksCosmos DBAzure DevOpsPythonSQLPySparkNoSQL data modelingData warehousing conceptsAzure SQL

Job description

Before you apply to a job, select your language preference from the options available at the top right of this page.

Explore your next opportunity at a Fortune Global 500 organization. Envision innovative possibilities, experience our rewarding culture, and work with talented teams that help you become better every day. We know what it takes to lead UPS into tomorrow—people with a unique combination of skill + passion. If you have the qualities and drive to lead yourself or teams, there are roles ready to cultivate your skills and take you to the next level.

Job Description:

Job Title: Senior Data Developer – Azure ADF and Databricks

Experience Range: 8-12 Years
Location: Chennai, Hybrid
Employment Type: Full-Time

About UPS


UPS is a global leader in logistics, offering a broad range of solutions that include transportation, distribution, supply chain management, and e-commerce. Founded in 1907, UPS operates in over 220 countries and territories, delivering packages and providing specialized services worldwide. Our mission is to enable commerce by connecting people, places, and businesses, with a strong focus on sustainability and innovation.

About UPS Supply Chain Symphony™

The UPS Supply Chain Symphony™ platform is a cloud-based solution that seamlessly integrates key supply chain components, including shipping, warehousing, and inventory management, into a unified platform. This solution empowers businesses by offering enhanced visibility, advanced analytics, and customizable dashboards to streamline global supply chain operations and decision-making.

About the role

We are seeking an experienced Senior Data Developer to join our data engineering team responsible for building and maintaining complex data solutions using Azure Data Factory (ADF), Azure Databricks, and Cosmos DB. The role involves designing and developing scalable data pipelines, implementing data transformations, and ensuring high data quality and performance. The Senior Data Developer will work closely with data architects, testers, and analysts to deliver robust data solutions that support strategic business initiatives.

The ideal candidate should possess deep expertise in big data technologies, data integration, and cloud-native data engineering solutions on Microsoft Azure. This role also involves coaching junior developers, conducting code reviews, and driving strategic improvements in data architecture and design patterns.

Key Responsibilities

  • Data Solution Design and Development:
    • Design and develop scalable and high-performance data pipelines using Azure Data Factory (ADF).
    • Implement data transformations and processing using Azure Databricks.
    • Develop and maintain NoSQL data models and queries in Cosmos DB.
    • Optimize data pipelines for performance, scalability, and cost efficiency.
  • Data Integration and Architecture:
    • Integrate structured and unstructured data from diverse data sources.
    • Collaborate with data architects to design end-to-end data flows and system integrations.
    • Implement data security, governance, and compliance standards.
  • Performance Tuning and Optimization:
    • Monitor and tune data pipelines and processing jobs for performance and cost efficiency.
    • Optimize data storage and retrieval strategies for Azure SQL and Cosmos DB.
  • Collaboration and Mentoring:
    • Collaborate with cross-functional teams including data testers, architects, and business analysts.
    • Conduct code reviews and provide constructive feedback to improve code quality.
    • Mentor junior developers, fostering best practices in data engineering and cloud development.

Primary Skills

  • Data Engineering: Azure Data Factory (ADF), Azure Databricks.
  • Cloud Platform: Microsoft Azure (Data Lake Storage, Cosmos DB).
  • Data Modeling: NoSQL data modeling, Data warehousing concepts.
  • Performance Optimization: Data pipeline performance tuning and cost optimization.
  • Programming Languages: Python, SQL, PySpark

Secondary Skills

  • DevOps and CI/CD: Azure DevOps, CI/CD pipeline design and automation.
  • Security and Compliance: Implementing data security and governance standards.
  • Agile Methodologies: Experience in Agile/Scrum environments.
  • Leadership and Mentoring: Strong communication and coaching skills for team collaboration.

Soft Skills

  • Strong problem-solving abilities and attention to detail.
  • Excellent communication skills, both verbal and written.
  • Effective time management and organizational capabilities.
  • Ability to work independently and within a collaborative team environment.
  • Strong interpersonal skills to engage with cross-functional teams.

Educational Qualifications

  • Bachelor's degree in Computer Science, Engineering, Information Technology, or a related field.
  • Relevant certifications in Azure and Data Engineering, such as:
    • Microsoft Certified: Azure Data Engineer Associate
    • Microsoft Certified: Azure Solutions Architect Expert
    • Databricks Certified Data Engineer Associate or Professional

About the Team
As a Senior Data Developer, you will be working with a dynamic, cross-functional team that includes developers, product managers, and other quality engineers. You will be a key player in the quality assurance process, helping shape testing strategies and ensuring the delivery of high-quality web applications.


Employee Type:
 

Permanent


UPS is committed to providing a workplace free of discrimination, harassment, and retaliation.

About UPS

Global package delivery and supply chain management provider.

Similar jobs

Senior Data Developer roles near Chennai, Tamil Nadu
4mo
Save
Mark Applied
Hide
Senior Data Engineer (Chennai, IN)
Chennai, Tamil Nadu, India
OnsiteFull Time
Denodo Technologies
Denodo Technologies: Private data management software providing logical data integration and governed real-time data access for enterprises.
5+ YOE5+ years as a Senior Data Engineer or similar; strong SQL, Java, and data management skills; good communication; willingness to travel.
Java, SQL, JDBC, XML, Web Services
5mo
Save
Mark Applied
Hide
Senior Data Engineer- Snowflake
Chennai, Tamil Nadu, India
OnsiteFull Time
SquareShift
SquareShift: Private Singaporean cloud consulting firm delivering data engineering, AI/ML, cybersecurity, and digital transformation services to businesses.
7+ YOE7+ years of data engineering experience with Snowflake, SQL, ETL/ELT, cloud platforms, and data warehousing concepts.
Snowflake, SQL, Python, Scala, Airflow, Informatica, dbt, AWS, Azure, GCP, Spark, Hadoop, Kafka, Kinesis, CI/CD
5mo
Save
Mark Applied
Hide
Senior Data Engineer
Chennai, Tamil Nadu, India
OnsiteFull Time
KLA Corporation
KLA CorporationNASDAQ: KLAC: Global leader in process control and yield management solutions.
5+ YOE5–7 years data engineering; Snowflake; SAP data integration; SQL; Python; CI/CD; data modeling.
Snowflake, SAP data, SQL, Python, Informatica, ADF, dbt, Power BI, Tableau, Looker
6mo
Save
Mark Applied
Hide
Senior Data Engineer
Chennai, Tamil Nadu, India
OnsiteFull Time
Med-Metrix
Med-Metrix: Technology-enabled revenue cycle management and consulting for healthcare.
5+ YOEBachelor's or master's in CS/Data Eng; 5+ years building production data pipelines; strong SQL; Dagster, DBT, AWS; HIPAA data handling; Python.
Dagster, DBT, Python, AWS, Athena, Glue, SQS, SNS, IAM, CloudWatch, PostgreSQL, SQL, Pandas, PySpark, Git, CI/CD, Airflow
7mo
Save
Mark Applied
Hide
Senior Data Engineer
Chennai, Tamil Nadu, India
HybridFull Time
Mindera
Mindera: AI-enabled consulting and software engineering building scalable digital systems for global clients.
Strong hands-on experience in Python and SQL with data pipelines for analytics/ML; knowledge of data modelling, data warehousing, data lakes; cloud experience (AWS); CI/CD; IaC (Terraform); Docker; vector databases and embeddings; ML concepts.
Python, SQL, Spark, Airflow, DBT, AWS, Parquet, Iceberg, Jenkins, GitHub Actions, Terraform, Docker, Vector Databases, Embeddings, ML Concepts
9mo
Save
Mark Applied
Hide
Senior Data Engineer
Chennai, Tamil Nadu, India
RemoteFull Time
Propelis
Propelis: A global agency built for brand impact.
5+ YOE5-8 years in DevOps or Cloud Infrastructure; IaC with Terraform/CloudFormation; Linux admin; AWS knowledge; bachelor’s degree; AWS certs a plus.
Terraform, CloudFormation, AWS, Linux, CI/CD
9mo
Save
Mark Applied
Hide
Senior Data Engineer
Chennai, Tamil Nadu, India
RemoteFull Time
Propelis
Propelis: A global agency built for brand impact.
5+ YOE5-8 years in DevOps or Cloud Infrastructure; IaC (Terraform/CloudFormation); CI/CD; Linux admin; AWS; degree in CS/IT; AWS certifications a plus
Terraform, AWS, CloudFormation, Linux, CI/CD, AKS, App Services
9mo
Save
Mark Applied
Hide
Senior Data Engineer
Chennai, Tamil Nadu, India
OnsiteFull Time
Yubi
Yubi: The Lending OS for modern credit teams.
3+ YOE5+ years data engineering experience; SQL, Python, PySpark; data warehousing; Airflow/Temporal; Docker; AWS; strong collaboration.
PySpark, Python, SQL, Airflow, Temporal, Docker, DBT, AWS, Snowflake, Redshift