Job Summary
Seeking an experienced Data Engineer with strong expertise in Python Spark Databricks and AIML technologies to build scalable data platforms and GenAI solutions The ideal candidate will have handson experience with LLM pipelines AI agent workflows cloudbased data engineering and modern data architectures
Responsibilities
Job Title Data Engineer ITRAC
Job Description
Seeking an experienced Data Engineer with strong expertise in Python Spark Databricks and AIML technologies to build scalable data platforms and GenAI solutions The ideal candidate will have handson experience with LLM pipelines AI agent workflows cloudbased data engineering and modern data architectures
Key Responsibilities
Design build and optimize scalable data pipelines using Python Spark Delta Lake and Databricks
Develop and manage data solutions across Azure Snowflake PostgreSQL and other enterprise data platforms
Design and implement LLM pipelines including data ingestion preprocessing prompt engineering finetuning and deployment
Build AIdriven workflows using LangChain LangGraph and LLM APIs such as OpenAI Azure OpenAI and Hugging Face
Collaborate with data scientists AI engineers and business teams to deliver data and AI solutions
Ensure data quality governance security and performance across data platforms
Required Skills
Strong expertise in Python Spark and AIML frameworks
Handson experience with Databricks Delta Lake Snowflake and PostgreSQL
Experience building and optimizing LLM and GenAI pipelines
Working knowledge of LangChain LangGraph AI Agents and RAG architectures
Experience with OpenAI Azure OpenAI Hugging Face or similar LLM APIs
Strong understanding of Azure cloud architecture scalability and solution design
Excellent analytical problemsolving and communication skills
Preferred Skills
Experience with Model Context Protocol MCP and AI agent orchestration
Knowledge of Docker CICD pipelines and cloud infrastructure
Exposure to AzureGCP cloud platforms
Telecommunications domain experience is a plus
Role Data Engineer AIML GenAI
Experience 7 Years
Primary Skills Python Spark Databricks Snowflake LLMs LangChain Azure AI GenAI Pipelines
Certifications Required
Experience with Model Context Protocol MCP and AI agent orchestration
Knowledge of Docker CICD pipelines and cloud infrastructure
Exposure to AzureGCP cloud platforms