HiringCafe
Save Job
Posted 4w ago

Senior Apache Spark Technical Lead - Scala, Python (122278)

@ HCLTech
View All Jobs
India
OnsiteFull Time
Responsibilities:processing data, building pipelines, integrating AI
Requirements Summary:Expert-level Python and SQL, hands-on Spark and Databricks, AWS/Azure experience (S3, EC2, Redshift, EMR), Tableau or Power BI, Kafka, Pandas, ETL pipelines, and familiarity with LLMs and LangChain; relevant Spark/Scala/Python certifications a plus.
Technical Tools Mentioned:Python, SQL, Spark, Databricks, AWS, Azure, S3, EC2, Redshift, EMR, Tableau, Microsoft Power BI, Kafka, Pandas, LangChain, Large Language Models (LLM), Scala
Save
Mark Applied
Hide Job
Report & Hide
Job Description
Requisition ID 122278 - Posted 


Job Summary

  • Expert-level proficiency in Python and SQL.
  • Hands-on experience with Spark for big data processing.
  • Databricks  
  • Strong experience with AWS/Azure cloud services (e.g., S3, EC2, Redshift, EMR).
  • Expertise in data visualization and reporting with Tableau or Power BI.
  • Streaming & Data: Kafka, Pandas, ETL Pipelines
  • Generative AI: Large Language Models (LLM), LangChain, Prompt Engineering, AI Integrations
  • Strong hands-on experience in SQL for complex transformations, data validation, and performance tuning

Key Responsibilities

null

Skill Requirements

null

Other Requirements

1.Relevant certifications in apache spark, scala, or python are a plus