Save Job
Posted 10mo ago

Data Engineering Lead

@ Techlogix
Karachi, Sindh, Pakistan
OnsiteFull Time
Responsibilities:developing pipelines, maintaining pipelines, modeling data
Requirements Summary:7+ years data engineering experience with banking domain, strong Big Data, Hadoop, Spark, Kafka, Python, SQL, ETL/ELT, data modelling and cloud (Azure/GCP/AWS) skills; BS in CS/IT/Engineering required.
Technical Tools Mentioned:Big Data, Hadoop, Spark Streaming, Kafka, Confluent Kafka, Python, SQL, Hive, NIFI, Airflow, Oozie, Azure Data Factory (ADF), Databricks, ADLS, Azure Synapse, Logic Apps, Azure Functions, Google Big Query, Google Analytics, Power Bl, Tableau, Qlik, Elastic Search, Couchbase
Save
Mark Applied
Hide Job
Report & Hide
Job Description
Core Skills:
  • Data engineer with a solid technical
    background and banking experience in data-intensive systems (>7 years)

  • Strong experience in Big Data, Hadoop
    Ecosystem, Spark Streaming, Kafka, Python, SQL, Hive, NIFI, Airflow

  • Proficient with Azure Cloud services
    such as Azure Data Factory (ADF), Databricks, ADLS, Azure Synapse, Logic Apps,
    Azure Functions. Or similar data stack knowledge within Google/AWS cloud
    services

  • Proficiency in relational SQL, Graph
    and NoSQL databases.

  • Proficiency in Elastic Search and
    Couchbase databases

  • In-depth skills in developing and
    maintaining ETL/ELT data pipelines.

  • Experience in data modelling
    techniques such as Kimball star schema, 3NF, vault modelling etc.

  • Experience in workflow management
    tools such as Airflow, Oozie and CI/CD tools

  • Data streaming solution in Kafka or
    Confluent Kafka

  • Hands on experience in Google Big
    Query, Google Analytics & Clickstream Data Model

  • Reporting knowledge in Power Bl,
    Tableau, Qlik etc.

  • Sound in Data Management Fundamentals
    and Data Architect, Modelling, Governance

  • Strong Domain Knowledge in
    Banking/Finance area like understanding of the various processes, products, and
    services within the banking industry, core functions, regulations, and
    operational aspects of banking institutions.

  • Hands on knowledge in Hadoop and
    Azure/AWS cloud ecosystem and ETL jobs migration

  • Knowledge of Advance Analytics and Al
    tools



Requirements

Minimum BS Degree in CS, IT or Engineering
Banking Domain Knowledge will be a Plus.

Benefits

Competitive Salary, Medical OPD & IPD, Life Insurance, EOBI