This job has expired

This job posting is no longer active and is not accepting applications. Explore similar roles below!

Made Tech
Posted 9mo ago

Lead Data Engineer

Made Tech
United Kingdom
£80k-£96k/yrHybridFull Time
Responsibilities
  • defining strategy
  • advising stakeholders
  • leading recruitment
Requirements
  • Senior data engineering with cloud
  • Data platforms, and DevOps
  • Experience designing data pipelines
  • Data warehouses/labric data lakes
  • Strong in CI/CD and IaC
  • Able to lead and mentor
Technical tools mentioned
GitGitHub ActionsIaCApache SparkDatabricksHadoopDataOps

Job description

As a Lead Data Engineer or architect at Made Tech, you'll play a pivotal role in helping public sector organisations become truly data-lead, by equipping them with robust data platforms. You'll also join a data team on its mission to get data knowledge and skills out of silos and embedded into delivery teams. You'll also help implement efficient data pipelines & storage.

Key Responsibilities

  • Define, shape and perfect data strategies in central and local government.
  • Help public sector teams understand the value of their data, and make the most of it.
  • Establish yourself as a trusted advisor in data driven approaches using public cloud services like AWS, Azure and GCP.
  • As employee growth is a huge focus here, we would expect you to contribute to our recruitment efforts and take on line management responsibilities.

Skills, Knowledge & Expertise

We are looking for candidates with a range of skills and experience, please apply even if you don’t meet all the criteria as if unsuccessful we can provide you with feedback.

  • Proficiency in Git (inc. Github Actions) and able to explain the benefits of different branch strategies.
  • Strong experience in IaC and able to guide how one could deploy infrastructure into different environments.
  • Knowledge of handling and transforming various data types (JSON, CSV, etc) with Apache Spark, Databricks or Hadoop.
  • Good understanding of possible architectures involved in modern data system design (Data Warehouse, Data Lakes, Data Meshes)
  • Ability to create data pipelines on a cloud environment and integrate error handling within these pipelines.
  • You understand how to create reusable libraries to encourage uniformity or approach across multiple data pipelines.
  • Able to document and present end-to-end diagrams to explain a data processing system on a cloud environment.
  • Some knowledge of how you would present diagrams (C4, UML, etc.)
  • Enthusiasm for learning and self-development.
  • You have experience of working on agile delivery-lead projects and can apply agile practices such as Scrum, XP, Kanban.
  • Can own the cloud infrastructure underpinning data systems through a DevOps approach.
  • Design and implement efficient data transformation processes at scale, both in batch and streaming use cases.
  • You are a skilled Data Engineer who has delivered data platforms.
  • Knowledge of SOLID, DRY and TDD principles and how to practically implement these into a project.
  • You can demonstrate a commercial mindset when on projects to grow accounts organically with senior stakeholders.
  • You have the experience to improve resilience into a project by checking for software vulnerabilities and implement appropriate testing strategies (unit integration, data quality, etc)
  • You are skilled at offering guidance on how one would implement a robust DevOps approach in a data project.
  • You can comfortably talk about tools needed such as DataOps in areas such as orchestration, data integration and data analytics.

Desirable experience
Experience in the following things isn’t essential, but it’s highly desirable!
  • Working at a technology consultancy
  • Working with Docker and virtual environments as part of the development and CI/CD process.
  • Working with senior stakeholders to gather requirements and keep them engaged with
  • Experience in working with a team of engineers using a variety of techniques such as pair programming or mob programming.
  • Working with data scientists to productionise advanced data deliverables, such as machine learning models
  • Working knowledge of statistics
  • Working with multidisciplinary digital and technology teams
  • Working within the public sector
  • Working with data scientists to productionise advanced data deliverables, such as machine learning models

Job Benefits

Life at Made Tech
We’re committed to building a happy, inclusive and diverse workforce. You can get a sense of what it’s like working here from our blog, where we talk about mental health, communities of practice and neurodiversity (as well as our client work and best practice).

Like many organisations, we use Slack to foster a sense of community and connection. As well as special interest groups such as music, food and pets, we also have 10+ Slack channels dedicated to specific communities, allies, and identities as well as dedicated learning spaces called communities of practice (COPs). If you’d like to speak to someone from one of these groups about their experience as an employee, please do let a member of the Made Tech talent team know.

Benefits
We are always listening to our growing teams and evolving the benefits available to our people. As we scale, as do our benefits and we are scaling quickly. We've recently introduced a flexible benefit platform which includes a Smart Tech scheme, Cycle to work scheme, and an individual benefits allowance which you can invest in a Health care cash plan or Pension plan. We’re also big on connection and have an optional social and wellbeing calendar of events for all employees to join should they choose to.

Here are some of our most popular benefits listed below:

✈️ 30 days Holiday - we offer 30 days of paid annual leave
👶 Flexible Parental Leave - we offer flexible parental leave options
👩‍💻 Remote Working - we offer part time remote working for all our staff
🤗 Paid counselling - we offer paid counselling as well as financial and legal advice.
📈 Pension - 7% employer matched

An increasing number of our customers are specifying a minimum of SC (security check) clearance in order to work on their projects. As a result, we're looking for all successful candidates for this role to have eligibility.Eligibility for SC requires 5 years' UK residency and 5 year' employment history (or back to full-time education). Ideally, no more than 30 consecutive days spent outside the UK within the last five years. Please note that if at any point during the interview process it is apparent that you may not be eligible for SC, we won't be able to progress your application and we will contact you to let you know why.

About Made Tech

Delivers digital transformation services for the UK public sector.

Similar jobs

Lead Data Engineer roles
2mo
Save
Mark Applied
Hide
Lead Data Engineer
Guildford, England, United Kingdom
HybridFull Time
Ceox
Ceox: Provides Microsoft technology solutions for UK public sector organisations.
5+ YOELead data engineer with Azure Databricks and Fabric; strong leadership; CI/CD; data warehousing; Power BI; experience in public sector projects.
Azure, Databricks, Fabric, PySpark, SQL, Power BI, Terraform, Bicep, CI/CD
3mo
Save
Mark Applied
Hide
Lead Data Engineer — International Consumer Bank (Chase UK)
London, England, United Kingdom
OnsiteFull Time
JPMorgan Chase
JPMorgan ChaseNYSE: JPM: Global financial services firm providing banking and investment solutions.
Lead data engineer with cloud, Python, data pipelines, testing, and stakeholder management.
Python, AWS, Data pipelines, Data transformation frameworks, Data orchestration tools
3mo
Save
Mark Applied
Hide
Lead Data Engineer
London, England, United Kingdom
HybridFull Time
UNiDAYS
UNiDAYS: Global platform for student verification and exclusive brand discounts.
Senior data engineering leader with extensive warehouse and pipeline experience; strong SQL, ELT tooling (dbt), cloud data platforms (AWS), CI/CD, data governance, and collaboration with analytics teams.
SQL, dbt, Python, Airflow, Fivetran, Google BigQuery, Linux, Bash/Shell scripting
5mo
Save
Mark Applied
Hide
Lead Data Engineer
Manchester, England, United Kingdom
HybridFull Time
Northrop Grumman
Northrop GrummanNYSE: NOC: Develops and manufactures advanced aerospace, defense, and space systems.
Lead data engineer with Python, Spark, and cloud experience; design, develop, deploy data systems; strong communication and leadership.
Python, NumPy, Spark, Apache Pig, CI/CD, Jenkins, Kubernetes, Docker, AWS, SQL, Elasticsearch, MongoDB
6mo
Save
Mark Applied
Hide
Lead Data Engineer
London, England, United Kingdom
HybridFull Time
WNS
WNSNYSE: WNS: Provides global business process management and digital transformation services.
10+ YOE10+ years in data engineering; data warehouse experience; agile delivery; leadership in data initiatives; strong SQL, Azure DevOps, and Git proficiency.
SQL Server, SSIS, T-SQL, ADF, ADLS, Azure SQL Database, PySpark, Spark SQL, Databricks, Delta lake
8mo
Save
Mark Applied
Hide
Lead Data Engineer
London or Belfast or Birmingham
RemoteFull Time
Kainos
KainosLondon Stock Exchange: KNOS: Provides digital transformation services and specialized Workday-integrated software solutions.
Lead a team of engineers in data-intensive components; design standards; Java/Scala/Python; Informatica/Azure Databricks/ETL tools; SQL; distributed data stores; clear communication; interest in AI.
Java, Scala, Python, Informatica, Azure Databricks, ETL tools, SQL
11mo
Save
Mark Applied
Hide
Lead Data Engineer
Leeds, United Kingdom
HybridFull Time
Scott Logic
Scott Logic: Delivers bespoke software and data engineering for enterprise clients.
Experience with modern data engineering tools and data pipelines; software engineering background; strong communication; on-site client work in London.
Python, Spark, SQL, PySpark, PowerBI, JavaScript, AWS, Azure, GCP
5y
Save
Mark Applied
Hide
Lead Data Engineer
London, England, United Kingdom
HybridFull Time
MedShr
MedShr: A professional network for physicians to share clinical expertise.
3+ YOEExperience in building and maintaining robust data platforms, working with Natural Language Processing, and strong SQL skills required.
Google Cloud Platform, PHP, Python, Typescript, MySQL, BigQuery
This job has expired