Methods
Posted 2w ago

Senior Data engineer (Java/SQL)

Methods
Glasgow, Scotland, United Kingdom
HybridFull Time
Responsibilities
  • designing pipelines
  • developing applications
  • optimising queries
Requirements
  • 5+ years Java experience
  • Advanced SQL
  • ETL/ELT pipeline development
  • Relational DB experience (PostgreSQL/SQL Server/Oracle/MySQL), Git, and cloud data platform knowledge
Technical tools mentioned
JavaSQLScalaApache SparkKafkaEvent HubsPostgreSQLMicrosoft SQL ServerOracleMySQLGitAzureAWSGCPCI/CD

Job description

We are seeking a Senior Data Engineer with strong SQL and Java expertise to design and deliver scalable data solutions.

In this role, you will leverage Java's robustness and Scala's functional data-processing power to build scalable pipelines, manage distributed big data frameworks, and optimize our data platform.

Location: 3days/w onsite in Glasgow

Key Responsibilities

  • Design, develop, and maintain scalable data pipelines to support data integration, transformation, and analytics requirements.
  • Write efficient, high-performance SQL queries, stored procedures, and data transformation logic.
  • Build and maintain backend data processing applications using Java.
  • Develop scalable APIs and microservices architectures.
  • Work with batch and near real-time data processing frameworks to deliver reliable data solutions.
  • Optimise data models, database performance, and query execution.
  • Collaborate with data architects, analysts, and business stakeholders to translate requirements into scalable data solutions.
  • Implement automated testing, monitoring, and data quality controls across the data platform.

Requirements

Essential Skills & Experience

• Java: 5+ years of professional experience with Java (Version 11 or higher preferred).

• Advanced SQL skills with experience in performance tuning, data modelling, and complex query development.

• Strong Java development experience, including object-oriented design and enterprise application development.

• Experience designing and developing ETL/ELT pipelines.

• Experience working with relational databases such as PostgreSQL, SQL Server, Oracle, or MySQL.

• Understanding of data warehousing concepts and dimensional modelling.

• Experience with version control systems such as Git.

• Knowledge of cloud-based data platforms and modern data engineering practices.

Desirable Skills

• Experience with Scala development.

• Experience with Apache Spark or other distributed data processing frameworks.

• Experience with Kafka, Event Hubs, or other streaming technologies.

• Exposure to cloud platforms such as Azure, AWS, or GCP.

• Experience with CI/CD pipelines and DevOps practices.

• Familiarity with data lake and lakehouse architectures.

• Experience in banking or financial services industry

Benefits

Benefits
By joining us you can expect

  • Autonomy to develop and grow your skills and experience
  • Be part of exciting project work that is making a difference in society
  • Strong, inspiring and thought-provoking leadership
  • A supportive and collaborative environment

As well as this, we offer:

  • Development access to LinkedIn Learning, a management development programme and training
  • Wellness 24/7 Confidential employee assistance programme
  • Social - Breakfast Tuesdays, Thirsty Thursdays and Pizza on the last Thursday of each month as well as commitment to charitable causes
  • Time off 25 days a year; plus the opportunity to purchase extra leave per year
  • Pension Salary Exchange Scheme with 4% employer contribution and 5% employee contribution
  • Life Assurance of 4 times base salary
  • Private Medical Insurance which is non-contributory (spouse and dependants included)
  • Worldwide Travel Insurance which is non-contributory (spouse and dependants included)

About Methods

Provides digital transformation and consulting for the public sector.

Year founded
1990
Employees
500
Organization type
Public
Headquarters
GB

Similar jobs

Data Engineer roles near Glasgow, Scotland
10h
Save
Mark Applied
Hide
Senior Data Engineer
Glasgow or Dundee
£49k-£59k/yr HybridFull Time
Scottish Government
Scottish Government: The devolved government responsible for public services in Scotland.
Experience designing, testing, documenting, and maintaining automated data solutions, troubleshooting data services, and applying data engineering standards, tools, and best practices.
Apache Kafka, Python
15h
Save
Mark Applied
Hide
Senior Data Engineer
Glasgow, Scotland, United Kingdom
HybridFull Time
Sword Group
Sword GroupEuronext Paris: SWP: Provides IT consulting, software solutions, and digital transformation services.
Requires advanced Azure, Fabric, Power BI, data architecture, SQL, Python or Spark, AI, governance, DevOps, client delivery, cloud optimisation, and consultancy experience.
Microsoft Azure, Azure Data Factory, Azure Synapse, Azure Data Lake, Azure SQL, Microsoft Fabric, Lakehouse, Power BI, DAX, SQL, Python, Spark, Azure Machine Learning, Cognitive Services, NLP, LLM, Azure DevOps, Git
3d
Save
Mark Applied
Hide
Senior Data Engineer (Microsoft Fabric)
Edinburgh or Leeds or Manchester or London or Bulgaria
HybridFull Time
CreateFuture
CreateFuture: Builds digital products and provides technology consulting services.
Senior data engineering experience with Microsoft Fabric, Python, PySpark, production data pipelines, CI/CD management, teamwork, stakeholder collaboration, and technical guidance.
Microsoft Fabric, Python, PySpark, Azure OneLake, Azure, Azure DevOps, Azure ML
4d
Save
Mark Applied
Hide
Senior Data Engineer (Defence)
Newcastle upon Tyne or Cheltenham or Bristol or Glasgow or Portsmouth or United Kingdom
FieldFull Time
Neptune North
Neptune North: Technical consultancy providing bespoke software and data engineering solutions.
5+ YOE5+ years designing, building, and overseeing data-intensive applications and pipelines; Python, SQL, distributed computing, cloud, orchestration, software engineering, communication, mentoring, and UK SC eligibility.
Python, SQL, Apache Spark, Databricks, AWS, Microsoft Azure, Google Cloud Platform (GCP), Apache Airflow
5d
Save
Mark Applied
Hide
Data Engineer
London or Manchester or Edinburgh
RemoteFull Time
Core Technology Systems
Core Technology Systems: Provides Microsoft cloud managed services and digital transformation solutions
Requires enterprise Power BI delivery, Microsoft Fabric, Azure data services, SQL, data pipelines, scalable modeling, and data governance expertise; Microsoft certifications are desirable.
Microsoft Power BI, Microsoft Fabric, DAX, Power Query, Data Factory, Lakehouse, Dataflows Gen2, Notebooks, Azure Data Factory, Azure Synapse, Data Lake, SQL, ETL, CI/CD, DevOps
5d
Save
Mark Applied
Hide
Consultant Data Engineer IRC302341
United Kingdom or Glasgow or London
HybridFull Time
GlobalLogic
GlobalLogic: Digital product engineering and software development services provider.
7+ YOERequires 7+ years of data engineering, AWS, Databricks, dbt, Airflow, SQL, Python, data migration, CI/CD, Git, Terraform, and regulated financial services experience preferred.
Amazon Web Services (AWS), Amazon S3, AWS Identity and Access Management (IAM), AWS Glue, Databricks, SparkSQL, PySpark, dbt, Apache Iceberg, Apache Airflow, Astronomer, SQL, Teradata, BTEQ, FastExport, Git, Terraform, OpenLineage, Microsoft?
1w
Save
Mark Applied
Hide
Data Engineer - Core Engineering
Alderley Park or Glasgow
HybridFull Time
Royal London
Royal London: Member-owned provider of insurance, pension and investment services.
Experience in data engineering, SQL/Python/pySpark, cloud data platforms (Databricks/Snowflake/Azure Data Factory/Fabric), version control and CI/CD, stakeholder management and BI tools.
SQL, Python, pySpark, GitHub, Azure DevOps, Databricks, Snowflake, Azure Data Factory, Fabric, PowerBI, Tableau, R, Microsoft SQL Server, T-SQL, SSIS
2w
Save
Mark Applied
Hide
Senior Data Engineer – Data Integration & Microsoft Fabric
London or Bristol or Cambridge or Edinburgh or Glasgow or Leeds or Manchester or Milton Keynes or Nottingham or Reading or Birmingham
OnsiteFull Time
RSM UK
RSM UK: Provides audit, tax, and consulting services to middle-market businesses.
Experience designing and delivering cloud-based data integration solutions using Microsoft Fabric and Microsoft Azure; building REST API and SFTP integrations; ETL/ELT with SQL Server and structured data sources; client engagement and technical leadership.
Microsoft Fabric, Microsoft Azure, REST API, SFTP, SQL Server