CGI
Posted 3mo ago

Senior Data Engineer

CGI
Leeds, England, United Kingdom
HybridFull Time
Responsibilities
  • designing pipelines
  • building products
  • improving observability
Requirements
  • Proven data engineering experience delivering production-grade pipelines/products using Python/PySpark/Spark
  • Strong SQL and data modelling
  • Cloud data services (AWS/Azure/GCP), and ability to learn Palantir Foundry
Technical tools mentioned
Palantir FoundryPythonPySparkApache SparkSQLAWSAzureGCP

Job description




CGI UK Careers: Big enough, small enough, complex enough – CGI in Leeds



By playing this video you consent to Google/YouTube processing your data and using cookies – Learn more.










Position Description:

Drive measurable change by shaping and delivering large-scale data products and platforms using Palantir Foundry and cloud-native tooling. In this role you’ll engineer scalable pipelines, transform complex datasets into operational decision-making assets, and partner with clients to unlock efficiency and insight across critical programmes. You’ll join multi-disciplinary teams where pragmatic ownership, creative solutioning and strong technical craft translate directly into business outcomes—building reusable patterns, improving observability and accelerating client roadmaps for modern data adoption.

CGI was recognised in the Sunday Times Best Places to Work List 2025 and has been named a UK ‘Best Employer’ by the Financial Times. We offer a competitive salary, excellent pension, private healthcare, plus a share scheme (3.5% + 3.5% matching) which makes you a CGI Partner not just an employee. We are committed to inclusivity, building a genuinely diverse community of tech talent and inspiring everyone to pursue careers in our sector, including our Armed Forces, and are proud to hold a Gold Award in recognition of our support of the Armed Forces Corporate Covenant. Join us and you’ll be part of an open, friendly community of experts. We’ll train and support you in taking your career wherever you want it to go.

Due to the secure nature of the programme, you will need to hold UK Security Clearance or be eligible to go through this clearance. This is a hybrid position.






Your future duties and responsibilities:

In this role you will design, build and optimise enterprise-scale data pipelines and data products that directly improve client operations and analytics. You will work across Foundry and cloud ecosystems (or quickly gain Foundry expertise), translating stakeholder needs into maintainable, production-grade solutions while championing quality, observability and reusable engineering patterns. You will collaborate closely with architects, product owners and analysts to shape roadmaps and deliver measurable outcomes.







Required qualifications to be successful in this role:

You should have strong commercial experience in data engineering, demonstrating the ability to deliver production-grade solutions on modern platforms. Candidates will be comfortable with large datasets, distributed processing and applying software engineering discipline to data products; Foundry experience is highly desirable but strong Python/PySpark engineers who can learn Foundry quickly are encouraged to apply.

Essential qualifications
• Extensive experience with Python and PySpark / Apache Spark.
• Proven track record designing and delivering scalable data pipelines and data products.
• Strong SQL and data modelling skills.
• Experience with modern data architectures and cloud data services (AWS, Azure or GCP).
• Familiarity with version control, automated testing and CI/CD for data platforms.
• Experience integrating data from multiple structured and unstructured sources.
• Strong problem-solving ability and experience working in delivery-focused or client-facing environments.
• (Desirable) Hands-on Palantir Foundry experience or demonstrable ability to upskill quickly in new platforms.


#LI-MW2















Skills:

  • Palantir Foundry Code Workbook
  • Python
  • Apache Spark






What you can expect from us:

Together, as owners, let’s turn meaningful insights into action.

Life at CGI is rooted in ownership, teamwork, respect and belonging. Here, you’ll reach your full potential because…

You are invited to be an owner from day 1 as we work together to bring our Dream to life. That’s why we call ourselves CGI Partners rather than employees. We benefit from our collective success and actively shape our company’s strategy and direction.

Your work creates value. You’ll develop innovative solutions and build relationships with teammates and clients while accessing global capabilities to scale your ideas, embrace new opportunities, and benefit from expansive industry and technology expertise.

You’ll shape your career by joining a company built to grow and last. You’ll be supported by leaders who care about your health and well-being and provide you with opportunities to deepen your skills and broaden your horizons.

Come join our team—one of the largest IT and business consulting services firms in the world.

About CGI

Provides information technology and business consulting services.

Similar jobs

Data Engineer roles near Leeds, England
4h
Save
Mark Applied
Hide
Senior Data Engineer
Manchester or London or Glasgow or Bristol
HybridFull Time
Jacobs
JacobsNYSE: J: Global provider of professional engineering and technical services.
Experience with AWS or Azure data services, PySpark, SQL, Python or Java, ETL/ELT pipelines, data quality, Git, CI/CD, Agile delivery, and senior project leadership; eligibility for SC clearance.
AWS, Microsoft Azure, AWS Glue, AWS Lambda, AWS Step Functions, Microsoft Azure Data Factory, Microsoft Azure Synapse, Microsoft Azure Functions, Microsoft Logic Apps, PySpark, SQL, Amazon Athena, Amazon Redshift, Microsoft Azure Data Lake Storage Gen2, Python, Java, Git, CI/CD, Agile
12h
Save
Mark Applied
Hide
Data Engineer
Manchester, England, United Kingdom
HybridFull Time
PA Consulting
PA Consulting: Global consultancy providing innovation, technology, and management strategy services.
Experience designing production data pipelines and processing structured and unstructured data using Java, Python, Scala, Spark, SQL, APIs, and AWS data services in big data architectures.
AWS, EMR, Glue, Redshift, Kinesis, Lambda, DynamoDB, Java, Python, Scala, Spark, SQL, Microsoft Teams
1d
Save
Mark Applied
Hide
Lead Data Engineer
Glasgow or Edinburgh or Leeds or Manchester or London or Bulgaria
HybridFull Time
CreateFuture
CreateFuture: Builds digital products and provides technology consulting services.
Strong SQL Server, T-SQL, SSMS, execution plans, AWS RDS, and scripting with Python or PowerShell. Requires database reverse engineering, financial services data expertise, consultancy experience, and engineering leadership.
Microsoft SQL Server, AWS RDS, T-SQL, SSMS, Python, PowerShell, AWS, Amazon S3, Claude, SQL
1d
Save
Mark Applied
Hide
Data Engineer - Kids Planet Central Support
Lymm, England, United Kingdom
OnsiteFull Time
Kids Planet
Kids Planet: Provides early years education and nursery childcare services.
Bachelor's degree in computer science, information technology, or related field; data engineering experience; SQL and Python, Java, or Scala proficiency; ETL, data modeling, data warehousing, and cloud platform experience.
Python, SQL, Java, Scala, AWS, Azure, GCP, API, ETL
6d
Save
Mark Applied
Hide
Data Engineer
Whitefield, England, United Kingdom
HybridFull Time
Leonard Curtis
Leonard Curtis: Provides corporate restructuring, insolvency, and business advisory services.
Strong proficiency in PySpark, Databricks SQL, T-SQL, Delta Lake, data formats, cloud orchestration, pipeline testing, and automated data quality checks.
PySpark, Databricks SQL, T-SQL, Delta Lake, Databricks, Microsoft Fabric, Fabric Data Factory, Dataflow Gen2, Databricks Workflows, Delta Live Tables (DLT), Medallion Architecture, Fabric Notebooks, Databricks clusters, Databricks Unity Catalog, Z-Order indexing, liquid clustering, CI/CD, Git, Databricks Asset Bundles (DABs), Power BI Direct Lake, Parquet, JSON, CSV
6d
Save
Mark Applied
Hide
Data Engineer
London or Manchester or Edinburgh
RemoteFull Time
Core Technology Systems
Core Technology Systems: Provides Microsoft cloud managed services and digital transformation solutions
Requires enterprise Power BI delivery, Microsoft Fabric, Azure data services, SQL, data pipelines, scalable modeling, and data governance expertise; Microsoft certifications are desirable.
Microsoft Power BI, Microsoft Fabric, DAX, Power Query, Data Factory, Lakehouse, Dataflows Gen2, Notebooks, Azure Data Factory, Azure Synapse, Data Lake, SQL, ETL, CI/CD, DevOps
1w
Save
Mark Applied
Hide
Senior Data Engineer
Manchester, England, United Kingdom
HybridFull Time
CMSPI
CMSPI: Optimizes payment supply chain performance for global merchant retailers.
3+ YOE3+ years building production data platforms; expertise in Azure Databricks, Python, ETL/ELT, CI/CD, APIs, SFTP/FTPS, Azure, infrastructure, troubleshooting, and secure data governance. STEM degree required.
Azure Databricks, Apache Spark (Spark), SQL, Python, Lakeflow Jobs, Unity Catalog, Volumes, Databricks Asset Bundles, Microsoft Azure, Azure Data Lake Storage (ADLS), Azure DevOps, Entra/RBAC, SFTP, FTPS, CI/CD, Infrastructure as Code, APIs
1w
Save
Mark Applied
Hide
Mid/Senior Data Engineer
Bristol or London or Sheffield
HybridFull Time
Methods
MethodsEuronext Paris: ATE: Provides digital transformation and consulting for the public sector.
Strong SQL and Python skills, data architecture and warehousing expertise, scalable pipeline development, Apache Spark, Azure data stack, orchestration, Docker, CI/CD, data quality, modelling, and stakeholder communication.
Ariba, Workday, SAP S/4HANA, SQL, Python, Apache Spark, PySpark, Spark SQL, Azure, Azure Data Factory, Apache Airflow, Docker, CI/CD, Power BI, Apache Superset, AWS, GCP, Oracle, Databricks, Microsoft Fabric, Kubernetes, Apache Kafka, LinkedIn Learning