Project description
Our Client is a leading global financial markets infrastructure and data provider. Their purpose is driving financial stability, empowering economies and enabling customers to create sustainable growth.
Team is responsible for managing a secure, scalable, and highly available cloud platform built on AWS, Azure, and Snowflake. Our mission is to deliver a strategic Common Data and Reporting solution for clients, members, and regulators by consolidating multiple data sources into a centralized reporting data store.
This role offers the opportunity to work on cutting-edge cloud technologies and contribute to building a platform that transforms how data is leveraged across the business.
Responsibilities
- Design, build, and optimize scalable data pipelines using Python, SQL, DBT, and Apache Airflow
- Develop and manage DBT models and ensure reliable workflow orchestration in Airflow
- Monitor and maintain Snowflake platform performance, availability, and cost efficiency
- Troubleshoot and resolve issues across data ingestion, transformation, and pipelines
- Implement and maintain end-to-end data quality testing and validation frameworks
- Automate deployments and workflows using GitLab CI/CD and support release processes
- Provide support to users and collaborate with teams on Snowflake, Airflow, and data solutions
- Document architecture and best practices while contributing to technical design, mentoring, and continuous improvement
Skills
Must have
- 7+ years of proven experience as a Senior Data Engineer
- Hands-on experience with Snowflake (preferred) or Databricks
- Experience with cloud platforms – AWS (preferred) or Azure
- Strong SQL
- advanced query writing and optimization skills
- Strong Python
- experience in data processing and automation
- Basic CI/CD knowledge (GitLab or similar)
- understanding of deployment pipelines
- Apache Airflow
- workflow orchestration
- Data Build Tool
- data transformation and modeling
Nice to have
- Terraform
- infrastructure as code
- Kafka
- event streaming and messaging
- Experience with DBT (data modeling and transformation)
- Oracle
Other
Languages: English: C1 Advanced
Seniority: Senior
