Job Description: Role: GCP Data Engineer - ETL, SQL, Python Kitchener - Hybrid: 2 days a week in office Primary Skills: ETL SQL Big Data Python Designed and built scalable, secure, and high performance data pipelines on Google Cloud Platform (GCP). Developed and optimized ETL/ELT workflows using Cloud Composer, Dataflow, Dataproc, and BigQuery. Implemented data ingestion frameworks for batch and streaming data using Pub/Sub, Kafka, and Dataflow. Modeled, partitioned, and optimized BigQuery datasets to support analytics use cases. Collaborated with data scientists, architects, and business teams to deliver end-to-end data solutions. Ensured data quality, reliability, and robustness through monitoring, validation, and automation processes. Implemented CI/CD pipelines for data workflows using Cloud Build, Git, and Terraform. Optimized cost, performance, and scalability across GCP data services. Applied security best practices, IAM policies, and compliance standards across data platforms. |
📋 External Recruiting Agencies
Astra North (Astra North Infoteck Inc.) is a specialized IT staffing and recruitment process outsourcing (RPO) provider that focuses on supplying talent and managed services to external clients.
This company was flagged and excluded from default search results. Proceed with caution.
Posted 1w ago
GCP Data Engineer - ETL, SQL, Python
Astra North Infoteck
Kitchener, Ontario, Canada
HybridContract
Responsibilities
- building pipelines
- optimizing workflows
- implementing frameworks
Requirements
- Requires 5+ years of experience building scalable GCP data pipelines
- ETL/ELT workflows
- BigQuery solutions
- Batch and streaming ingestion, CI/CD
- Security, and data optimization
Technical tools mentioned
Google Cloud Platform (GCP)Cloud ComposerDataflowDataprocBigQueryPub/SubKafkaCloud BuildGitTerraformETLELTSQLPythonCI/CDIAM
Job description
Similar jobs
Data Engineer roles near Kitchener, Ontario