Berkeley Payment
Posted 1mo ago

Intermediate Data Engineer

Berkeley Payment
Canada
RemoteFull Time
Responsibilities
  • designing pipelines
  • operating infrastructure
  • mentoring juniors
Requirements
  • 3+ years data engineering experience building production data pipelines
  • Proficiency in SQL and Python
  • Experience with AWS
  • Terraform
  • PySpark
  • Workflow orchestration and data warehousing
Technical tools mentioned
AWSS3AuroraRDSLambdaTerraformPostgreSQLMySQLPythonPySparkArgo WorkflowsAirflowGitGitHub

Job description




This is a remote position.

About Us:

Berkeley Payments is a leading payment technology provider specializing in innovative solutions for businesses to manage and process payments seamlessly. We pride ourselves on offering cutting-edge financial technology to our clients, empowering businesses to streamline operations and improve their payment processes.


Role Overview:

We are looking for an experienced and highly capable Intermediate Data Engineer to join our technology team. In this role, you will own the design, development, and operation of our data infrastructure, ensuring data is reliable, scalable, and trusted across the organization. You will play a key role in shaping data architecture, setting engineering standards, and enabling analytics, finance, and product teams to make data-driven decisions. This role is suited for someone who has built production data systems and is ready to take full ownership in a fast-paced fintech environment.


Key Responsibilities:

  • Design, build, and maintain scalable and fault-tolerant data pipelines using AWS services.

  • Own and evolve the architecture for data ingestion, transformation, and storage.

  • Design and maintain data models, data warehouses, and data marts to support analytics and financial reporting.

  • Develop and operate robust ETL processes ensuring timely, accurate, and auditable data ingestion.

  • Partner with analytics, finance, product, and engineering teams to translate business requirements into durable data solutions.

  • Optimize data pipelines and infrastructure for performance, reliability, and cost efficiency.

  • Establish data quality checks, monitoring, and alerting to ensure trust in data.

  • Ensure data security, integrity, and compliance across the full data lifecycle.

  • Build and manage data infrastructure using Terraform and infrastructure-as-code practices.

  • Support and improve executive dashboards, financial reporting, and operational analytics.

  • Troubleshoot complex data issues and lead root cause analysis and resolution.

  • Mentor junior team members and set best practices for data engineering across the organization.

  • Stay current with industry trends and continuously improve data platform capabilities.


Tech Stack:

  • Cloud Services: AWS

  • Infrastructure as Code (IaC): Terraform

  • Databases: PostgreSQL, MySQL

  • ETL Tools: Production-grade ETL frameworks and pipelines

  • Programming Languages: Python

  • Version Control: Git, GitHub


Qualifications:

  • Bachelor’s degree in Computer Science, Engineering, Information Technology, or equivalent practical experience.

  • 3+ years of experience in data engineering or building backend data systems.

  • Strong hands-on experience designing and operating production data pipelines.

  • Deep proficiency in SQL and strong understanding of relational databases.

  • Strong programming skills in Python for data processing and automation.

  • Experience with AWS data services such as S3, Aurora, RDS, Lambda, and related tooling.

  • Experience with workflow orchestration tools, ideally Argo Workflows or Airflow.

  • Hands-on experience with PySpark for distributed data processing.

  • Hands-on experience using Terraform or similar infrastructure-as-code tools.

  • Solid understanding of data warehousing concepts, dimensional modelling, and ETL best practices.

  • Strong problem-solving skills with the ability to reason about system trade-offs.

  • Clear communication skills and ability to work cross-functionally with technical and non-technical stakeholders.


Preferred Skills:

  • Experience in fintech, payments, or financial reporting environments.

  • Familiarity with business intelligence tools such as Tableau or Power BI.

  • Experience supporting compliance, audit, or financial reporting workflows.

  • Understanding of Agile development methodologies.


What We Offer:

At Berkeley Payments, we believe in creating an environment where our team members can thrive both professionally and personally. As a part of our team, you’ll benefit from:

  • Competitive Compensation: We offer a salary package that reflects your experience and contributions.

  • Comprehensive Benefits: Enjoy health, dental, and vision coverage, along with paid time off.

  • Fully Remote Environment: We are a fully remote company, allowing you to work from anywhere.

  • Professional Development: We invest in your growth through ongoing learning opportunities, mentorship, and chances to work with cutting-edge technologies.

  • Ownership and Impact: Be a part of a small, agile team where your work has direct and visible impacts on our products and customers.

  • Inclusive Culture: We are committed to fostering a diverse and inclusive workplace where everyone’s voice is heard and valued.

  • Exciting Fintech Landscape: Join a dynamic industry at the forefront of payments technology, where you’ll tackle complex problems and contribute to innovative solutions that shape the future of fintech.


Don’t they meet every single requirement?

At Berkeley Payments, we are dedicated to building a diverse and inclusive workplace. If you’re excited about this role but your experience doesn’t align perfectly with every qualification in the job description and you have a passion for learning and growth, we encourage you to apply anyway.





About Berkeley Payment

Provides platform for launching white-label payment and card solutions.

Year founded
2005
Employees
100
Organization type
Private
Latest investment
Debt Financing (2019)
Headquarters
CA

Similar jobs

Data Engineer roles
9h
Save
Mark Applied
Hide
Data Engineer
Canada
RemoteFull Time
Blackline Safety
Blackline SafetyToronto Stock Exchange: BLN: Develops connected safety devices and cloud monitoring platforms.
3+ YOEDegree in a related computing field and 3+ years of data engineering experience. Requires cloud data services, ETL/ELT, orchestration, IaC, CI/CD, monitoring, SQL, and programming experience.
Apache Kafka, Amazon MSK, Terraform, GitHub Actions, CloudWatch, Datadog, PagerDuty, AWS Glue Studio, Matillion, AWS Step Functions, Redshift, EMR, S3, Lambda, Kinesis, SQL, Python, Java, Scala, BigQuery, Snowflake, Microsoft Fabric, Hive, Hadoop, Apache Flink, Apache Spark, Power BI, Amazon Quick, Amazon Bedrock, SageMaker, Strands, Claude Code, Amazon Q Developer, GitHub Copilot, Infrastructure as Code (IaC), CI/CD, ETL/ELT, AWS
12h
Save
Mark Applied
Hide
Senior Data Engineer
Toronto, Ontario, Canada
$120k-$145k/yr HybridFull Time
Konrad Group
Konrad Group: Provides digital strategy, design, and software development services.
4+ YOEBachelor's degree or higher in a relevant field and 4+ years of data engineering experience. Requires SQL or Python, data platforms, pipelines, cloud services, big data technologies, and analytical skills.
Azure Fabric, Databricks, Snowflake, SQL, Python, Spark, Hadoop, Kafka, DevOps, CI/CD
19h
Save
Mark Applied
Hide
AWS Data Engineer
Mississauga or Canada
$98k-$110k/yr RemoteFull Time
Cognizant
CognizantNasdaq: CTSH: Provides IT consulting and digital business process services.
5+ YOEBachelor's degree and 5+ years of data engineering experience required, including 3+ years building Databricks solutions on AWS; strong Python, PySpark, Spark SQL, SQL, ETL/ELT, and cloud data platform skills.
Databricks, PySpark, Python, SQL, Delta Lake, AWS, Amazon S3, AWS Glue, AWS Lambda, AWS Identity and Access Management (IAM), Amazon Redshift, Amazon SNS, Amazon SQS, Amazon CloudWatch, Git, Terraform, Jenkins, Azure DevOps, Spark SQL, Unity Catalog
1d
Save
Mark Applied
Hide
Principal Data Engineer
Toronto, Ontario, Canada
$95k-$176k/yr OnsiteFull Time
BMO
BMOTSX: BMO: Provides personal and commercial banking, investment, and wealth services.
15+ YOE15+ years relevant experience, post-secondary education or equivalent, bachelor's degree in computer/data science or engineering, principal engineering experience, and expertise in data architecture, cloud, AI, security, and integration.
Python, Spark, Scala, RAG, MLOps, LLMOps
1d
Save
Mark Applied
Hide
Consultant, Data Developer
Toronto, Ontario, Canada
OnsiteFull Time
CIBC
CIBCToronto Stock Exchange: CM: Provides personal, commercial, and investment banking and wealth management.
7+ YOERequires 7+ years with Databricks, Azure Data Factory, Informatica, Oracle DB, Azure, Python, SQL, CI/CD, GitHub, batch scheduling, and SFTP; bachelor's degree or equivalent and technical leadership experience.
Databricks, Azure Data Factory, Informatica, Oracle Database, Microsoft Azure, Python, SQL, CI/CD, GitHub, AutoSys, SFTP, REST APIs, Databricks Unity Catalog, Informatica Cloud, Informatica PowerExchange
1d
Save
Mark Applied
Hide
Staff Data Engineer
Canada
RemoteFull Time
Sonatype
Sonatype: Secures software supply chains and automates open source governance.
8+ YOERequires 8+ years of data or backend engineering experience, a technical bachelor's degree, strong Python, Scala, or Java skills, distributed data systems, SQL, NoSQL, ETL/ELT, data modeling, and Databricks expertise.
Databricks, Apache Spark, Python, Scala, Java, Apache Kafka, SQL, NoSQL, Apache Airflow, Dagster, Amazon Web Services (AWS), Delta Lake, Apache Iceberg, Apache Hudi, CI/CD
1d
Save
Mark Applied
Hide
Data Engineer
Toronto or Vancouver or Ottawa or Calgary or Halifax or St. John's or Kelowna or Prince George or Montreal or Quebec City
$83k-$93k/yr HybridFull Time
Canadian Cancer Society
Canadian Cancer Society: A national cancer organization funding research, supporting people affected by cancer, and advocating for healthier communities.
3+ YOEBachelor's or master's degree in a relevant computing or data field, 3-5 years of related experience, and proficiency with Microsoft Fabric, Apache Spark, SQL, Python, cloud data platforms, integrations, DevOps, and data governance.
Microsoft Fabric, Apache Spark, SQL, Python, Microsoft Azure, Azure DevOps, Microsoft Purview, Salesforce, Delta Lake, OneLake
1d
Save
Mark Applied
Hide
Data Engineer (270600)
Toronto, Ontario, Canada
OnsiteFull Time
Scotiabank
ScotiabankToronto Stock Exchange: BNS: Provides global personal, commercial, and investment banking services.
4+ YOERequires 4+ years in cloud, lakehouse, data platforms, ETL/ELT, and CI/CD; Azure and Databricks are required, with SQL, Python, Java, Scala, GitHub, Bitbucket, and Terraform experience.
Azure, Azure Data Factory, ADLS, Databricks, Unity Catalog, Auto Loader, SQL, Python, Java, Scala, GitHub, Bitbucket, Terraform, DevOps, Scrum, Product Teams