📋 External Recruiting Agencies

Flatgigs is a recruitment and talent acquisition firm that operates as an agency for various startups in the MENA region, as evidenced by its service descriptions and job postings for diverse clients.

This company was flagged and excluded from default search results. Proceed with caution.

Save Job
Posted 1mo ago

Python Data Engineer

@ Flatgigs
Pakistan
RemoteFull Time
Responsibilities:own engine, develop processing, integrate data
Requirements Summary:5+ years Python data engineering; constraint solving/OR-Tools; large-scale data processing; Celery; Azure; SQL; REST APIs; message queues.
Technical Tools Mentioned:Python, Celery, Redis, Polars, OR-Tools, Azure Functions, Azure SQL, Azure Blob Storage, Azure Service Bus, SQLAlchemy
Save
Mark Applied
Hide Job
Report & Hide
Job Description

Our client is building an operations management platform that handles workforce planning, rostering, dispatching, and performance analytics for a large-scale field operations environment. You will own the Python engine layer, responsible for the algorithms and data processing that power the core operational workflows used daily by operations teams.

This is not a typical web backend role. You will be working on constraint-based planning algorithms, large-scale data processing pipelines, and event-driven dispatch engines that operate in real time against live operational data.

WHAT YOU'LL OWN:

  • Planning engine: processing large volumes of operational schedule data through constraint evaluation, business rules, and engagement profiles to produce workforce planning demands. Built on Celery, Polars, and OR-Tools running on Azure App Service
  • Rostering engine: generating periodic staff rosters by solving constraint problems against planning demands, employee certifications, and leave data pulled from third-party HR systems. Running as an Azure Function App
  • Dispatch engine: real-time task assignment using proximity scoring against live employee location data, attendance records, and operational schedule data. Running as an always-on Azure Function App or App service.
  • Performance engine: scheduled KPI aggregation and SLA scoring across all modules. Running as a timer-triggered Azure Function App

WHY'S THIS ROLE INTERESTING:

The planning engine is the core of this platform. The algorithm you build determines how efficiently an operations team deploys its workforce against a complex schedule of demands. When the platform matures, the rule-based constraint engine you build will become the foundation for an ML-driven prediction model. You are building something that runs in a live operational environment and directly impacts how a team performs on the ground every day.

WHAT YOU'LL WORK WITH:

  • Python 3.11
  • Celery with Redis as broker for long-running jobs
  • Polars for large-scale data processing
  • OR-Tools for constraint solving and optimisation
  • Azure Functions for event-driven and scheduled workloads
  • Azure SQL via SQLAlchemy for output persistence
  • Azure Blob Storage for intermediate file handling
  • Azure Service Bus for async message queuing between modules
  • Third-party HR and workforce management API integrations
  • Real-time location data streams for proximity-based task assignment