This job has expired

This job posting is no longer active and is not accepting applications. Explore similar roles below!

🏢 Offshore Consulting Shops

Luxoft is an IT consulting and software engineering services firm that provides bespoke technology solutions to external clients, often operating as a staff augmentation or professional services provider.

This company was flagged and excluded from default search results. Proceed with caution.

Luxoft
Posted 1mo ago

Senior Big Data Engineer (Spark/Scala/Java)

Luxoft
Wroclaw, Lower Silesian Voivodeship, Poland
OnsiteFull Time
Responsibilities
  • enable teams
  • manage platform
  • provide tooling
Requirements
  • Experience developing Apache Spark solutions
  • Java/Scala production systems
  • Azure Databricks and cloud platform engineering
  • CI/CD, containerization and Kubernetes experience
  • Strong collaboration and architecture skills
Technical tools mentioned
Apache SparkAzure DatabricksJavaScalaMicrosoft AzureGitLabKubernetesTerraformPython

Job description

Project description

ACQA is built on Microsoft Azure cloud computing technology. It aims to deliver:
• Scalable cost-efficient infrastructure, using cloud PaaS components.
• Single core platform, open architecture, designed for change, itemised $cost metrics, automated data lineage.
• Shared across Front Office, Finance and Risk, improving regulatory compliance.
• One-Platform / One-Experience -fast to train, easy to operate, retaining talent.
The ACQA platform is made up of a series of components providing the next generation valuation and risk management services.

Responsibilities

  • Work with multiple federated teams to enable them to build Big Data solutions
  • Manage the ACQA Databricks platform – provide monitoring and other tooling
  • Provide best practices for runtime upgrades

Skills

Must have

  • Development of big data technologies like Apache Spark and Azure Databricks
  • Programming complex production systems in Java and Scala
  • Experience in a platform engineering role on a major cloud provider (ideally Microsoft Azure)
  • Development and/or operations of CI/CD pipelines using modern cloud-friendly build systems like GitLab
  • Experience with containerisation in development, build, and runtime environments, including experience with Kubernetes

Nice to have

  • Production experience with Terraform on a major public cloud provider (ideally Microsoft Azure)
  • Python experience
  • Testing and instrumentation practices, observability and alerting tooling
  • Understanding of information modelling, data structures and algorithms
  • Technical architecture and low-level design
  • Agile development and planning practices
  • Ability to collaborate effectively in a large global team and influence key architectural decisions

Other

Languages: English: C1 Advanced

Seniority: Senior

This job has expired