Job Information
1.
Senior Python & AWS Developers to Migrate new Acquisition data – Remote
This is a Migration project from a new Acquisition company's existing AWS to the Client AWS Cloud
The core skill set is very good knowledge of Python and AWS. Customer will give coding exercises realtime and will grill on technical capability. Expected to contribute independently by 4th week.
Job Title: Big Data Engineer with Python & AWS Development
Job Description:
Our Opportunity:
As a developer, you will join the team as a hands-on technologist to work on our data initiatives supporting current on-premises solution and enable the evolution to the cloud.
The role requires hands-on development in a client driven technology organization and executing on regulatory, tactical and strategic business initiatives focused on developing the data platform and delivery of analytics, reporting projects. The ideal candidate is expected to be a self-entails full Agile and DevOps model in partnership of our business—actively working with Product Owners, End-Users, Partners—in managing requirements, design, coding, testing (unit and functional), deployment and post-release support.
What you’ll do:
• Work collaboratively with other engineers, architects, data scientists, analytics teams, and business product owners in an agile environment
• Architect, build, and support the operation of Cloud and On-Premises enterprise data infrastructure and tools
• Design and build robust, reusable, and scalable data driven solutions and data pipeline frameworks to automate the ingestion, processing and delivery of both structured and unstructured batch and real-time streaming data
• Define asset management data models for operational and reporting data store implementations through understanding of business requirements and analysing existing application, API and reporting implementations.
• Build data APIs and data delivery services to support critical operational processes, analytical models and machine learning applications
• Assist in selection and integration of data related tools, frameworks, and applications required to expand platform capabilities
• Understand and implement best practices in management of enterprise data, including master data, reference data, metadata, data quality and lineage
• Scale solutions to support multiple efforts, establish design patterns and software that can be leveraged outside the team.
• Communicate strategic technology plans to associated business partners ensuring collaboration across technology and the business.
• Lead or participate in developing proof of concepts
• Analyse business problems and processes, help refine requirements and design solutions for them.
• Drive continuous integration and deployment strategies leveraging tools like Jenkins/Bamboo with a DevOps philosophy
• Perform production support activities
• Be a champion of new ways of collaborating with technology and business partners
• Influence and implement improvements and efficiencies in the technical aspects of the development process
What you have:
• Bachelor’s degree in computer science, information systems, math, engineering, or other technical field, or equivalent experience
• Five or more years of experience with Python or Java
• Three or more years of experience in building data lake, cloud data platform leveraging cloud (GCP/AWS) cloud native architecture, ETL/ELT, and data integration
• Experience delivering data platform modernization efforts in a financial services industry is preferred.
• Three years of development experience with cloud services (AWS,GCP,AZURE) utilizing various support tools (e.g. GCS, Dataproc, Cloud Data flow, Airflow(Composer), Cloud Pub/Sub)
• Familiarity in developing distributed data processing and Streaming frameworks and architectures (Apache Spark, Apache Beam, Apache Flink)
• Familiarity with NoSQL database technologies (e.g. MongoDB, BigTable, DynamoDB)
• Expertise in build and deployment tools - (Visual Studio, PyCharm, Git/Bitbucket/Bamboo, Maven, Jenkins, Nexus)
• Four years of experience and expertise in database design techniques and philosophies (e.g. RDBMS, Document, Star Schema, Data Vault, Kimball Model)
• Experience with integration and service frameworks (e.g API Gateways, Apache Camel, Swagger API, Zookeeper, Kafka, messaging tools, microservices)
• Expertise with Microservices and REST based API development
• Experience leveraging continuous integration/development tools (e.g. Jenkins, Docker, Containers, OpenShift, Kubernetes, and container automation) in a Ci/CD pipeline
• Attention to detail and results oriented, with a strong customer focus
• Ability to work as part of a team and independently
• Ability to prioritize workload to meet tight deadlines
• Ability to conceptualize the best tactical approach for a team to deliver a project while defining the target state evolution path
• Excellent team player with the ability to influence and negotiate
• Self-motivated as well as creative and efficient in proposing solutions to complex, time-critical problems