Digital Alpha Platforms
Posted 4y ago

AWS– Spark –Python Data Engineer

Digital Alpha Platforms
United States
OnsiteFull Time
Responsibilities
  • Build pipelines
  • Develop platforms
  • Collaborate teams
Requirements
  • 5+ years experience building data pipelines with Apache Spark on AWS
  • Strong Python/PySpark
  • AWS data services
  • Agile practices
  • Data platform development
Technical tools mentioned
Apache SparkPythonPySparkAWSGlueEMRLambdaStep FunctionsCloudWatchS3VPCEC2RDSIAMKafka

Job description

Digital Alpha is looking for passionate data engineers to join our team. As an experienced member we look first and foremost for people who are passionate around solving business problems through innovation & engineering practices. You will be required to apply your depth of knowledge, attention to detail and expertise to all aspects of the software development lifecycle.  We embrace a culture of experimentation and constantly strive for improvement and learning. You’ll work in a collaborative, trusting, thought-provoking environment—one that encourages diversity of thought and creative solutions that are in the best interests of our customers globally.

Requirements

  • Strong hands on experience building data pipelines using Apache Spark in AWS.
  • Hands on experience with AWS services such as Glue, EMR, Lambda, Step Functions, CloudTrail, CloudWatch, SNS, SQS, S3, VPC, EC2, RDS, IAM.
  • Proficient in python programming language.
  • Proficient in PySpark.
  • Knowledge of application development lifecycles, & continuous integration/deployment practices
  • Experience with development on AWS and cloud native applications
  • Kafka and event driven architectures exposure is a plus
  • Experience with Developing Data Platforms on AWS
  • Proficient in Agile Software Development methodology, processes, and practices.

 

Qualifications:

- Bachelor’s degree in related field

- Strong, analytical, focused, self-driven with excellent problem-solving skills

- Minimum 2+ years of hands on in-depth experience of AWS Data Pipelines development and implementation is required

- AWS Architect Associate or Professional level certifications is a plus



About Digital Alpha Platforms

Provides AI, data, and platform engineering solutions for finance.