Save Job
Posted 2mo ago

Data Engineer

@ Test Triangle
Dublin, Dublin, Ireland
OnsiteFull Time
Responsibilities:Build pipelines, Ensure data quality, Collaborate cross-functionally
Requirements Summary:5+ years of experience designing and building end-to-end data pipelines; strong data quality focus; proficient in Python or Scala, Spark, Hadoop ecosystem, SQL; experience deploying data-driven applications; knowledge of cloud (Databricks or AWS) is a plus.
Technical Tools Mentioned:Python, Scala, Spark, Hadoop, Hive, Airflow, NiFi, Scoop, SQL, Databricks, AWS
Save
Mark Applied
Hide Job
Report & Hide
Job Description

Job Description:

• Ability to easily move between business, data management, and technical teams; ability to quickly intuit the business use case and identify technical solutions to enable it

• Experience building robust and efficient data pipelines end-to-end with a strong focus on data quality

• High proficiency in using Python or Scala, Spark, Hadoop platforms & tools (Hive, Airflow, NiFi, Scoop), SQL to build Big Data products & platforms

• Experience in building and deploying production-level data-driven applications and data processing workflows/pipelines and/or

• Implementing machine learning systems at scale in Java, Scala, or Python and deliver analytics involving all phases like data ingestion, feature engineering, modeling, tuning, evaluating, monitoring, and presenting

• Cloud knowledge (Databricks or AWS ecosystem) is a plus but not required