HiringCafe
Save Job
Posted 2y ago

Lead Data Engineer

@ VERYUX
View All Jobs
Mexico
RemoteFull Time
Responsibilities:Design architecture, Mentor team, Write queries
Requirements Summary:7+ years data engineering; Hadoop/Spark/MapReduce; relational DBs; Java/Python/Scala; strong problem-solving; independent and collaborative work.
Technical Tools Mentioned:Hadoop, Spark, MapReduce, MySQL, Oracle, SQL Server, Java, Python, Scala, MongoDB, Cassandra, AWS, Azure, R, MATLAB
Save
Mark Applied
Hide Job
Report & Hide
Job Description

We’re looking for a Lead Data Engineer to join our team and help us turn data into insights that drive business decisions. The ideal candidate will have a strong technical background with experience leading a team of data engineers in the design, development, and maintenance of our data architecture. He/she will be responsible for ensuring that our data is accurate, accessible, and secure, and will work closely with the data science team to develop data-driven solutions to business problems. The Lead Data Engineer will also be responsible for mentoring and developing junior data engineers, and for staying up-to-date on the latest industry trends.

Duties & Responsibilities

  • Design, implement, and maintain the data architecture for all company data, including but not limited to customer data, product data, financial data, and operational data

  • Work with business stakeholders, data scientists, and software engineers to understand data needs and develop solutions to meet those needs

  • Design and implement ETL processes to load data from a variety of sources into the data warehouse

  • Design and implement data models that are optimized for performance and scalability

  • Mentor junior members of the team and provide guidance on best practices

  • Participate in code reviews and provide feedback on design and implementation

  • Assist in the development of data governance policies and procedures

  • Help troubleshoot production issues when they arise

  • Perform other duties as assigned

  • Write SQL queries and stored procedures to support data analysis and reporting

  • Monitor data quality and take corrective action when necessary

  • Stay up-to-date on new technologies and approaches in the data engineering field and recommend ways to improve the company’s data infrastructure

Required Skills and Qualifications

  • Bachelor’s degree in computer science, engineering, or related field

  • 7+ years professional experience as a data engineer or similar role

  • Expertise in big data processing tools, including Hadoop, Spark, and MapReduce

  • Experience with relational databases, including MySQL, Oracle, and SQL Server

  • Proficiency in Java, Python, or Scala

  • Strong analytical and problem-solving skills

  • Ability to work independently and with a team

Preferred Skills and Qualifications

  • Master’s degree in computer science, engineering, or related field

  • 10+ years professional experience as a data engineer or similar role

  • Experience with NoSQL databases, including MongoDB and Cassandra

  • Experience with cloud computing platforms, including Amazon Web Services and Microsoft Azure

  • Proficiency in R or MATLAB