Rearc
Posted 1y ago

Lead Data Engineer

Rearc
Pune, India
OnsiteFull Time
Responsibilities
  • Collaborating with stakeholders
  • Driving DataOps practices
  • Leading projects
Requirements
  • 10+ years of experience in data engineering
  • Data architecture, or related fields
  • With proven leadership and mentoring skills
Technical tools mentioned
DatabricksDelta LakeAWSRedshiftGlueS3Apache AirflowPrefect

Job description

As a Lead Data Engineer at Rearc, you'll play a pivotal role in establishing and maintaining technical excellence within our data engineering team. Your deep expertise in data architecture, ETL processes, and data modelling will be instrumental in optimizing data workflows for efficiency, scalability, and reliability. You'll collaborate closely with cross-functional teams to design and implement robust data solutions that meet business objectives and adhere to best practices in data management. Building strong partnerships with both technical teams and stakeholders will be essential as you drive data-driven initiatives and ensure their successful implementation. 


What You Bring

  • 10+ years of experience in data engineering, data architecture, or related fields, demonstrating expertise in managing and optimizing complex data pipelines and architectures.
  • Proven ability to lead and deliver large-scale data engineering projects, with a track record of designing and implementing scalable data solutions.
  • Advanced skills in ETL processes, data warehousing, and data modeling, using tools like Databricks and Delta Lake.
  • AWS experience (e.g., Redshift, Glue, S3) and familiarity with cloud platforms are a plus.
  • Proficiency in modern data engineering tools such as Apache Airflow, Prefect, or similar workflow orchestration platforms.
  • Strong analytical and strategic thinking skills, enabling you to address complex data challenges and drive business outcomes.
  • Proven leadership and mentoring skills, with a passion for fostering team growth and collaboration.
  • Exceptional communication abilities, facilitating clear collaboration with cross-functional teams and stakeholder alignment.


What You’ll Do

  • Collaborate with Stakeholders: Work closely with internal and external stakeholders to understand data challenges and design solutions tailored to client needs.
  • Drive DataOps Practices: Lead with a DataOps mindset, leveraging modern tools and methodologies to build scalable, efficient, and reliable data pipelines.
  • Lead Projects and Teams: Manage and execute high-impact data engineering projects, ensuring timely delivery and technical excellence while mentoring and guiding the team.
  • Foster Knowledge Sharing: Promote continuous learning by contributing to technical blogs, sharing best practices, and encouraging innovation across the team.
  • Enable Strategic Growth in Pune: Act as a key player in establishing our presence in Pune, replicating the successful structures we’ve implemented in the US, managing relationships with clients, and leading project delivery.


At Rearc, we're committed to empowering engineers to build awesome products and experiences. Success as a business hinges on our people's ability to think freely, challenge the status quo, and speak up about alternative problem-solving approaches. If you're an engineer driven by the desire to solve problems and make a difference, you're in the right place!


Our approach is simple — empower engineers with the best tools possible to make

an impact within their industry.


We're on the lookout for engineers who thrive on ownership and freedom, possessing not just technical prowess, but also exceptional leadership skills. Our ideal candidates are hands-on-keyboard leaders who don't just talk the talk but also walk the walk, designing and building solutions that push the boundaries of cloud computing.

About Rearc

Engineering firm providing cloud, data, and AI services.

Year founded
2016
Employees
120
Organization type
Private
Latest investment
Corporate Round (2022) — led by Databricks
Headquarters
US

Similar jobs

Lead Data Engineer roles near Pune, null
3mo
Save
Mark Applied
Hide
Lead Data Engineer - Data Modeler
Pune, Maharashtra, India
HybridFull Time
EXL
EXLNASDAQ: EXLS: Provides data analytics and digital operations solutions to businesses.
10+ YOE10+ years of experience and a bachelor’s degree in Computer Science or related field; strong data modeling and data engineering skills.
Databricks, Snowflake, Redshift, Airflow, Dagster, Spark, Java, Scala, Python, Git, JIRA, Jenkins, CI/CD, DBT, AWS
2mo
Save
Mark Applied
Hide
Lead Data Platform Engineer
Pune or Chennai
OnsiteFull Time
Gen Digital
Gen Digital: Provides cybersecurity, identity protection, and online privacy software solutions.
10+ YOE10-15+ years in data platform engineering; architect large-scale data platforms; strong SQL, Python; Kafka; Kubernetes; IaC; leadership.
SQL, Python, Java, Scala, Docker, Kubernetes, Kafka, Apache Airflow, Snowflake, dbt, PostgreSQL, MySQL, Oracle, DynamoDB, MongoDB, Elasticsearch, Prometheus, Grafana, ELK, Jaeger, Informatica, SSIS
1y
Save
Mark Applied
Hide
Lead Software Engineer, Data - 10070
Pune City or Hyderabad
HybridFull Time
Coupa
Coupa: Cloud platform for managing business spend and supply chains.
10+ YOE3+ Mgmt10+ years data engineering and application development; 3+ years technical lead; graduate degree in Computer Science; strong Python and Java; advanced SQL; experience with Spark, Kafka; cloud services (AWS/Azure/GCP); API design REST/GraphQL; data warehousing; handling unstructured data.
Python, Java, SQL, Spark, Kafka, AWS, Azure, GCP, REST, GraphQL, ETL, ELT, Data Warehouse
4mo
Save
Mark Applied
Hide
Delivery Lead/Senior Data Engineer 3
Pune, Maharashtra, India
OnsiteFull Time
Barclays
BarclaysLondon Stock Exchange: BARC: Global bank providing retail, corporate, and investment financial services.
Lead enterprise-scale data platforms; cloud data architecture (AWS); data governance; Python/PySpark/SQL; DevOps/CI/CD; data security; guide teams.
AWS, Glue, Lambda, S3, Redshift, Athena, Databricks, Snowflake, Python, PySpark, SQL, Jenkins, GitLab, Immuta, DBT, Kafka, Spark Streaming