Li Auto
Posted 3mo ago

大数据平台开发工程师-存储方向

Li Auto
Beijing, Beijing, China
OnsiteFull Time
Responsibilities
  • designing storage
  • developing platform
  • maintaining sla
Requirements
  • Bachelor's in computer-related field
  • Familiarity with data lake/storage (Iceberg/Paimon/Lance)
  • OLAP/MPP systems (Presto/StarRocks)
  • Big data stack (Hadoop/Hive/Spark/Flink/Kafka), and production system maintenance
Technical tools mentioned
PaimonLanceGravitinoPolarisUnity CatalogIcebergPrestoStarRocksHadoopHiveSparkFlinkKafka

Job description

1、基于Paimon/Lance与Gravitino设计与研发理想汽车数据湖存储,解决海量元数据管理、分级存储、缓存加速、多模态存储、向量和全文检索等需求,支持数据平台、算法平台等数据存储和访问场景;
2、与团队合作完成湖仓一体底层存储建设,支持批流一体业务场景,优化业务数据链路;
3、负责维护线上分布式存储或大数据解决方案的SLA,基于用户的体验和数据持续优化。

1、全日制统招本科及以上学历,计算机相关专业
2、熟悉数据湖和元数据概念原理,Iceberg/Paimon/Lance及Gravitino/Polaris/Unity Catalog;
3、熟悉MPP库概念、架构和原理,精通OLAP相关技术,包括SQL语言应用、数据模型的设计和开发,至少熟悉一种OLAP组件及其特性和应用场景,Presto/StarRocks;
4、有大数据相关研发经验和数仓开发经验,对常见的大数据体系组件(Hadoop、Hive、Spark、Flink、Kafka等)有使用和开发经验;
5、加分项:熟悉本体语义或数据语义层的定义和应用。

About Li Auto

Designing and manufacturing premium smart electric vehicles.

Similar jobs

Big Data Platform Engineer roles near Beijing, Beijing
8mo
Save
Mark Applied
Hide
具身智能大数据平台/引擎开发工程师
Beijing, Beijing, China
OnsiteFull Time
Spirit AI
Spirit AI: Developing embodied AI and robotics for autonomous physical systems.
3+ YOEBachelor's in computer science or related, 3+ years big data development, expertise with Hadoop/Spark/Flink/Kafka, Python/Java/Scala/SQL, storage systems and cloud-native deployment.
Hadoop, Spark, Flink, Kafka, Python, Java, Scala, SQL, HDFS, OSS/S3, HBase, ClickHouse, Docker, Kubernetes
1y
Save
Mark Applied
Hide
大数据平台研发工程师/专家-BABI
Beijing, Beijing, China
OnsiteFull Time
ByteDance
ByteDance: Developing AI-driven content platforms and mobile applications.
Bachelor's in computer science, strong programming in Java/Go/Python, familiarity with Kafka/Flink/Spark/Hive/Clickhouse/Doris, cloud and cloud-native concepts, system architecture and optimization skills.
Java, Go, Python, Kafka, Flink, Spark, Hive, Clickhouse, Doris
1mo
Save
Mark Applied
Hide
多模态大数据平台开发工程师
Shanghai or Beijing or Shenzhen
OnsiteFull Time
Agibot
Agibot: Develops general-purpose humanoid robots and embodied AI systems.
Master's degree or above in CS/AI/Automation, strong programming on Linux and proficiency in at least one of Java, Go, Python, C++, TypeScript; familiarity with backend, database, frontend or big data frameworks; proactive and team-oriented.
Linux, Java, Go, Python, C++, TypeScript, Argo Workflows