ByteDance
Posted 6y ago

计算引擎研发工程师-Data

ByteDance
Beijing, Beijing, China
OnsiteFull Time
Responsibilities
  • building engine
  • tuning performance
  • supporting products
Requirements
  • Strong C++ skills
  • Experience with OLAP/vectorized execution, SIMD
  • Columnar storage
  • Parallel and distributed systems
  • Familiarity with Spark/Presto and other big-data engines, and performance debugging and tuning
Technical tools mentioned
C++Spark SQLSparkPrestoDruidKylinHiveImpalaDorisClickHouseStarRocksTeradataOracleTiDBMySQLOceanBase

Job description

1、打造业界领先的PB级OLAP引擎,并支撑字节跳动相关产品线;
2、产品旨在提供一套统一的通过C++实现的性能的向量化执行引擎;
3、该执行引擎将加速Spark SQL及Presto为代表的大数据OLAP引擎,并通过火山引擎公有云产品LAS对外提供服务;
4、负责该执行引擎的核心研发、性能调优、应用落地。

1、良好的C++编程基础;
2、熟悉主流的OLAP引擎的优化原理,如向量化执行、SIMD编程、列式存储、并行编程等;
3、扎实的计算机基础知识,包含数据结构,算法,多线程编程等,具备一定的分布式系统研发经验;
4、熟悉主流大数据系统原理及源码,比如Spark、Presto、Druid、Kylin、Hive、Impala、Doris、ClickHouse、StarRocks等;
5、具备一定的故障诊断与性能优化能力;
6、熟悉Teradata、Oracle、TiDB、MySQL、OceanBase等数据库内核优先(不要求熟悉所有技术栈)。

About ByteDance

Developing AI-driven content platforms and mobile applications.

Similar jobs

Compute Engine Engineer roles near Beijing, Beijing
3w
Save
Mark Applied
Hide
【练习生】离线计算引擎工程师(AGI数据工程)
Shanghai or Beijing or Hangzhou
OnsiteInternship
Xiaohongshu
Xiaohongshu: Social media and e-commerce platform for lifestyle sharing.
Bachelor's degree in computer science, big data, or AI (2027 graduates); proficient in Java/C++/Python; experience or interest in distributed compute engines (Spark,Celeborn,Hive); strong problem-solving and communication.
Spark, Celeborn, Hive, Java, C++, Python