Autel Robotics
Posted 8mo ago

Python 数据处理工程师(数据采集/清洗/数据闭环平台)

Autel Robotics
Beijing, Beijing, China
OnsiteFull Time
Responsibilities
  • collecting data
  • cleaning data
  • optimizing pipelines
Requirements
  • Bachelor's in computer/data-related field
  • Proficient in Python and data libraries
  • Experience in data collection
  • Cleaning
  • Preprocessing
  • Scheduling (Airflow/Workflow) and basic DB operations (MySQL/PostgreSQL/Redis)
Technical tools mentioned
PythonPandasNumpyWorkflowAirflowMySQLPostgreSQLRedis

Job description

负责公司数据闭环平台的数据采集、解析、清洗、预处理和组织,确保数据完整性和高质量
设计和优化数据处理流程,开发高效、可扩展的数据处理工具和脚本,提升数据处理效率
参与数据版本管理、数据格式转换和时间同步等工作,保证数据可追溯性和一致性
与算法团队和内部同学紧密协作,理解业务需求,优化数据流和处理流程
对数据质量问题进行分析和改进,推动数据处理标准化和流程优化
使用 Workflow 等调度平台管理数据处理任务,实现数据处理流程自动化
辅助管理常用数据库和中间件(MySQL、Redis 等),保证数据服务稳定

任职要求:
本科及以上学历,计算机科学、数据工程、软件工程、人工智能等相关专业
精通 Python,熟练使用常用数据处理库(如 Pandas、Numpy 等)
有数据清洗、数据预处理、数据解析或数据组织经验,熟悉完整数据处理流程
熟悉调度和任务管理平台(如 Airflow、Workflow 等),能够设计和维护数据处理任务
熟悉基本数据库操作(MySQL、PostgreSQL、Redis 等),保证数据处理稳定
注重数据质量,有良好的逻辑分析能力,思路清晰,团队协作能力强

本科及以上学历,计算机科学、数据工程、软件工程、人工智能等相关专业
精通 Python,熟练使用用数据处理库(如 Pandas、Numpy 等)
有数据清洗、数据预处理、数据解析或数据组织经验,熟悉完整数据处理流程
熟悉调度和任务管理平台(如 Airflow、Workflow 等),能够设计和维护数据处理任务
熟悉基本数据库操作(MySQL、PostgreSQL、Redis 等),保证数据处理稳定
注重数据质量,有良好的逻辑分析能力,思路清晰,团队协作能力强

About Autel Robotics

Manufacturer of consumer and industrial unmanned aerial vehicles.

Similar jobs

Data Processing Engineer roles near Beijing, Beijing
2w
Save
Mark Applied
Hide
数据技术及产品部-RL 数据处理工程师-Work
Beijing or Hangzhou
OnsiteFull Time
Alibaba Group
Alibaba GroupNYSE: BABA: A global technology specializing in e-commerce and cloud computing.
2+ YOEBachelor's degree in a relevant field and 2+ years of data mining, data engineering, or machine learning experience; Python, SQL, Shell, ETL, pipeline, LLM, and distributed processing expertise.
Python, Spark, Ray, Dask, Flink, SQL, Shell, LLM
1mo
Save
Mark Applied
Hide
解决方案数据处理工程师
Beijing or Shanghai
OnsiteFull Time
Lightwheel
Lightwheel: Provides simulation and data infrastructure for physical AI systems.
2+ YOEBachelor's degree and 2+ years of data processing or engineering experience; Python, Linux, shell scripting, databases, cloud storage, data formats, and customer delivery expertise required.
Python, MCAP, LeRobot, S3, Alibaba Cloud OSS, MySQL, Elasticsearch, Linux, Shell, JSON, CSV, Parquet, HDF5, Tencent Cloud COS
10mo
Save
Mark Applied
Hide
大模型数据处理工程师
Beijing, Beijing, China
OnsiteFull Time
Zhipu AI
Zhipu AIHKEX: 02513: Developing advanced large-scale artificial intelligence models and platforms.
1+ YOEMaster's in CS/data science, 1+ year data processing experience, proficient in Python, pandas, numpy, familiar with Spark or Dask, experience designing data quality controls.
Python, pandas, numpy, Spark, Dask, CommonCrawl, C4
6d
Save
Mark Applied
Hide
算法工程师-大数据处理
Beijing or Hangzhou
OnsiteFull Time
Alibaba Cloud
Alibaba CloudNYSE: BABA: Global cloud computing infrastructure and services provider
Master's degree or higher in computer science, mathematics, statistics, artificial intelligence, or big data; multimodal data experience; deep learning, large-scale processing, mathematical modeling, and Python or Java skills.
TensorFlow, PyTorch, Python, Java
2mo
Save
Mark Applied
Hide
流式视频生成数据处理工程师
Beijing, Beijing, China
OnsiteFull Time
Shengshu Technology
Shengshu Technology: Develops multimodal generative AI models and world model frameworks.
Design and optimize large-scale streaming video data pipelines; proficient in Python and deep learning frameworks; experience with data cleaning, annotation, transcoding, and quality assurance for model training.
Python, PyTorch
4y
Save
Mark Applied
Hide
数据处理及管理工程师
Beijing, Beijing, China
OnsiteFull Time
Beijing Wanji Technology
Beijing Wanji TechnologyShenzhen Stock Exchange: 300552: Provider of intelligent transportation systems and road sensing technology.
Perform data labeling, dataset construction and data management for lidar and smart base station products; plan and coordinate outsourced labeling; review and audit labeled data; collaborate with projects to deliver targeted datasets.