Issues

• EvalPort: portable interchange for LLM-quality-filter stats

  datajuicer/data-juicer#1081 · Filter by author adhabnr-ux opened on Sep 27, 2026

• [Tracking] Reduce peak memory usage across Data-Juicer operators / 降低算子峰值内存

  datajuicer/data-juicer#1031 · Filter by author macroguo-ghy opened on Aug 5, 2026

• I have an idea to implement lineage capabilities for unstructured data—similar to the structured data lineage found in Apache Atlas or OpenLineage—within the current project

  enhancement
  datajuicer/data-juicer#1006 · Filter by author fightBoxing opened on Jul 10, 2026
  

• 为什么datajuicer在Ray模式下，不支持groupby算子呢？

  question
  datajuicer/data-juicer#920 · Filter by author lsyel opened on Feb 25, 2026

• Multi-Branch Execution (DAG feature enhancment)

  dj:coreenhancement
  datajuicer/data-juicer#915 · Filter by author yxdyc opened on Feb 13, 2026
  

• ETL过程的咨询

  question
  datajuicer/data-juicer#909 · Filter by author SeoMP opened on Feb 6, 2026
  4

• 去重算子CPU利用率非常低

  question
  datajuicer/data-juicer#879 · Filter by author zjuAJW opened on Jan 8, 2026
  1

  

• perplexity 算子，在计算中文数据集时，都特别大

  question
  datajuicer/data-juicer#878 · Filter by author nuaabuaa07 opened on Jan 7, 2026
  5

• 视频打分流程 On Ray 长尾问题

  question
  datajuicer/data-juicer#866 · Filter by author INBreezefall opened on Dec 23, 2025
  1

  

• How to use Data-Juicer with Ray (Python API, Checkpointing, and Pipeline Improvements)

  question
  datajuicer/data-juicer#846 · Filter by author atulydvv opened on Dec 11, 2025
  3

  

• 数据增强是不是只能用于单字段的json，不能用于多字段的

  datajuicer/data-juicer#813 · Filter by author GGGsk opened on Nov 11, 2025
  

• 使用 Ray 处理数据集时疑似卡住

  question
  datajuicer/data-juicer#810 · Filter by author cnlinxi opened on Nov 6, 2025
  1

• Is there any issue with the return types of the read, read_json, and read_webdataset functions in the RayDataSet class?

  datajuicer/data-juicer#797 · Filter by author cn-robot-ai opened on Oct 17, 2025
  

• 能把所有用的模型放到一个地方？

  good first issue
  datajuicer/data-juicer#792 · Filter by author zhanglv0209 opened on Sep 28, 2025
  1

• [Bug]: video_split_by_scene_mapper Runing with: [INFO] Process ffmpeg is running without libra.

  bug
  datajuicer/data-juicer#756 · Filter by author Cccccc0630 opened on Aug 12, 2025
  1

• Reaching out from the Ray Team!

  enhancement
  datajuicer/data-juicer#742 · Filter by author richardliaw opened on Jul 18, 2025
  3

  

• How to reduce the memory overhead when processing millions of samples ?

  question
  datajuicer/data-juicer#734 · Filter by author DonaldRR opened on Jul 9, 2025
  1

• 什么时候data-juicer支持使用对象存储的数据集？

  dj:coredj:datalakedj:distquestion
  datajuicer/data-juicer#732 · Filter by author wangpi26 opened on Jul 9, 2025
  3

  

• 为什么 RayExecutor 没有作为 API 服务暴露出来？

  question
  datajuicer/data-juicer#731 · Filter by author Young-zj opened on Jul 7, 2025
  

• data-juicer 有计划支持流式或微批计算么

  enhancement
  datajuicer/data-juicer#695 · Filter by author xiedeyantu opened on Jun 10, 2025
  8

  

• 在执行自己的算子的时候出现RuntimeError: One of the subprocesses has abruptly died during map operation.To debug the error, disable multiprocessing.

  question
  datajuicer/data-juicer#685 · Filter by author stalwart0465 opened on May 28, 2025
  4

  

• Improve GPU utilization in ray mode

  dj:distenhancement
  datajuicer/data-juicer#670 · Filter by author pan-x-c opened on May 12, 2025
  2

  

• 如何实现两个算子的逻辑运算关系 How to implement the logical operation between two operators?

  good first issuequestion
  datajuicer/data-juicer#667 · Filter by author DietDietDiet opened on May 9, 2025
  2

• Support others LLMs & APIs for the OP generate_qa_from_text_mapper

  dj:openhancement
  datajuicer/data-juicer#535 · Filter by author yxdyc opened on Jan 9, 2025

• [BUG]: inappropriate arguments for map_batches in ray mode

  bugdj:dist
  datajuicer/data-juicer#533 · Filter by author HYLcool opened on Jan 8, 2025