NotImplementedError: Loading a streaming dataset cached in a LocalFileSystem is not supported yet. #174

Error

when i run below command,

bash training/finetune_llama-2-7b-32k-mqa.sh

it will return errors:

NotImplementedError: Loading a streaming dataset cached in a LocalFileSystem is not supported yet.

How-to-Fix

re-install datasets
old version: 2.13.0 (above error)
new version: 2.15.0 (working)