Benjamin Mako Hill bf6ccbc84a datasets/helper.py: use zstandard library for .zst decompression ...

The Python environment runs inside a Singularity container that cannot
exec the host's /usr/bin/zstd via subprocess. Replace the subprocess
call with the zstandard Python library, which was already a dependency.
Other formats (bz2, xz, gz) still use subprocess as before.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-05-25 18:48:04 -07:00

1.7 KiB

Raw Blame History

View Raw