setting up the environment by loading in conda environment at Tue Sep 16 11:46:51 CDT 2025
running the batched olmo categorization job at Tue Sep 16 11:46:51 CDT 2025
[nltk_data] Downloading package punkt_tab to
[nltk_data]     /home/nws8519/nltk_data...
[nltk_data]   Package punkt_tab is already up-to-date!
cuda
NVIDIA A100-SXM4-80GB
_CudaDeviceProperties(name='NVIDIA A100-SXM4-80GB', major=8, minor=0, total_memory=81153MB, multi_processor_count=108, uuid=b6c5753c-65f3-91cd-dd90-e56a02d2cf99, L2_cache_size=40MB)

Loading checkpoint shards:   0%|          | 0/12 [00:00<?, ?it/s]
Loading checkpoint shards:   8%|▊         | 1/12 [00:00<00:05,  2.11it/s]
Loading checkpoint shards:  17%|█▋        | 2/12 [00:00<00:05,  1.99it/s]
Loading checkpoint shards:  25%|██▌       | 3/12 [00:01<00:05,  1.79it/s]
Loading checkpoint shards:  33%|███▎      | 4/12 [00:02<00:05,  1.54it/s]
Loading checkpoint shards:  42%|████▏     | 5/12 [00:02<00:04,  1.63it/s]
Loading checkpoint shards:  50%|█████     | 6/12 [00:03<00:04,  1.49it/s]
Loading checkpoint shards:  58%|█████▊    | 7/12 [00:04<00:03,  1.50it/s]
Loading checkpoint shards:  67%|██████▋   | 8/12 [00:05<00:02,  1.54it/s]
Loading checkpoint shards:  75%|███████▌  | 9/12 [00:05<00:01,  1.63it/s]
Loading checkpoint shards:  83%|████████▎ | 10/12 [00:05<00:01,  1.78it/s]
Loading checkpoint shards:  92%|█████████▏| 11/12 [00:06<00:00,  1.79it/s]
Loading checkpoint shards: 100%|██████████| 12/12 [00:06<00:00,  1.82it/s]
Asking to truncate to max_length but no maximum length is provided and the model has no predefined maximum length. Default to no truncation.