setting up the environment by loading in conda environment at Mon Oct 13 09:25:24 CDT 2025
running the batched olmo categorization job at Mon Oct 13 09:25:24 CDT 2025
[nltk_data] Downloading package punkt_tab to
[nltk_data]     /home/nws8519/nltk_data...
[nltk_data]   Package punkt_tab is already up-to-date!
cuda
NVIDIA A100-SXM4-80GB
_CudaDeviceProperties(name='NVIDIA A100-SXM4-80GB', major=8, minor=0, total_memory=81153MB, multi_processor_count=108, uuid=19efa4d6-01cd-d825-4cd9-637cc23cebd3, L2_cache_size=40MB)

Loading checkpoint shards:   0%|          | 0/12 [00:00<?, ?it/s]
Loading checkpoint shards:   8%|▊         | 1/12 [00:00<00:03,  3.50it/s]
Loading checkpoint shards:  17%|█▋        | 2/12 [00:00<00:03,  2.64it/s]
Loading checkpoint shards:  25%|██▌       | 3/12 [00:01<00:03,  2.39it/s]
Loading checkpoint shards:  33%|███▎      | 4/12 [00:01<00:03,  2.19it/s]
Loading checkpoint shards:  42%|████▏     | 5/12 [00:02<00:03,  2.19it/s]
Loading checkpoint shards:  50%|█████     | 6/12 [00:02<00:02,  2.08it/s]
Loading checkpoint shards:  58%|█████▊    | 7/12 [00:03<00:02,  2.04it/s]
Loading checkpoint shards:  67%|██████▋   | 8/12 [00:03<00:01,  2.01it/s]
Loading checkpoint shards:  75%|███████▌  | 9/12 [00:04<00:01,  2.03it/s]
Loading checkpoint shards:  83%|████████▎ | 10/12 [00:04<00:00,  2.07it/s]
Loading checkpoint shards:  92%|█████████▏| 11/12 [00:05<00:00,  2.19it/s]
Loading checkpoint shards: 100%|██████████| 12/12 [00:05<00:00,  2.36it/s]
Asking to truncate to max_length but no maximum length is provided and the model has no predefined maximum length. Default to no truncation.
This is a friendly reminder - the current text generation call will exceed the model's predefined maximum length (4096). Depending on the model, you may observe exceptions, performance degradation, or nothing at all.
unsupervised batched olmo categorization pau at Wed Oct 15 02:55:57 CDT 2025