13 lines
2.0 KiB
Plaintext
13 lines
2.0 KiB
Plaintext
setting up the environment by loading in conda environment at Tue Oct 21 22:09:37 CDT 2025
|
|
running the batched olmo categorization job at Tue Oct 21 22:09:38 CDT 2025
|
|
[nltk_data] Downloading package punkt_tab to
|
|
[nltk_data] /home/nws8519/nltk_data...
|
|
[nltk_data] Package punkt_tab is already up-to-date!
|
|
cuda
|
|
NVIDIA A100-SXM4-80GB
|
|
_CudaDeviceProperties(name='NVIDIA A100-SXM4-80GB', major=8, minor=0, total_memory=81153MB, multi_processor_count=108, uuid=f431a288-a223-5654-4599-c2a6f20abe8d, L2_cache_size=40MB)
|
|
|
|
Loading checkpoint shards: 0%| | 0/12 [00:00<?, ?it/s]
|
|
Loading checkpoint shards: 8%|▊ | 1/12 [00:00<00:03, 3.54it/s]
|
|
Loading checkpoint shards: 17%|█▋ | 2/12 [00:00<00:03, 2.63it/s]
|
|
Loading checkpoint shards: 25%|██▌ | 3/12 [00:01<00:03, 2.47it/s]
|
|
Loading checkpoint shards: 33%|███▎ | 4/12 [00:01<00:03, 2.22it/s]
|
|
Loading checkpoint shards: 42%|████▏ | 5/12 [00:02<00:03, 2.06it/s]
|
|
Loading checkpoint shards: 50%|█████ | 6/12 [00:02<00:02, 2.05it/s]
|
|
Loading checkpoint shards: 58%|█████▊ | 7/12 [00:03<00:02, 2.01it/s]
|
|
Loading checkpoint shards: 67%|██████▋ | 8/12 [00:03<00:01, 2.00it/s]
|
|
Loading checkpoint shards: 75%|███████▌ | 9/12 [00:04<00:01, 2.05it/s]
|
|
Loading checkpoint shards: 83%|████████▎ | 10/12 [00:04<00:00, 2.04it/s]
|
|
Loading checkpoint shards: 92%|█████████▏| 11/12 [00:05<00:00, 2.22it/s]
|
|
Loading checkpoint shards: 100%|██████████| 12/12 [00:05<00:00, 2.36it/s]
|
|
Asking to truncate to max_length but no maximum length is provided and the model has no predefined maximum length. Default to no truncation.
|
|
This is a friendly reminder - the current text generation call will exceed the model's predefined maximum length (4096). Depending on the model, you may observe exceptions, performance degradation, or nothing at all.
|
|
unsupervised batched olmo categorization pau at Thu Oct 23 16:52:15 CDT 2025
|