13 lines
2.0 KiB
Plaintext
13 lines
2.0 KiB
Plaintext
setting up the environment by loading in conda environment at Tue Sep 16 11:46:51 CDT 2025
|
|
running the batched olmo categorization job at Tue Sep 16 11:46:51 CDT 2025
|
|
[nltk_data] Downloading package punkt_tab to
|
|
[nltk_data] /home/nws8519/nltk_data...
|
|
[nltk_data] Package punkt_tab is already up-to-date!
|
|
cuda
|
|
NVIDIA A100-SXM4-80GB
|
|
_CudaDeviceProperties(name='NVIDIA A100-SXM4-80GB', major=8, minor=0, total_memory=81153MB, multi_processor_count=108, uuid=b6c5753c-65f3-91cd-dd90-e56a02d2cf99, L2_cache_size=40MB)
|
|
|
|
Loading checkpoint shards: 0%| | 0/12 [00:00<?, ?it/s]
|
|
Loading checkpoint shards: 8%|▊ | 1/12 [00:00<00:05, 2.11it/s]
|
|
Loading checkpoint shards: 17%|█▋ | 2/12 [00:00<00:05, 1.99it/s]
|
|
Loading checkpoint shards: 25%|██▌ | 3/12 [00:01<00:05, 1.79it/s]
|
|
Loading checkpoint shards: 33%|███▎ | 4/12 [00:02<00:05, 1.54it/s]
|
|
Loading checkpoint shards: 42%|████▏ | 5/12 [00:02<00:04, 1.63it/s]
|
|
Loading checkpoint shards: 50%|█████ | 6/12 [00:03<00:04, 1.49it/s]
|
|
Loading checkpoint shards: 58%|█████▊ | 7/12 [00:04<00:03, 1.50it/s]
|
|
Loading checkpoint shards: 67%|██████▋ | 8/12 [00:05<00:02, 1.54it/s]
|
|
Loading checkpoint shards: 75%|███████▌ | 9/12 [00:05<00:01, 1.63it/s]
|
|
Loading checkpoint shards: 83%|████████▎ | 10/12 [00:05<00:01, 1.78it/s]
|
|
Loading checkpoint shards: 92%|█████████▏| 11/12 [00:06<00:00, 1.79it/s]
|
|
Loading checkpoint shards: 100%|██████████| 12/12 [00:06<00:00, 1.82it/s]
|
|
Asking to truncate to max_length but no maximum length is provided and the model has no predefined maximum length. Default to no truncation.
|
|
This is a friendly reminder - the current text generation call will exceed the model's predefined maximum length (4096). Depending on the model, you may observe exceptions, performance degradation, or nothing at all.
|
|
unsupervised batched olmo categorization pau at Thu Sep 18 03:22:25 CDT 2025
|