1
0
mw-lifecycle-analysis/p2/quest/batched-mw-olmo-info-cat.log
2025-09-16 11:22:45 -05:00

16 lines
2.0 KiB
Plaintext

setting up the environment by loading in conda environment at Sun Sep 14 11:31:17 CDT 2025
running the batched olmo categorization job at Sun Sep 14 11:31:17 CDT 2025
[nltk_data] Downloading package punkt_tab to
[nltk_data] /home/nws8519/nltk_data...
[nltk_data] Package punkt_tab is already up-to-date!
cuda
NVIDIA A100-SXM4-80GB
_CudaDeviceProperties(name='NVIDIA A100-SXM4-80GB', major=8, minor=0, total_memory=81153MB, multi_processor_count=108, uuid=02d36cc8-5c30-554c-c2e0-f5fb530dcc7a, L2_cache_size=40MB)
Loading checkpoint shards: 0%| | 0/12 [00:00<?, ?it/s]
Loading checkpoint shards: 8%|▊ | 1/12 [00:00<00:03, 2.93it/s]
Loading checkpoint shards: 17%|█▋ | 2/12 [00:00<00:04, 2.21it/s]
Loading checkpoint shards: 25%|██▌ | 3/12 [00:01<00:04, 2.06it/s]
Loading checkpoint shards: 33%|███▎ | 4/12 [00:01<00:04, 1.93it/s]
Loading checkpoint shards: 42%|████▏ | 5/12 [00:02<00:03, 1.80it/s]
Loading checkpoint shards: 50%|█████ | 6/12 [00:03<00:03, 1.78it/s]
Loading checkpoint shards: 58%|█████▊ | 7/12 [00:03<00:02, 1.84it/s]
Loading checkpoint shards: 67%|██████▋ | 8/12 [00:04<00:02, 1.82it/s]
Loading checkpoint shards: 75%|███████▌ | 9/12 [00:04<00:01, 1.76it/s]
Loading checkpoint shards: 83%|████████▎ | 10/12 [00:05<00:01, 1.68it/s]
Loading checkpoint shards: 92%|█████████▏| 11/12 [00:05<00:00, 1.86it/s]
Loading checkpoint shards: 100%|██████████| 12/12 [00:05<00:00, 2.02it/s]
Traceback (most recent call last):
File "/home/nws8519/git/mw-lifecycle-analysis/p2/quest/python_scripts/label_sampling.py", line 122, in <module>
random_df = df.sample(n=300, random_sample = 8)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
TypeError: NDFrame.sample() got an unexpected keyword argument 'random_sample'
unsupervised batched olmo categorization pau at Sun Sep 14 11:34:04 CDT 2025