groceryheist/cdsc_reddit
1
0
Fork 0
Code

set os environment for big machine

Browse Source
This commit is contained in:
Nathan TeBlunthuis 2024-12-01 15:25:18 -08:00
parent abe217d2d5
commit 613059737a
1 changed files with 1 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1
ngrams/term_frequencies.py
View File

@ -14,6 +14,7 @@ from nltk.util import ngrams
import string import string
from random import random from random import random
from pathlib import Path from pathlib import Path
os.environ(["_JAVA_OPTIONS"]="-Xmx920g"
# remove urls # remove urls
# taken from https://stackoverflow.com/questions/3809401/what-is-a-good-regular-expression-to-match-a-url # taken from https://stackoverflow.com/questions/3809401/what-is-a-good-regular-expression-to-match-a-url