collective/cdsc_reddit
13
0
Fork 0
Code

Bugfix (typo)

Browse Source
This commit is contained in:
Nate E TeBlunthuis 2020-11-10 13:38:11 -08:00
parent 39c581bee9
commit 4c8bd14992
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
term_cosine_similarity.py
View File

@ -47,7 +47,7 @@ https://stanford.edu/~rezab/papers/dimsum.pdf. If similarity_threshold=0 we get
if exclude_phrases == True: if exclude_phrases == True:
tfidf = tfidf.filter(~f.col(term).contains("_")) tfidf = tfidf.filter(~f.col(term).contains("_"))
sim_dist, tfidf = cosine_similarities(tfidf, 'term', min_df, include_subreddits, similarity_threshold) sim_dist, tfidf = cosine_similarities(tfidf, 'term', min_df, included_subreddits, similarity_threshold)
p = Path(outfile) p = Path(outfile)