cdsc_reddit/similarities/job_script.sh

#!/usr/bin/bash
start_spark_cluster.sh
spark-submit --master spark://$(hostname):18899 wang_similarity.py --infile=/gscratch/comdata/output/reddit_similarity/tfidf/comment_authors.parquet --max_df=10 --outfile=/gscratch/comdata/output/reddit_similarity/wang_similarity_1000_max10.feather
stop-all.sh
Refactor and reorganze. 2020-12-09 01:32:20 +00:00			`#!/usr/bin/bash`
			`start_spark_cluster.sh`
Updating to support wang-style user overlaps. 2020-12-25 06:38:04 +00:00			`spark-submit --master spark://$(hostname):18899 wang_similarity.py --infile=/gscratch/comdata/output/reddit_similarity/tfidf/comment_authors.parquet --max_df=10 --outfile=/gscratch/comdata/output/reddit_similarity/wang_similarity_1000_max10.feather`
Refactor and reorganze. 2020-12-09 01:32:20 +00:00			`stop-all.sh`