cdsc_reddit/density/job_script.sh

#!/usr/bin/bash
source ~/.bashrc
echo $(hostname)
start_spark_cluster.sh
spark-submit --verbose --master spark://$(hostname):43015 overlap_density.py authors --inpath=../../data/reddit_similarity/subreddit_comment_authors-tf_10k_LSI/600.feather --outpath=../../data/reddit_density/subreddit_author_tf_similarities_10K_LSI/600.feather --agg=pd.DataFrame.sum
stop-all.sh
Updating to support wang-style user overlaps. 2020-12-25 06:38:04 +00:00			`#!/usr/bin/bash`
changes for archiving. 2023-05-24 00:18:19 +00:00			`source ~/.bashrc`
			`echo $(hostname)`
Updating to support wang-style user overlaps. 2020-12-25 06:38:04 +00:00			`start_spark_cluster.sh`
changes for archiving. 2023-05-24 00:18:19 +00:00			`spark-submit --verbose --master spark://$(hostname):43015 overlap_density.py authors --inpath=../../data/reddit_similarity/subreddit_comment_authors-tf_10k_LSI/600.feather --outpath=../../data/reddit_density/subreddit_author_tf_similarities_10K_LSI/600.feather --agg=pd.DataFrame.sum`
			`stop-all.sh`