13
0
cdsc_reddit/similarities/job_script.sh

5 lines
208 B
Bash
Raw Normal View History

2020-12-09 01:32:20 +00:00
#!/usr/bin/bash
start_spark_cluster.sh
2021-02-23 00:03:48 +00:00
spark-submit --master spark://$(hostname):18899 cosine_similarities.py term --outfile=/gscratch/comdata/output/reddit_similarity/comment_terms_10000.feather
2020-12-09 01:32:20 +00:00
stop-all.sh