mgaughan/covid19
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

Compare commits

merge into: mgaughan:dsaez_submodule
Branches Tags
mgaughan:master
mgaughan:article_ids
mgaughan:dsaez_submodule
mgaughan:kaylea/master
mgaughan:translations
...
pull from: mgaughan:master
Branches Tags
mgaughan:master
mgaughan:article_ids
mgaughan:dsaez_submodule
mgaughan:kaylea/master
mgaughan:translations

4 Commits
dsaez_subm ... master

Author SHA1 Message Date
Benjamin Mako Hill
befb87c8f5
Merge pull request #20 from makoshark/master 
bug fix: change to the correct working directory before running cron jobs
 2020-04-07 14:45:05 -07:00
Benjamin Mako Hill
1a27b68061
Merge pull request #18 from CommunityDataScienceCollective/dsaez_submodule 
Add dsaez's submodule for crawling wikidata
 2020-04-07 14:43:26 -07:00
Benjamin Mako Hill
e32e826083 updated script to ensure the correct working dir 2020-04-07 16:39:58 -05:00
Benjamin Mako Hill
0c4cfcdfcf made cronjobs executable 2020-04-04 11:19:43 -05:00
2 changed files with 7 additions and 0 deletions
Show Stats Expand all files Collapse all files

4
cron-wikipedia_revisions.sh Normal file → Executable file
View File

@ -1,5 +1,8 @@
#!/bin/bash -x #!/bin/bash -x
WORKING_DIR="/home/SOC.NORTHWESTERN.EDU/bmh1867/covid19"
cd $WORKING_DIR
TZ="UTC" TZ="UTC"
date_string=$(date +%Y%m%d) date_string=$(date +%Y%m%d)
@ -15,3 +18,4 @@ mv wikipedia/data/${revs_tsv} /var/www/covid19/wikipedia
revs_json="digobs_covid19-wikipedia-enwiki_revisions-${date_string}.json" revs_json="digobs_covid19-wikipedia-enwiki_revisions-${date_string}.json"
xz wikipedia/data/${revs_json} xz wikipedia/data/${revs_json}
mv wikipedia/data/${revs_json}.xz /var/www/covid19/wikipedia mv wikipedia/data/${revs_json}.xz /var/www/covid19/wikipedia

3
cron-wikipedia_views.sh Normal file → Executable file
View File

@ -1,5 +1,8 @@
#!/bin/bash -x #!/bin/bash -x
WORKING_DIR="/home/SOC.NORTHWESTERN.EDU/bmh1867/covid19"
cd $WORKING_DIR
TZ="UTC" TZ="UTC"
date_string=${OVERRIDE_DATE_STRING:-$(date +%Y%m%d)} date_string=${OVERRIDE_DATE_STRING:-$(date +%Y%m%d)}