13
0
Commit Graph

55 Commits

Author SHA1 Message Date
Nate E TeBlunthuis
7da18e33ba Bugfix: use timestamp types
Also change the canonical file path.
2020-07-03 11:38:43 -07:00
Nate E TeBlunthuis
db2d6248fc update the reddit comment dumps 2020-07-03 10:41:13 -07:00
Nate E TeBlunthuis
d05da6441f Don't clobber old dumps so that we can just download the new ones. 2020-07-03 10:40:43 -07:00
Nate E TeBlunthuis
592d2c7dda script for getting submissions dumps from pushshift. 2020-07-02 17:40:17 -07:00
Nate E TeBlunthuis
64e9408a65 Extract variables from pushshift comment to parquet
A spark script
2020-07-02 14:35:55 -07:00