54 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Nate E TeBlunthuis	db2d6248fc	update the reddit comment dumps	2020-07-03 10:41:13 -07:00
Nate E TeBlunthuis	d05da6441f	Don't clobber old dumps so that we can just download the new ones.	2020-07-03 10:40:43 -07:00
Nate E TeBlunthuis	592d2c7dda	script for getting submissions dumps from pushshift.	2020-07-02 17:40:17 -07:00
Nate E TeBlunthuis	64e9408a65	Extract variables from pushshift comment to parquet ... A spark script	2020-07-02 14:35:55 -07:00