Nate E TeBlunthuis 6d4344355b Create parquet datasets of reddit submissions from pushshift.

2020-07-05 23:20:17 -07:00

.gitignore

update .gitignore

2020-07-03 13:55:25 -07:00

check_submission_shas.py

Script for checking shas for submissions.

2020-07-03 13:35:46 -07:00

comments_2_parquet.py

Rename spark script to reflect that it is for comments.

2020-07-03 14:00:36 -07:00

pull_pushshift_comments.sh

update the reddit comment dumps

2020-07-03 10:41:13 -07:00

pull_pushshift_submissions.sh

bugfix in retrieving old data and rename file.

2020-07-03 13:54:55 -07:00

submissions_2_parquet.py

Create parquet datasets of reddit submissions from pushshift.

2020-07-05 23:20:17 -07:00

Description

No description provided

3.2 MiB

Languages

Python 84.5%

Makefile 11.4%

Shell 4.1%