|
|
b124f9c7c8
|
write regex captures to parquet arrays.
|
2022-03-29 17:52:26 -07:00 |
|
|
|
595728d8da
|
resolve redirects if siteinfo is provided
|
2022-03-10 13:31:03 -08:00 |
|
|
|
b1bea09ad6
|
fix bugs and unit tests
|
2021-10-18 13:33:05 -07:00 |
|
|
|
414cc5ff2d
|
validate tests and add asserts and baselines for regex tests.
|
2019-11-09 12:19:55 -08:00 |
|
sohyeonhwang
|
f147e1d899
|
merging pull containing revert-radius with 2nd version of regex scanner w/ unit tests
|
2019-11-07 13:28:17 -06:00 |
|
|
|
c84844cfb5
|
add unit tests for configuring revert_radius
|
2019-10-07 15:02:30 -07:00 |
|
|
|
f7f5bf8fd4
|
sub assertEquals assertEqual
|
2018-09-03 11:21:49 -07:00 |
|
|
|
7cd0bf3b9e
|
Add parameter for selecting specific namespaces.
|
2018-08-23 18:49:32 -07:00 |
|
|
|
f468d1a5b6
|
add support for persistence with segment matching
|
2018-08-20 16:08:16 -07:00 |
|
|
|
dba793c6ac
|
migrate to mwxml. This completes the migration away from python-mediawiki-utilities. Except for preserving legacy persistence behavior, we can safely use the nice updates from the mediawiki-utils project.
|
2018-07-05 01:16:00 -07:00 |
|
|
|
d77b0a4965
|
migrate to mwpersistence. this fixes many issues. We preserve legacy persistence behavior using the --persistence-legacy.
|
2018-07-04 19:06:07 -07:00 |
|
|
|
e925ac9da1
|
add tests for wikipedia, malformed xml, bzip2, correct bz2 bug in wikiq.
|
2018-07-04 15:08:30 -07:00 |
|
|
|
d2746879d0
|
create baseline tests for xml dump processing
|
2018-07-03 23:43:47 -07:00 |
|
