collective/mediawiki_dump_tools
18
0
Fork 0
Code Issues Pull Requests Activity

Get Parquet test working

Browse Source 
This requires some data smoothing to get read_table and read_parquet
DataFrames to look close enough, but the test now passes and validates
that the data match.

Signed-off-by: Will Beason <willbeason@gmail.com>
This commit is contained in:
Will Beason
2025-05-28 16:48:58 -05:00
parent 52757a8239
commit ee01ce3e61
2 changed files with 44 additions and 9 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
wikiq
View File

@@ -270,7 +270,7 @@ class RevDataBase:
pa.field("title", pa.string()),
pa.field("namespace", pa.int32()),
pa.field("deleted", pa.bool_()),
pa.field("test_chars", pa.int32()),
pa.field("text_chars", pa.int32()),
pa.field("revert", pa.bool_()),
pa.field("reverteds", pa.list_(pa.int64())),
pa.field("sha1", pa.string()),