collective/wikiq
20
0
Fork 0
Code Issues Pull Requests 3 Activity
Files
507cc243281353c04eef6632c23f24bbae868ae8
wikiq/test/baseline_output/capturegroup_regextest_0.tsv
Benjamin Mako Hill b8dddf6af8 make redirect detection revision-level 
The redirect_target column added in 59fea19 was page-level: the page's
state at dump time, stamped onto every revision row of the page. That
invited the wrong inference that a given revision was a redirect, and
the column was empty for dumps whose export never wrote <redirect>
elements, such as the 2023 wikitravel.org scrapes; a Swedish Wikitravel
scrape with 732 in-text redirect revisions produced no redirect signal
at all.

Remove that column and detect redirects from each revision's own text
instead. revision_is_redirect records whether the text begins with a
redirect directive and revision_redirect_target records the directive's
link target with any fragment and label stripped. #REDIRECT is
recognized on every wiki; localized keywords (e.g. OMDIRIGERING on
Swedish wikis) can be added with --redirect-aliases. Revisions with
deleted or unavailable text get nulls in both columns. The redirect-map
use case behind 59fea19 survives: the last revision's
revision_redirect_target per page reconstructs the page-level map, now
also on dumps without <redirect> elements.

Document that title and namespace are page-level identity values as of
the time of export, not historical facts about each revision.

Regenerate the test baselines for the column change. Every regenerated
file was verified to differ from its predecessor only by removing
redirect_target and adding the two new columns, with identical values
in all shared columns.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
(cherry picked from commit 40132f04dd)
2026-08-13 13:37:44 -07:00

28 lines
13 KiB
Plaintext
Raw Blame History

"revid" "date_time" "articleid" "title" "namespace" "revision_is_redirect" "revision_redirect_target" "deleted" "editorid" "edit_summary" "text_chars" "reverteds" "sha1" "minor" "editor" "anon" "revert" "li_cheval" "three_letter" "three_number" "three_cat"
819091731 2018-01-07 10:40:58 56237363 "User talk:86.139.142.254" 3 false false 3742946 "Your IP address has been blocked from editing because it has been used to [[WP:EVADE|evade a previous block]]. ([[WP:TW|TW]])" 1141 "135nz8q6lfam6cojla7azb7k5alx3t3" false "NinjaRobotPirate" false false "has, has"
819091755 2018-01-07 10:41:10 56237364 "User talk:Kavin kavitha" 3 false false 32792125 "[[WP:AES|←]]Created page with ''''''Kavin (Tamil. கவின்) is a masculine given name, which is Tamil for ""beauty"", ""grace"", ""fairness"" or ""comeliness""Kavin is born on 01 /12/2001 at Sa...'" 663 "0pwezjc6yopz0smc8al6ogc4fax5bwo" false "Kavin kavitha" false false "AES, for" "01, 12, 2001"
819091788 2018-01-07 10:41:26 56237365 "User talk:Dr.vivek163" 3 false false 32621254 "/* Regarding Merger discussion */ new section" 399 "sz3t2ap7z8bpkdvdvi195f3i35949bv" false "Amicable always" false false "new"
819091796 2018-01-07 10:41:31 56237366 "User talk:Twistorl" 3 false false 13286072 "Warning [[Special:Contributions/Twistorl|Twistorl]] - #1" 1260 "r6s5j8j3iykenrhuhpnkpsmmd71vubf" false "ClueBot NG" false false "1"
819091825 2018-01-07 10:41:51 56237368 "Kom Firin" 0 false false 8409334 "[[WP:AES|←]]Created page with '[[File:Stele 67.119 Brooklyn.jpg|thumb|Stele of the [[Libu#Great Chiefs of the Libu|Chief of the Libu]] Titaru, a contemporary of pharaoh [[Shoshenq V]] of the [...'TestCaseB and you're a Tor node " 2249 "tf5qz2yaswx61zrlm9ovxzuhl7r2dc4" false "Khruner" false false "AES, jpg, the, the, the, the, and, you, Tor" "67, 119"
822610647 2018-01-27 12:16:02 56237368 "Kom Firin" 0 false false 8409334 "/* History */ typo" 2230 "e6oa4g0qv64icdaq26uu1zzbyr5hcbh" true "Khruner" false false
819091844 2018-01-07 10:42:05 56237369 "User:Editingaccount1994/sandbox" 2 false false 32794215 "[[WP:AES|←]]Created page with '{{User sandbox}} <!-- EDIT BELOW THIS LINE --> {{voir homonymes|Chevalier}} {{Infobox Artiste | nom = Li Chevalier | autres noms = | im...'" 27840 "0fyvyh2a8xu41gt8obr34oba0bfixj6" false "Editingaccount1994" false false "Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier" "AES, nom"
819093984 2018-01-07 11:09:52 56237369 "User:Editingaccount1994/sandbox" 2 false false 7611264 "[[User:AnomieBOT/docs/TemplateSubster|Substing templates]]: {{Lien web}}. See [[User:AnomieBOT/docs/TemplateSubster]] for info." 27787 "8gy52aolt5rg3eaketwj5v7eiw0apv2" true "AnomieBOT" false false "Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier" "web, See, for"
820064189 2018-01-12 21:45:50 56237369 "User:Editingaccount1994/sandbox" 2 false false 12406635 "Orphan per [[WP:TFD|TFD outcome]]" 27784 "he8ydemaanxlrpftqxkez8jfpge1fsj" true "SporkBot" false false "Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier" "per, TFD, TFD"
820078679 2018-01-12 23:28:11 56237369 "User:Editingaccount1994/sandbox" 2 false false 12406635 "Replace template per [[Wikipedia:Templates for discussion/Log/2010 June 13|TFD outcome]]; no change in content" 27783 "0to17w9rth3url8n7gvucdtobybdq5h" true "SporkBot" false false "Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier" "per, for, Log, TFD" "2010, 13"
820078733 2018-01-12 23:28:39 56237369 "User:Editingaccount1994/sandbox" 2 false false 12406635 "Replace template per [[Wikipedia:Templates for discussion/Log/2011 February 17|TFD outcome]]; no change in content" 27782 "531dizmmloyxffbkdr5vph7owh921eg" true "SporkBot" false false "Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier" "per, for, Log, TFD" "2011, 17"
820177382 2018-01-13 13:45:33 56237369 "User:Editingaccount1994/sandbox" 2 false false 13791031 "translate TestCaseD if you are from tor you need neutral point of view " 27757 "nik9p2u2fuk4yazjxt8ymbicxv5qid9" false "Frietjes" false false "Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier" "you, are, tor, you"
822038928 2018-01-24 01:35:22 56237369 "User:Editingaccount1994/sandbox" 2 false false 2304267 "Removing [[:c:File:Li_Chevalier_Art_Studio.jpg|Li_Chevalier_Art_Studio.jpg]], it has been deleted from Commons by [[:c:User:JuTa|JuTa]] because: [[:c:COM:OTRS|No permission]] since 16 January 2018." 27667 "gwk6pampl8si1v5pv3kwgteg710sfw3" false "CommonsDelinker" false false "Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier, Li Chevalier" "jpg, jpg, has, COM" "16, 2018"
819091874 2018-01-07 10:42:20 56237370 "Anita del Rey" 0 true "Ana del Rey" false 1368779 "r from alt name" 25 "n4ozbsgle13p9yywtfrz982ccj8woc9" false "PamD" false false "alt"
819091883 2018-01-07 10:42:27 56237371 "User talk:119.94.96.157" 3 false false 13286072 "Warning [[Special:Contributions/119.94.96.157|119.94.96.157]] - #1" 1274 "ksohnvsbeuzwpl5vb8a3v8m18hva0a7" false "ClueBot NG" false false "119, 94, 96, 157, 119, 94, 96, 157, 1"
819091914 2018-01-07 10:42:50 56237372 "Category:Ohmi Railway" 14 false false 677153 "[[WP:AES|←]]Created page with ' [[Category:Railway companies of Japan]] [[Category:Rail transport in Shiga Prefecture]] [[Category:Seibu Group]]'" 113 "je7aw21fedbwyqsyofpisdrynsu7olr" false "Underbar dk" false false "AES"
819091968 2018-01-07 10:43:32 56237375 "User talk:92.226.219.222" 3 false false 882433 "[[WP:AES|←]]Created page with '{{3rr}}~~~~'" 199 "cpm4tkzcx4hc6irr9ukbi06ogud8dtq" false "TastyPoutine" false false "AES"
819094036 2018-01-07 11:10:24 56237375 "User talk:92.226.219.222" 3 false false 7611264 "[[User:AnomieBOT/docs/TemplateSubster|Substing templates]]: {{3rr}}. See [[User:AnomieBOT/docs/TemplateSubster]] for info." 1840 "artmfz8b2gxhb3pp8a5p4ksplxqfkpg" true "AnomieBOT" false false "See, for"
819112363 2018-01-07 14:33:36 56237375 "User talk:92.226.219.222" 3 false false 702940 "Your IP address has been blocked from editing because it has been used to [[WP:EVADE|evade a previous block]]. ([[WP:TW|TW]])" 2949 "dn9wj0n8d8pdd5lqe56uw5xamupowr1" false "Only" false false "has, has"
819092004 2018-01-07 10:44:01 56237376 "User:Dipayanacharya" 2 false false 32794237 "Education" 28 "ofueugwatmmn7u73isw732neuza57gk" false "Dipayanacharya" false false
819092390 2018-01-07 10:49:08 56237376 "User:Dipayanacharya" 2 false false 32794237 "School" 38 "dsz55xv96ec2uv6w9c1z7c52ipfovbw" false "Dipayanacharya" false false
819092066 2018-01-07 10:44:56 56237378 "BSCIC" 0 true "Bangladesh Small and Cottage Industries Corporation" false 21516552 "[[WP:AES|←]]Redirected page to [[Bangladesh Small and Cottage Industries Corporation]]" 65 "9ma38hak0ef1ew4fpiutxpnzd8oz1wd" false "Vinegarymass911" false false "AES, and"
819092102 2018-01-07 10:45:21 56237379 "Category:Women government ministers of Yemen" 14 false false 754619 "[[WP:AES|←]]Created page with '{{portal|Yemen|Politics}} {{Non-diffusing subcategory|Government ministers of Yemen}} {{Underpopulated category}} Category:Women government ministers by nati...'" 285 "4dvakoat58bzyf5hmtthxukt29hip6n" false "BrownHairedGirl" false false "AES, Non"
819092135 2018-01-07 10:45:54 56237381 "Talk:List of Morning Glories Characters" 1 false false 410898 "[[WP:AES|←]]Created page with '{{WikiProject Fictional characters|class=List|importance=low}} {{Comicsproj|class=List|importance=low}}'" 103 "2sjrxsc7os9k9pg4su2t4rk2j8nn0h7" false "PRehse" false false "AES, low, low"
819092138 2018-01-07 10:45:56 56237382 "User talk:106.207.126.114" 3 false false 13286072 "Warning [[Special:Contributions/106.207.126.114|106.207.126.114]] - #1" 1330 "3y9t5wpk6ur5jhone75rhm4wjf01fgi" false "ClueBot NG" false false "106, 207, 126, 114, 106, 207, 126, 114, 1"
819092495 2018-01-07 10:50:22 56237382 "User talk:106.207.126.114" 3 false false 31190506 "Caution: Unconstructive editing on [[List of Baahubali characters]]. ([[WP:TW|TW]])" 2355 "8wvn6vh3isyt0dorpe89lztrburgupe" false "HindWIKI" false false
Reference in New Issue View Git Blame Copy Permalink