make redirect detection revision-level
The redirect_target column added in59fea19was page-level: the page's state at dump time, stamped onto every revision row of the page. That invited the wrong inference that a given revision was a redirect, and the column was empty for dumps whose export never wrote <redirect> elements, such as the 2023 wikitravel.org scrapes; a Swedish Wikitravel scrape with 732 in-text redirect revisions produced no redirect signal at all. Remove that column and detect redirects from each revision's own text instead. revision_is_redirect records whether the text begins with a redirect directive and revision_redirect_target records the directive's link target with any fragment and label stripped. #REDIRECT is recognized on every wiki; localized keywords (e.g. OMDIRIGERING on Swedish wikis) can be added with --redirect-aliases. Revisions with deleted or unavailable text get nulls in both columns. The redirect-map use case behind59fea19survives: the last revision's revision_redirect_target per page reconstructs the page-level map, now also on dumps without <redirect> elements. Document that title and namespace are page-level identity values as of the time of export, not historical facts about each revision. Regenerate the test baselines for the column change. Every regenerated file was verified to differ from its predecessor only by removing redirect_target and adding the two new columns, with identical values in all shared columns. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> (cherry picked from commit40132f04dd)
This commit is contained in:
@@ -1,27 +1,27 @@
|
||||
"revid" "date_time" "articleid" "title" "namespace" "redirect_target" "deleted" "editorid" "edit_summary" "text_chars" "reverteds" "sha1" "minor" "editor" "anon" "revert" "npov_npov" "npov_neutral" "testcase_a" "testcase_b" "testcase_c" "testcase_d"
|
||||
819091731 2018-01-07 10:40:58 56237363 "User talk:86.139.142.254" 3 false 3742946 "Your IP address has been blocked from editing because it has been used to [[WP:EVADE|evade a previous block]]. ([[WP:TW|TW]])" 1141 "135nz8q6lfam6cojla7azb7k5alx3t3" false "NinjaRobotPirate" false false
|
||||
819091755 2018-01-07 10:41:10 56237364 "User talk:Kavin kavitha" 3 false 32792125 "[[WP:AES|←]]Created page with ''''''Kavin (Tamil. கவின்) is a masculine given name, which is Tamil for ""beauty"", ""grace"", ""fairness"" or ""comeliness""Kavin is born on 01 /12/2001 at Sa...'" 663 "0pwezjc6yopz0smc8al6ogc4fax5bwo" false "Kavin kavitha" false false
|
||||
819091788 2018-01-07 10:41:26 56237365 "User talk:Dr.vivek163" 3 false 32621254 "/* Regarding Merger discussion */ new section" 399 "sz3t2ap7z8bpkdvdvi195f3i35949bv" false "Amicable always" false false "NPOV, NPOV"
|
||||
819091796 2018-01-07 10:41:31 56237366 "User talk:Twistorl" 3 false 13286072 "Warning [[Special:Contributions/Twistorl|Twistorl]] - #1" 1260 "r6s5j8j3iykenrhuhpnkpsmmd71vubf" false "ClueBot NG" false false
|
||||
819091825 2018-01-07 10:41:51 56237368 "Kom Firin" 0 false 8409334 "[[WP:AES|←]]Created page with '[[File:Stele 67.119 Brooklyn.jpg|thumb|Stele of the [[Libu#Great Chiefs of the Libu|Chief of the Libu]] Titaru, a contemporary of pharaoh [[Shoshenq V]] of the [...'TestCaseB and you're a Tor node " 2249 "tf5qz2yaswx61zrlm9ovxzuhl7r2dc4" false "Khruner" false false "NPOV" "TestCaseB"
|
||||
822610647 2018-01-27 12:16:02 56237368 "Kom Firin" 0 false 8409334 "/* History */ typo" 2230 "e6oa4g0qv64icdaq26uu1zzbyr5hcbh" true "Khruner" false false
|
||||
819091844 2018-01-07 10:42:05 56237369 "User:Editingaccount1994/sandbox" 2 false 32794215 "[[WP:AES|←]]Created page with '{{User sandbox}} <!-- EDIT BELOW THIS LINE --> {{voir homonymes|Chevalier}} {{Infobox Artiste | nom = Li Chevalier | autres noms = | im...'" 27840 "0fyvyh2a8xu41gt8obr34oba0bfixj6" false "Editingaccount1994" false false
|
||||
819093984 2018-01-07 11:09:52 56237369 "User:Editingaccount1994/sandbox" 2 false 7611264 "[[User:AnomieBOT/docs/TemplateSubster|Substing templates]]: {{Lien web}}. See [[User:AnomieBOT/docs/TemplateSubster]] for info." 27787 "8gy52aolt5rg3eaketwj5v7eiw0apv2" true "AnomieBOT" false false
|
||||
820064189 2018-01-12 21:45:50 56237369 "User:Editingaccount1994/sandbox" 2 false 12406635 "Orphan per [[WP:TFD|TFD outcome]]" 27784 "he8ydemaanxlrpftqxkez8jfpge1fsj" true "SporkBot" false false
|
||||
820078679 2018-01-12 23:28:11 56237369 "User:Editingaccount1994/sandbox" 2 false 12406635 "Replace template per [[Wikipedia:Templates for discussion/Log/2010 June 13|TFD outcome]]; no change in content" 27783 "0to17w9rth3url8n7gvucdtobybdq5h" true "SporkBot" false false
|
||||
820078733 2018-01-12 23:28:39 56237369 "User:Editingaccount1994/sandbox" 2 false 12406635 "Replace template per [[Wikipedia:Templates for discussion/Log/2011 February 17|TFD outcome]]; no change in content" 27782 "531dizmmloyxffbkdr5vph7owh921eg" true "SporkBot" false false
|
||||
820177382 2018-01-13 13:45:33 56237369 "User:Editingaccount1994/sandbox" 2 false 13791031 "translate TestCaseD if you are from tor you need neutral point of view " 27757 "nik9p2u2fuk4yazjxt8ymbicxv5qid9" false "Frietjes" false false "TestCaseD"
|
||||
822038928 2018-01-24 01:35:22 56237369 "User:Editingaccount1994/sandbox" 2 false 2304267 "Removing [[:c:File:Li_Chevalier_Art_Studio.jpg|Li_Chevalier_Art_Studio.jpg]], it has been deleted from Commons by [[:c:User:JuTa|JuTa]] because: [[:c:COM:OTRS|No permission]] since 16 January 2018." 27667 "gwk6pampl8si1v5pv3kwgteg710sfw3" false "CommonsDelinker" false false
|
||||
819091874 2018-01-07 10:42:20 56237370 "Anita del Rey" 0 "Ana del Rey" false 1368779 "r from alt name" 25 "n4ozbsgle13p9yywtfrz982ccj8woc9" false "PamD" false false
|
||||
819091883 2018-01-07 10:42:27 56237371 "User talk:119.94.96.157" 3 false 13286072 "Warning [[Special:Contributions/119.94.96.157|119.94.96.157]] - #1" 1274 "ksohnvsbeuzwpl5vb8a3v8m18hva0a7" false "ClueBot NG" false false
|
||||
819091914 2018-01-07 10:42:50 56237372 "Category:Ohmi Railway" 14 false 677153 "[[WP:AES|←]]Created page with ' [[Category:Railway companies of Japan]] [[Category:Rail transport in Shiga Prefecture]] [[Category:Seibu Group]]'" 113 "je7aw21fedbwyqsyofpisdrynsu7olr" false "Underbar dk" false false
|
||||
819091968 2018-01-07 10:43:32 56237375 "User talk:92.226.219.222" 3 false 882433 "[[WP:AES|←]]Created page with '{{3rr}}~~~~'" 199 "cpm4tkzcx4hc6irr9ukbi06ogud8dtq" false "TastyPoutine" false false
|
||||
819094036 2018-01-07 11:10:24 56237375 "User talk:92.226.219.222" 3 false 7611264 "[[User:AnomieBOT/docs/TemplateSubster|Substing templates]]: {{3rr}}. See [[User:AnomieBOT/docs/TemplateSubster]] for info." 1840 "artmfz8b2gxhb3pp8a5p4ksplxqfkpg" true "AnomieBOT" false false
|
||||
819112363 2018-01-07 14:33:36 56237375 "User talk:92.226.219.222" 3 false 702940 "Your IP address has been blocked from editing because it has been used to [[WP:EVADE|evade a previous block]]. ([[WP:TW|TW]])" 2949 "dn9wj0n8d8pdd5lqe56uw5xamupowr1" false "Only" false false
|
||||
819092004 2018-01-07 10:44:01 56237376 "User:Dipayanacharya" 2 false 32794237 "Education" 28 "ofueugwatmmn7u73isw732neuza57gk" false "Dipayanacharya" false false
|
||||
819092390 2018-01-07 10:49:08 56237376 "User:Dipayanacharya" 2 false 32794237 "School" 38 "dsz55xv96ec2uv6w9c1z7c52ipfovbw" false "Dipayanacharya" false false
|
||||
819092066 2018-01-07 10:44:56 56237378 "BSCIC" 0 "Bangladesh Small and Cottage Industries Corporation" false 21516552 "[[WP:AES|←]]Redirected page to [[Bangladesh Small and Cottage Industries Corporation]]" 65 "9ma38hak0ef1ew4fpiutxpnzd8oz1wd" false "Vinegarymass911" false false
|
||||
819092102 2018-01-07 10:45:21 56237379 "Category:Women government ministers of Yemen" 14 false 754619 "[[WP:AES|←]]Created page with '{{portal|Yemen|Politics}} {{Non-diffusing subcategory|Government ministers of Yemen}} {{Underpopulated category}} Category:Women government ministers by nati...'" 285 "4dvakoat58bzyf5hmtthxukt29hip6n" false "BrownHairedGirl" false false
|
||||
819092135 2018-01-07 10:45:54 56237381 "Talk:List of Morning Glories Characters" 1 false 410898 "[[WP:AES|←]]Created page with '{{WikiProject Fictional characters|class=List|importance=low}} {{Comicsproj|class=List|importance=low}}'" 103 "2sjrxsc7os9k9pg4su2t4rk2j8nn0h7" false "PRehse" false false
|
||||
819092138 2018-01-07 10:45:56 56237382 "User talk:106.207.126.114" 3 false 13286072 "Warning [[Special:Contributions/106.207.126.114|106.207.126.114]] - #1" 1330 "3y9t5wpk6ur5jhone75rhm4wjf01fgi" false "ClueBot NG" false false
|
||||
819092495 2018-01-07 10:50:22 56237382 "User talk:106.207.126.114" 3 false 31190506 "Caution: Unconstructive editing on [[List of Baahubali characters]]. ([[WP:TW|TW]])" 2355 "8wvn6vh3isyt0dorpe89lztrburgupe" false "HindWIKI" false false
|
||||
"revid" "date_time" "articleid" "title" "namespace" "revision_is_redirect" "revision_redirect_target" "deleted" "editorid" "edit_summary" "text_chars" "reverteds" "sha1" "minor" "editor" "anon" "revert" "npov_npov" "npov_neutral" "testcase_a" "testcase_b" "testcase_c" "testcase_d"
|
||||
819091731 2018-01-07 10:40:58 56237363 "User talk:86.139.142.254" 3 false false 3742946 "Your IP address has been blocked from editing because it has been used to [[WP:EVADE|evade a previous block]]. ([[WP:TW|TW]])" 1141 "135nz8q6lfam6cojla7azb7k5alx3t3" false "NinjaRobotPirate" false false
|
||||
819091755 2018-01-07 10:41:10 56237364 "User talk:Kavin kavitha" 3 false false 32792125 "[[WP:AES|←]]Created page with ''''''Kavin (Tamil. கவின்) is a masculine given name, which is Tamil for ""beauty"", ""grace"", ""fairness"" or ""comeliness""Kavin is born on 01 /12/2001 at Sa...'" 663 "0pwezjc6yopz0smc8al6ogc4fax5bwo" false "Kavin kavitha" false false
|
||||
819091788 2018-01-07 10:41:26 56237365 "User talk:Dr.vivek163" 3 false false 32621254 "/* Regarding Merger discussion */ new section" 399 "sz3t2ap7z8bpkdvdvi195f3i35949bv" false "Amicable always" false false "NPOV, NPOV"
|
||||
819091796 2018-01-07 10:41:31 56237366 "User talk:Twistorl" 3 false false 13286072 "Warning [[Special:Contributions/Twistorl|Twistorl]] - #1" 1260 "r6s5j8j3iykenrhuhpnkpsmmd71vubf" false "ClueBot NG" false false
|
||||
819091825 2018-01-07 10:41:51 56237368 "Kom Firin" 0 false false 8409334 "[[WP:AES|←]]Created page with '[[File:Stele 67.119 Brooklyn.jpg|thumb|Stele of the [[Libu#Great Chiefs of the Libu|Chief of the Libu]] Titaru, a contemporary of pharaoh [[Shoshenq V]] of the [...'TestCaseB and you're a Tor node " 2249 "tf5qz2yaswx61zrlm9ovxzuhl7r2dc4" false "Khruner" false false "NPOV" "TestCaseB"
|
||||
822610647 2018-01-27 12:16:02 56237368 "Kom Firin" 0 false false 8409334 "/* History */ typo" 2230 "e6oa4g0qv64icdaq26uu1zzbyr5hcbh" true "Khruner" false false
|
||||
819091844 2018-01-07 10:42:05 56237369 "User:Editingaccount1994/sandbox" 2 false false 32794215 "[[WP:AES|←]]Created page with '{{User sandbox}} <!-- EDIT BELOW THIS LINE --> {{voir homonymes|Chevalier}} {{Infobox Artiste | nom = Li Chevalier | autres noms = | im...'" 27840 "0fyvyh2a8xu41gt8obr34oba0bfixj6" false "Editingaccount1994" false false
|
||||
819093984 2018-01-07 11:09:52 56237369 "User:Editingaccount1994/sandbox" 2 false false 7611264 "[[User:AnomieBOT/docs/TemplateSubster|Substing templates]]: {{Lien web}}. See [[User:AnomieBOT/docs/TemplateSubster]] for info." 27787 "8gy52aolt5rg3eaketwj5v7eiw0apv2" true "AnomieBOT" false false
|
||||
820064189 2018-01-12 21:45:50 56237369 "User:Editingaccount1994/sandbox" 2 false false 12406635 "Orphan per [[WP:TFD|TFD outcome]]" 27784 "he8ydemaanxlrpftqxkez8jfpge1fsj" true "SporkBot" false false
|
||||
820078679 2018-01-12 23:28:11 56237369 "User:Editingaccount1994/sandbox" 2 false false 12406635 "Replace template per [[Wikipedia:Templates for discussion/Log/2010 June 13|TFD outcome]]; no change in content" 27783 "0to17w9rth3url8n7gvucdtobybdq5h" true "SporkBot" false false
|
||||
820078733 2018-01-12 23:28:39 56237369 "User:Editingaccount1994/sandbox" 2 false false 12406635 "Replace template per [[Wikipedia:Templates for discussion/Log/2011 February 17|TFD outcome]]; no change in content" 27782 "531dizmmloyxffbkdr5vph7owh921eg" true "SporkBot" false false
|
||||
820177382 2018-01-13 13:45:33 56237369 "User:Editingaccount1994/sandbox" 2 false false 13791031 "translate TestCaseD if you are from tor you need neutral point of view " 27757 "nik9p2u2fuk4yazjxt8ymbicxv5qid9" false "Frietjes" false false "TestCaseD"
|
||||
822038928 2018-01-24 01:35:22 56237369 "User:Editingaccount1994/sandbox" 2 false false 2304267 "Removing [[:c:File:Li_Chevalier_Art_Studio.jpg|Li_Chevalier_Art_Studio.jpg]], it has been deleted from Commons by [[:c:User:JuTa|JuTa]] because: [[:c:COM:OTRS|No permission]] since 16 January 2018." 27667 "gwk6pampl8si1v5pv3kwgteg710sfw3" false "CommonsDelinker" false false
|
||||
819091874 2018-01-07 10:42:20 56237370 "Anita del Rey" 0 true "Ana del Rey" false 1368779 "r from alt name" 25 "n4ozbsgle13p9yywtfrz982ccj8woc9" false "PamD" false false
|
||||
819091883 2018-01-07 10:42:27 56237371 "User talk:119.94.96.157" 3 false false 13286072 "Warning [[Special:Contributions/119.94.96.157|119.94.96.157]] - #1" 1274 "ksohnvsbeuzwpl5vb8a3v8m18hva0a7" false "ClueBot NG" false false
|
||||
819091914 2018-01-07 10:42:50 56237372 "Category:Ohmi Railway" 14 false false 677153 "[[WP:AES|←]]Created page with ' [[Category:Railway companies of Japan]] [[Category:Rail transport in Shiga Prefecture]] [[Category:Seibu Group]]'" 113 "je7aw21fedbwyqsyofpisdrynsu7olr" false "Underbar dk" false false
|
||||
819091968 2018-01-07 10:43:32 56237375 "User talk:92.226.219.222" 3 false false 882433 "[[WP:AES|←]]Created page with '{{3rr}}~~~~'" 199 "cpm4tkzcx4hc6irr9ukbi06ogud8dtq" false "TastyPoutine" false false
|
||||
819094036 2018-01-07 11:10:24 56237375 "User talk:92.226.219.222" 3 false false 7611264 "[[User:AnomieBOT/docs/TemplateSubster|Substing templates]]: {{3rr}}. See [[User:AnomieBOT/docs/TemplateSubster]] for info." 1840 "artmfz8b2gxhb3pp8a5p4ksplxqfkpg" true "AnomieBOT" false false
|
||||
819112363 2018-01-07 14:33:36 56237375 "User talk:92.226.219.222" 3 false false 702940 "Your IP address has been blocked from editing because it has been used to [[WP:EVADE|evade a previous block]]. ([[WP:TW|TW]])" 2949 "dn9wj0n8d8pdd5lqe56uw5xamupowr1" false "Only" false false
|
||||
819092004 2018-01-07 10:44:01 56237376 "User:Dipayanacharya" 2 false false 32794237 "Education" 28 "ofueugwatmmn7u73isw732neuza57gk" false "Dipayanacharya" false false
|
||||
819092390 2018-01-07 10:49:08 56237376 "User:Dipayanacharya" 2 false false 32794237 "School" 38 "dsz55xv96ec2uv6w9c1z7c52ipfovbw" false "Dipayanacharya" false false
|
||||
819092066 2018-01-07 10:44:56 56237378 "BSCIC" 0 true "Bangladesh Small and Cottage Industries Corporation" false 21516552 "[[WP:AES|←]]Redirected page to [[Bangladesh Small and Cottage Industries Corporation]]" 65 "9ma38hak0ef1ew4fpiutxpnzd8oz1wd" false "Vinegarymass911" false false
|
||||
819092102 2018-01-07 10:45:21 56237379 "Category:Women government ministers of Yemen" 14 false false 754619 "[[WP:AES|←]]Created page with '{{portal|Yemen|Politics}} {{Non-diffusing subcategory|Government ministers of Yemen}} {{Underpopulated category}} Category:Women government ministers by nati...'" 285 "4dvakoat58bzyf5hmtthxukt29hip6n" false "BrownHairedGirl" false false
|
||||
819092135 2018-01-07 10:45:54 56237381 "Talk:List of Morning Glories Characters" 1 false false 410898 "[[WP:AES|←]]Created page with '{{WikiProject Fictional characters|class=List|importance=low}} {{Comicsproj|class=List|importance=low}}'" 103 "2sjrxsc7os9k9pg4su2t4rk2j8nn0h7" false "PRehse" false false
|
||||
819092138 2018-01-07 10:45:56 56237382 "User talk:106.207.126.114" 3 false false 13286072 "Warning [[Special:Contributions/106.207.126.114|106.207.126.114]] - #1" 1330 "3y9t5wpk6ur5jhone75rhm4wjf01fgi" false "ClueBot NG" false false
|
||||
819092495 2018-01-07 10:50:22 56237382 "User talk:106.207.126.114" 3 false false 31190506 "Caution: Unconstructive editing on [[List of Baahubali characters]]. ([[WP:TW|TW]])" 2355 "8wvn6vh3isyt0dorpe89lztrburgupe" false "HindWIKI" false false
|
||||
|
||||
|
Reference in New Issue
Block a user