wikiq/test/baseline_output/capturegroup_regextest_1.tsv at c49fa5af3ce21659ad27c17023ffb7fe5f6dbef9

Files

Benjamin Mako Hill 40132f04dd make redirect detection revision-level

The redirect_target column added in 59fea19 was page-level: the page's
state at dump time, stamped onto every revision row of the page. That
invited the wrong inference that a given revision was a redirect, and
the column was empty for dumps whose export never wrote <redirect>
elements, such as the 2023 wikitravel.org scrapes; a Swedish Wikitravel
scrape with 732 in-text redirect revisions produced no redirect signal
at all.

Remove that column and detect redirects from each revision's own text
instead. revision_is_redirect records whether the text begins with a
redirect directive and revision_redirect_target records the directive's
link target with any fragment and label stripped. #REDIRECT is
recognized on every wiki; localized keywords (e.g. OMDIRIGERING on
Swedish wikis) can be added with --redirect-aliases. Revisions with
deleted or unavailable text get nulls in both columns. The redirect-map
use case behind 59fea19 survives: the last revision's
revision_redirect_target per page reconstructs the page-level map, now
also on dumps without <redirect> elements.

Document that title and namespace are page-level identity values as of
the time of export, not historical facts about each revision.

Regenerate the test baselines for the column change. Every regenerated
file was verified to differ from its predecessor only by removing
redirect_target and adding the two new columns, with identical values
in all shared columns.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>

2026-08-06 23:41:57 -07:00

7.3 KiB

Raw Blame History

1	revid	date_time	articleid	title	namespace	revision_is_redirect	revision_redirect_target	deleted	editorid	edit_summary	text_chars	sha1	minor	editor	anon	revert	npov_npov	testcase_b	testcase_d
2	819091731	2018-01-07 10:40:58	56237363	User talk:86.139.142.254	3	false		false	3742946	Your IP address has been blocked from editing because it has been used to [[WP:EVADE\|evade a previous block]]. ([[WP:TW\|TW]])	1141	135nz8q6lfam6cojla7azb7k5alx3t3	false	NinjaRobotPirate	false	false
3	819091755	2018-01-07 10:41:10	56237364	User talk:Kavin kavitha	3	false		false	32792125	[[WP:AES\|←]]Created page with ''''''Kavin (Tamil. கவின்) is a masculine given name, which is Tamil for "beauty", "grace", "fairness" or "comeliness"Kavin is born on 01 /12/2001 at Sa...'	663	0pwezjc6yopz0smc8al6ogc4fax5bwo	false	Kavin kavitha	false	false
4	819091788	2018-01-07 10:41:26	56237365	User talk:Dr.vivek163	3	false		false	32621254	/* Regarding Merger discussion */ new section	399	sz3t2ap7z8bpkdvdvi195f3i35949bv	false	Amicable always	false	false	NPOV, NPOV
5	819091796	2018-01-07 10:41:31	56237366	User talk:Twistorl	3	false		false	13286072	Warning [[Special:Contributions/Twistorl\|Twistorl]] - #1	1260	r6s5j8j3iykenrhuhpnkpsmmd71vubf	false	ClueBot NG	false	false
6	819091825	2018-01-07 10:41:51	56237368	Kom Firin	0	false		false	8409334	[[WP:AES\|←]]Created page with '[[File:Stele 67.119 Brooklyn.jpg\|thumb\|Stele of the [[Libu#Great Chiefs of the Libu\|Chief of the Libu]] Titaru, a contemporary of pharaoh [[Shoshenq V]] of the [...'TestCaseB and you're a Tor node	2249	tf5qz2yaswx61zrlm9ovxzuhl7r2dc4	false	Khruner	false	false	NPOV	TestCaseB
7	822610647	2018-01-27 12:16:02	56237368	Kom Firin	0	false		false	8409334	/* History */ typo	2230	e6oa4g0qv64icdaq26uu1zzbyr5hcbh	true	Khruner	false	false
8	819091844	2018-01-07 10:42:05	56237369	User:Editingaccount1994/sandbox	2	false		false	32794215	[[WP:AES\|←]]Created page with '{{User sandbox}} <!-- EDIT BELOW THIS LINE --> {{voir homonymes\|Chevalier}} {{Infobox Artiste \| nom = Li Chevalier \| autres noms = \| im...'	27840	0fyvyh2a8xu41gt8obr34oba0bfixj6	false	Editingaccount1994	false	false
9	819093984	2018-01-07 11:09:52	56237369	User:Editingaccount1994/sandbox	2	false		false	7611264	[[User:AnomieBOT/docs/TemplateSubster\|Substing templates]]: {{Lien web}}. See [[User:AnomieBOT/docs/TemplateSubster]] for info.	27787	8gy52aolt5rg3eaketwj5v7eiw0apv2	true	AnomieBOT	false	false
10	820064189	2018-01-12 21:45:50	56237369	User:Editingaccount1994/sandbox	2	false		false	12406635	Orphan per [[WP:TFD\|TFD outcome]]	27784	he8ydemaanxlrpftqxkez8jfpge1fsj	true	SporkBot	false	false
11	820078679	2018-01-12 23:28:11	56237369	User:Editingaccount1994/sandbox	2	false		false	12406635	Replace template per [[Wikipedia:Templates for discussion/Log/2010 June 13\|TFD outcome]]; no change in content	27783	0to17w9rth3url8n7gvucdtobybdq5h	true	SporkBot	false	false
12	820078733	2018-01-12 23:28:39	56237369	User:Editingaccount1994/sandbox	2	false		false	12406635	Replace template per [[Wikipedia:Templates for discussion/Log/2011 February 17\|TFD outcome]]; no change in content	27782	531dizmmloyxffbkdr5vph7owh921eg	true	SporkBot	false	false
13	820177382	2018-01-13 13:45:33	56237369	User:Editingaccount1994/sandbox	2	false		false	13791031	translate TestCaseD if you are from tor you need neutral point of view	27757	nik9p2u2fuk4yazjxt8ymbicxv5qid9	false	Frietjes	false	false			TestCaseD
14	822038928	2018-01-24 01:35:22	56237369	User:Editingaccount1994/sandbox	2	false		false	2304267	Removing [[:c:File:Li_Chevalier_Art_Studio.jpg\|Li_Chevalier_Art_Studio.jpg]], it has been deleted from Commons by [[:c:User:JuTa\|JuTa]] because: [[:c:COM:OTRS\|No permission]] since 16 January 2018.	27667	gwk6pampl8si1v5pv3kwgteg710sfw3	false	CommonsDelinker	false	false
15	819091874	2018-01-07 10:42:20	56237370	Anita del Rey	0	true	Ana del Rey	false	1368779	r from alt name	25	n4ozbsgle13p9yywtfrz982ccj8woc9	false	PamD	false	false
16	819091883	2018-01-07 10:42:27	56237371	User talk:119.94.96.157	3	false		false	13286072	Warning [[Special:Contributions/119.94.96.157\|119.94.96.157]] - #1	1274	ksohnvsbeuzwpl5vb8a3v8m18hva0a7	false	ClueBot NG	false	false
17	819091914	2018-01-07 10:42:50	56237372	Category:Ohmi Railway	14	false		false	677153	[[WP:AES\|←]]Created page with ' [[Category:Railway companies of Japan]] [[Category:Rail transport in Shiga Prefecture]] [[Category:Seibu Group]]'	113	je7aw21fedbwyqsyofpisdrynsu7olr	false	Underbar dk	false	false
18	819091968	2018-01-07 10:43:32	56237375	User talk:92.226.219.222	3	false		false	882433	[[WP:AES\|←]]Created page with '{{3rr}}~~~~'	199	cpm4tkzcx4hc6irr9ukbi06ogud8dtq	false	TastyPoutine	false	false
19	819094036	2018-01-07 11:10:24	56237375	User talk:92.226.219.222	3	false		false	7611264	[[User:AnomieBOT/docs/TemplateSubster\|Substing templates]]: {{3rr}}. See [[User:AnomieBOT/docs/TemplateSubster]] for info.	1840	artmfz8b2gxhb3pp8a5p4ksplxqfkpg	true	AnomieBOT	false	false
20	819112363	2018-01-07 14:33:36	56237375	User talk:92.226.219.222	3	false		false	702940	Your IP address has been blocked from editing because it has been used to [[WP:EVADE\|evade a previous block]]. ([[WP:TW\|TW]])	2949	dn9wj0n8d8pdd5lqe56uw5xamupowr1	false	Only	false	false
21	819092004	2018-01-07 10:44:01	56237376	User:Dipayanacharya	2	false		false	32794237	Education	28	ofueugwatmmn7u73isw732neuza57gk	false	Dipayanacharya	false	false
22	819092390	2018-01-07 10:49:08	56237376	User:Dipayanacharya	2	false		false	32794237	School	38	dsz55xv96ec2uv6w9c1z7c52ipfovbw	false	Dipayanacharya	false	false
23	819092066	2018-01-07 10:44:56	56237378	BSCIC	0	true	Bangladesh Small and Cottage Industries Corporation	false	21516552	[[WP:AES\|←]]Redirected page to [[Bangladesh Small and Cottage Industries Corporation]]	65	9ma38hak0ef1ew4fpiutxpnzd8oz1wd	false	Vinegarymass911	false	false
24	819092102	2018-01-07 10:45:21	56237379	Category:Women government ministers of Yemen	14	false		false	754619	[[WP:AES\|←]]Created page with '{{portal\|Yemen\|Politics}} {{Non-diffusing subcategory\|Government ministers of Yemen}} {{Underpopulated category}} Category:Women government ministers by nati...'	285	4dvakoat58bzyf5hmtthxukt29hip6n	false	BrownHairedGirl	false	false
25	819092135	2018-01-07 10:45:54	56237381	Talk:List of Morning Glories Characters	1	false		false	410898	[[WP:AES\|←]]Created page with '{{WikiProject Fictional characters\|class=List\|importance=low}} {{Comicsproj\|class=List\|importance=low}}'	103	2sjrxsc7os9k9pg4su2t4rk2j8nn0h7	false	PRehse	false	false
26	819092138	2018-01-07 10:45:56	56237382	User talk:106.207.126.114	3	false		false	13286072	Warning [[Special:Contributions/106.207.126.114\|106.207.126.114]] - #1	1330	3y9t5wpk6ur5jhone75rhm4wjf01fgi	false	ClueBot NG	false	false
27	819092495	2018-01-07 10:50:22	56237382	User talk:106.207.126.114	3	false		false	31190506	Caution: Unconstructive editing on [[List of Baahubali characters]]. ([[WP:TW\|TW]])	2355	8wvn6vh3isyt0dorpe89lztrburgupe	false	HindWIKI	false	false

7.3 KiB Raw Blame History

7.3 KiB

Raw Blame History