⚓ T219123 Migrate to and read from new store for item terms

Subject	Repo	Branch	Lines +/-
Read from the new term store everywhere	operations/mediawiki-config	master	+2 -4
labs: Stop writing to the old term store for wikidatawiki	operations/mediawiki-config	master	+4 -2
Set up read new term store up to Q80M	operations/mediawiki-config	master	+2 -2
Set up read new term store up to Q70M	operations/mediawiki-config	master	+2 -2
Set up read new term store up to Q40M	operations/mediawiki-config	master	+2 -2
Set up read new term store up to Q60M	operations/mediawiki-config	master	+2 -2
Set up read new term store up to Q50M	operations/mediawiki-config	master	+2 -2
Set up read new term store up to Q35M	operations/mediawiki-config	master	+2 -2
Revert "Revert "Set term store to WRITE_BOTH for all of Wikidata""	operations/mediawiki-config	master	+1 -2
Set term store to WRITE_BOTH for all of Wikidata	operations/mediawiki-config	master	+1 -2
Write to the new terms store up to Q 87.5 million	operations/mediawiki-config	master	+1 -1
Write to the new terms store up to Q 87 million	operations/mediawiki-config	master	+1 -1
Read from the new term store up to Q30 mill everywhere	operations/mediawiki-config	master	+2 -2
Write to the new terms store up to Q 86 million	operations/mediawiki-config	master	+1 -1
Read from the new term store up to Q25 mill everywhere	operations/mediawiki-config	master	+2 -2
Read from the new term store up to Q20 mill everywhere	operations/mediawiki-config	master	+2 -2
Read from the new term store up to Q15 mill everywhere	operations/mediawiki-config	master	+2 -2
Read from the new term store up to Q12 mill everywhere	operations/mediawiki-config	master	+2 -2
Read from the new term store up to Q10 million for clients	operations/mediawiki-config	master	+1 -1
Read from the new term store up to Q8 million for clients	operations/mediawiki-config	master	+1 -1
Read from the new term store up to Q6 million for clients	operations/mediawiki-config	master	+1 -1
Read from the new term store up to Q4 million	operations/mediawiki-config	master	+1 -1
Read from the new term store, back to Q2 million	operations/mediawiki-config	master	+1 -1
Read from the new term store up to Q8 million	operations/mediawiki-config	master	+1 -1
Revert read from the new term store again to Q2M	operations/mediawiki-config	master	+1 -1
Increase the reads for term store for clients for up to Q6Mio	operations/mediawiki-config	master	+1 -1
Increase the reads for term store for clients for up to Q4Mio	operations/mediawiki-config	master	+1 -1
Increase the reads for term store for clients for up to Q1Mio	operations/mediawiki-config	master	+1 -1
Increase the reads for term store for clients for up to Q512K	operations/mediawiki-config	master	+1 -1
Increase the reads for term store for clients for up to Q6Mio	operations/mediawiki-config	master	+1 -1
Increase the reads for term store for clients for up to Q4Mio	operations/mediawiki-config	master	+1 -1
Increase the reads for term store for clients for up to Q2Mio	operations/mediawiki-config	master	+1 -1
Increase the reads for term store for clients for up to Q256K	operations/mediawiki-config	master	+1 -1
Increase the reads for term store for clients for up to Q120K	operations/mediawiki-config	master	+1 -1
Increase the reads for term store for clients for up to Q60K	operations/mediawiki-config	master	+1 -1
Increase the reads for term store for clients for up to Q30K	operations/mediawiki-config	master	+1 -1
Read and write more in the new term store	operations/mediawiki-config	master	+2 -2
mediawiki: Drop the rebuildItemTerms cron	operations/puppet	production	+0 -11
Set read new for item term store up to Q100K	operations/mediawiki-config	master	+2 -2
mediawiki: Stop rebuildItemTermIndex job	operations/puppet	production	+1 -1

Status	Assigned	Task
Resolved	Addshore	T208425 [EPIC] Kill the wb_terms table
Resolved	ArielGlenn	T226167 audit public tables and make sure we dump them all
Resolved	Addshore	T219175 [Mega] - Migrate data from wb_terms to new schema
Resolved	Ladsgroup	T219123 Migrate to and read from new store for item terms
Invalid	None	T221715 Implement ItemTermStore in mediawiki dbal lib
Duplicate	Ladsgroup	T225055 Switch `tmpItemTermsMigrationStages` to MIGRATION_WRITE_BOTH
Resolved	Ladsgroup	T225056 Run Item Terms Rebuild script
Duplicate	Ladsgroup	T225057 Switch `tmpItemTermsMigrationStages` to MIGRATION_WRITE_NEW
Resolved	Ladsgroup	T234329 Investigate, fix and reimport failing item terms into new store
Resolved	Ladsgroup	T232393 Find out why rebuilding some items in new term store failed
Resolved	Ladsgroup	T234948 New Wikibase deadlocks on Wikidata wiki since 2019-10-08T00:00:02: Wikibase\Lib\Store\Sql\Terms\{closure} Deadlock found when trying to get lock; try restarting transaction
Resolved	Addshore	T235265 Slow query on SpecialMostLinked creating lag on wikidata slaves
Resolved	Addshore	T239470 Check the success of the initial terms migration (does it have holes)
Resolved	Addshore	T239471 Sqoop wikidata terms tables into hadoop
Resolved	Ladsgroup	T240235 Alter rebuildItemTerms.php to allow passing of a a list of int item ids to process
Resolved	Addshore	T245740 LUA getLabelWithLang calls result in many db queries to terms storage with spikey and unpredictable patterns
Resolved	Ladsgroup	T246005 Wikibase client description API module results in 15k selected rows with new term storage
Resolved	Ladsgroup	T246159 Setting on read new for items causes increased worst response time and number of open connections

Mentioned in SAL (#wikimedia-operations) [2020-03-04T13:47:31Z] <addshore> START warm cache for db1111 & db1126 for Q25-30 million T219123 (pass 3)

Addshore updated the task description. (Show Details)Mar 4 2020, 4:15 PM

Mentioned in SAL (#wikimedia-operations) [2020-03-04T17:41:01Z] <addshore> stop item term rebuild at Q Q60345318 as I generate more lists (T219123)

I'm generating some new lists to work from to reduce the amount of time the rest of the migration will take.

Identifying "holes" in the tables, where some records exist, but some in other tables have gone missing due to bugs:

addshore@stat1007:~$ analytics-mysql wikidatawiki -e "SELECT DISTINCT wbit_item_id as id FROM wbt_item_terms LEFT JOIN wbt_term_in_lang ON wbit_term_in_lang_id = wbtl_id LEFT JOIN wbt_type ON wbtl_type_id = wby_id LEFT JOIN wbt_text_in_lang ON wbtl_text_in_lang_id = wbxl_id LEFT JOIN wbt_text ON wbxl_text_id = wbx_id WHERE wbx_text IS NULL ORDER BY wbit_item_id ASC;" -N -B > 4march1740-holes-nulls.list

Another one identifying all items that have no records yet (have not been migrated):

addshore@stat1007:~$ cat 4march1740-holes-86000000.sql
SELECT n
FROM
(
SELECT (a.digit + (10 * b.digit) + (100 * c.digit) + (1000 * d.digit) + (10000 * e.digit) + (100000 * f.digit) + (1000000 * g.digit) + (10000000 * h.digit)) as n
    from (select 0 as digit union all select 1 union all select 2 union all select 3 union all select 4 union all select 5 union all select 6 union all select 7 union all select 8 union all select 9) as a
    cross join (select 0 as digit union all select 1 union all select 2 union all select 3 union all select 4 union all select 5 union all select 6 union all select 7 union all select 8 union all select 9) as b
    cross join (select 0 as digit union all select 1 union all select 2 union all select 3 union all select 4 union all select 5 union all select 6 union all select 7 union all select 8 union all select 9) as c
    cross join (select 0 as digit union all select 1 union all select 2 union all select 3 union all select 4 union all select 5 union all select 6 union all select 7 union all select 8 union all select 9) as d
    cross join (select 0 as digit union all select 1 union all select 2 union all select 3 union all select 4 union all select 5 union all select 6 union all select 7 union all select 8 union all select 9) as e
    cross join (select 0 as digit union all select 1 union all select 2 union all select 3 union all select 4 union all select 5 union all select 6 union all select 7 union all select 8 union all select 9) as f
    cross join (select 0 as digit union all select 1 union all select 2 union all select 3 union all select 4 union all select 5 union all select 6 union all select 7 union all select 8 union all select 9) as g
    cross join (select 0 as digit union all select 1 union all select 2 union all select 3 union all select 4 union all select 5 union all select 6 union all select 7 union all select 8 union all select 9) as h
) as a
LEFT JOIN
( SELECT DISTINCT wbit_item_id from wbt_item_terms where wbit_item_id BETWEEN 0 AND 86000000 ) as b
ON wbit_item_id = n
WHERE wbit_item_id IS NULL
AND n BETWEEN 0 AND 86000000
;

After these lists have been migrated we will also have to deal with items above 86 million.

When running these queries earlier I identified roughly 26 million more items to pass over

addshore@stat1007:~$ wc -l 4march1143-holes-*.list
 19237277 4march1143-holes-87061632.list
  6753614 4march1143-holes-nulls.list
 25990891 total
addshore@stat1007:~$ sort 4march1143-holes-*.list | uniq | wc -l
25990891

Mentioned in SAL (#wikimedia-operations) [2020-03-05T08:50:28Z] <addshore> START warm cache for db1111 & db1126 for Q25-30 million T219123 (pass 1 today)

Mentioned in SAL (#wikimedia-operations) [2020-03-05T10:11:06Z] <addshore> START warm cache for db1111 & db1126 for Q25-30 million T219123 (pass 2 today)

Change 577209 had a related patch set uploaded (by Addshore; owner: Addshore):
[operations/mediawiki-config@master] Read from the new term store up to Q30 mill everywhere

https://gerrit.wikimedia.org/r/577209

Change 577211 had a related patch set uploaded (by Addshore; owner: Addshore):
[operations/mediawiki-config@master] Write to the new terms store up to Q 87 million

https://gerrit.wikimedia.org/r/577211

Archive of the old description as I am now rebuilding ONLY using SQL generated lists.

Hadoop based Rebuild number 3

31 January, Q 1.8 million

4 February Q 9 million

7 February Q 14.5 million

17 February Q 37.5 million

23 February Q 44.5 million

27 February Q 50 million

2 March Q54 million

4 March Q60 million

Post Hadoop, SQL based rebuild number 3:

Fill in gaps missed due to only rebuilding from a select ID list from hadoop

0-1 million - Addshore did on 18th Feb, (4 deleted item holes left) - https://phabricator.wikimedia.org/P10447 - and some other holes re appearing T219123#5896364

0-10 million - Addshore did on 20th Feb (8122 item holes left) - https://phabricator.wikimedia.org/P10469

10-20 million - Addshore did on 25th Feb (1292 item holes left) - https://phabricator.wikimedia.org/P10517

20-30 million - Addshore did on 26th Feb (442k holes) TBA how many are left?

30-40 million - Addshore did between 3rd & 4th March

40-50 million - Addshore did between 3rd & 4th March

50-end ??????

Rough prediction of when we could finish the bulk of the migration:

Change 577209 merged by jenkins-bot:
[operations/mediawiki-config@master] Read from the new term store up to Q30 mill everywhere

https://gerrit.wikimedia.org/r/577209

Mentioned in SAL (#wikimedia-operations) [2020-03-05T11:04:55Z] <addshore@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Reading up to Q30M for the new term store everywhere (was Q25M) + warm db1126 & db1111 caches (T219123) (duration: 01m 05s)

Mentioned in SAL (#wikimedia-operations) [2020-03-05T11:06:08Z] <addshore@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Reading up to Q30M for the new term store everywhere (was Q25M) + warm db1126 & db1111 caches (T219123) cache bust (duration: 01m 04s)

Addshore updated the task description. (Show Details)Mar 5 2020, 11:14 AM

Change 577211 merged by jenkins-bot:
[operations/mediawiki-config@master] Write to the new terms store up to Q 87 million

https://gerrit.wikimedia.org/r/577211

Mentioned in SAL (#wikimedia-operations) [2020-03-05T11:19:26Z] <addshore@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Write to new term store up to Q87 million, was 86 (T219123) (duration: 01m 04s)

Mentioned in SAL (#wikimedia-operations) [2020-03-05T11:20:34Z] <addshore@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Write to new term store up to Q87 million, was 86 (T219123) cache bust (duration: 01m 03s)

Addshore updated the task description. (Show Details)Mar 5 2020, 11:28 AM

Addshore updated the task description. (Show Details)

Addshore updated the task description. (Show Details)Mar 5 2020, 12:08 PM

Maintenance_bot removed a project: Patch-For-Review.Mar 5 2020, 12:11 PM

Mentioned in SAL (#wikimedia-operations) [2020-03-05T12:52:42Z] <addshore> START warm cache for db1111 & db1126 for Q30-32 million (100k batch selects, 30s sleep) T219123 (pass 1)

Just added the "rebuild" of 86-87 million to the lists that are currently running.

addshore@mwmaint1002:~/sqlterms$ cat ./6/*part* | wc -l
950622

Looks like this rebuild pass should finish mid week

Change 579213 had a related patch set uploaded (by Addshore; owner: Addshore):
[operations/mediawiki-config@master] Write to the new terms store up to Q 87.5 million

https://gerrit.wikimedia.org/r/579213

gerritbot added a project: Patch-For-Review.Mar 12 2020, 8:18 AM

Change 579213 merged by jenkins-bot:
[operations/mediawiki-config@master] Write to the new terms store up to Q 87.5 million

https://gerrit.wikimedia.org/r/579213

Mentioned in SAL (#wikimedia-operations) [2020-03-12T08:26:33Z] <addshore@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Write to new term store up to Q87.5 million, was 87 (T219123) (duration: 01m 12s)

Mentioned in SAL (#wikimedia-operations) [2020-03-12T08:27:45Z] <addshore@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Write to new term store up to Q87.5 million, was 87 (T219123) cache bust (duration: 01m 08s)

Mentioned in SAL (#wikimedia-operations) [2020-03-12T08:36:02Z] <addshore> start "rebuild" of Q87 -> 87.5 million for T219123

Maintenance_bot removed a project: Patch-For-Review.Mar 12 2020, 9:10 AM

Change 579326 had a related patch set uploaded (by Ladsgroup; owner: Ladsgroup):
[operations/mediawiki-config@master] Set term store to WRITE_BOTH for all of Wikidata

https://gerrit.wikimedia.org/r/579326

gerritbot added a project: Patch-For-Review.Mar 12 2020, 4:52 PM

Change 579326 merged by jenkins-bot:
[operations/mediawiki-config@master] Set term store to WRITE_BOTH for all of Wikidata

https://gerrit.wikimedia.org/r/579326

Mentioned in SAL (#wikimedia-operations) [2020-03-12T18:29:43Z] <tgr@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:579326|Set term store to WRITE_BOTH for all of Wikidata (T219123)]] (duration: 01m 07s)

Mentioned in SAL (#wikimedia-operations) [2020-03-16T10:02:20Z] <Amir1> start of ladsgroup@mwmaint1002:~$ mwscript extensions/Wikibase/repo/maintenance/rebuildItemTerms.php --wiki=wikidatawiki --batch-size=50 --sleep=0 --file=15march2217-holes-nulls.list on screen (T219123)

Change 579908 had a related patch set uploaded (by Ladsgroup; owner: Ladsgroup):
[operations/mediawiki-config@master] Revert "Revert "Set term store to WRITE_BOTH for all of Wikidata""

https://gerrit.wikimedia.org/r/579908

Change 579908 merged by jenkins-bot:
[operations/mediawiki-config@master] Revert "Revert "Set term store to WRITE_BOTH for all of Wikidata""

https://gerrit.wikimedia.org/r/579908

Mentioned in SAL (#wikimedia-operations) [2020-03-16T10:43:26Z] <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: "Set term store to WRITE_BOTH for all of Wikidata" (T219123) (duration: 01m 13s)

Mentioned in SAL (#wikimedia-operations) [2020-03-16T10:45:09Z] <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: "Set term store to WRITE_BOTH for all of Wikidata" (T219123), take II (duration: 01m 07s)

Mentioned in SAL (#wikimedia-operations) [2020-03-16T10:55:44Z] <Amir1> warming up db1026 for up to Q35M for the new term store (T219123)

Mentioned in SAL (#wikimedia-operations) [2020-03-16T11:04:04Z] <Amir1> Warming up InnoDB buffer pool cache in db1111, db1126, db1104, db1092 (T219123)

Change 579913 had a related patch set uploaded (by Ladsgroup; owner: Ladsgroup):
[operations/mediawiki-config@master] Set up read new term store up to Q35M

https://gerrit.wikimedia.org/r/579913

Change 579913 merged by jenkins-bot:
[operations/mediawiki-config@master] Set up read new term store up to Q35M

https://gerrit.wikimedia.org/r/579913

Mentioned in SAL (#wikimedia-operations) [2020-03-16T12:05:32Z] <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: [[gerrit:579913|Set up read new term store up to Q35M (T219123)]] (duration: 01m 08s)

Mentioned in SAL (#wikimedia-operations) [2020-03-16T12:09:39Z] <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: [[gerrit:579913|Set up read new term store up to Q35M (T219123)]], take II (duration: 01m 07s)

Mentioned in SAL (#wikimedia-operations) [2020-03-16T12:09:53Z] <Amir1> warming up cache for Q35M to Q40M for new term store on db1111, db1126, db1104, db1092 (T219123)

Maintenance_bot removed a project: Patch-For-Review.Mar 16 2020, 12:10 PM

Change 579925 had a related patch set uploaded (by Ladsgroup; owner: Ladsgroup):
[operations/mediawiki-config@master] Set up read new term store up to Q40M

https://gerrit.wikimedia.org/r/579925

gerritbot added a project: Patch-For-Review.Mar 16 2020, 1:26 PM

Change 579925 merged by jenkins-bot:
[operations/mediawiki-config@master] Set up read new term store up to Q40M

https://gerrit.wikimedia.org/r/579925

Mentioned in SAL (#wikimedia-operations) [2020-03-16T14:15:02Z] <Amir1> ladsgroup@mwmaint1002:~$ mwscript extensions/Wikibase/repo/maintenance/rebuildItemTerms.php --wiki=wikidatawiki --from-id 87500000 --to-id 87767570 --batch-size=10 --sleep=5 (T219123)

Mentioned in SAL (#wikimedia-operations) [2020-03-16T14:18:54Z] <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: [[gerrit:579925|Set up read new term store up to Q40M (T219123)]] (duration: 01m 07s)

Mentioned in SAL (#wikimedia-operations) [2020-03-16T14:22:13Z] <Amir1> warming up cache for Q40M to Q50M for new term store on db1111, db1126, db1104, db1092 (T219123)

Mentioned in SAL (#wikimedia-operations) [2020-03-16T14:22:19Z] <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: [[gerrit:579925|Set up read new term store up to Q40M (T219123)]], take II (duration: 01m 06s)

Maintenance_bot removed a project: Patch-For-Review.Mar 16 2020, 3:10 PM

Change 580082 had a related patch set uploaded (by Ladsgroup; owner: Ladsgroup):
[operations/mediawiki-config@master] Set up read new term store up to Q50M

https://gerrit.wikimedia.org/r/580082

gerritbot added a project: Patch-For-Review.Mar 16 2020, 4:58 PM

Change 580082 merged by jenkins-bot:
[operations/mediawiki-config@master] Set up read new term store up to Q50M

https://gerrit.wikimedia.org/r/580082

Mentioned in SAL (#wikimedia-operations) [2020-03-16T17:03:36Z] <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: [[gerrit:579925|Set up read new term store up to Q50M (T219123)]] (duration: 01m 06s)

Mentioned in SAL (#wikimedia-operations) [2020-03-16T17:06:56Z] <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: [[gerrit:579925|Set up read new term store up to Q50M (T219123)]], take II (duration: 01m 08s)

Mentioned in SAL (#wikimedia-operations) [2020-03-16T17:08:12Z] <Amir1> warming up cache for Q50M to Q60M for new term store on db1111, db1126, db1104, db1092 (T219123)

Change 580285 had a related patch set uploaded (by Ladsgroup; owner: Ladsgroup):
[operations/mediawiki-config@master] Set up read new term store up to Q60M

https://gerrit.wikimedia.org/r/580285

Change 580285 merged by jenkins-bot:
[operations/mediawiki-config@master] Set up read new term store up to Q60M

https://gerrit.wikimedia.org/r/580285

Mentioned in SAL (#wikimedia-operations) [2020-03-17T09:54:19Z] <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: [[gerrit:579925|Set up read new term store up to Q60M (T219123)]] (duration: 01m 09s)

Mentioned in SAL (#wikimedia-operations) [2020-03-17T09:55:53Z] <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: [[gerrit:579925|Set up read new term store up to Q60M (T219123)]], take II (duration: 01m 05s)

Mentioned in SAL (#wikimedia-operations) [2020-03-17T10:03:03Z] <Amir1> warming up cache for Q60M to Q70M for new term store on db1111, db1126, db1104, db1092 (T219123)

Maintenance_bot removed a project: Patch-For-Review.Mar 17 2020, 10:10 AM

I'm doing this.

Change 580331 had a related patch set uploaded (by Ladsgroup; owner: Ladsgroup):
[operations/mediawiki-config@master] Set up read new term store up to Q70M

https://gerrit.wikimedia.org/r/580331

gerritbot added a project: Patch-For-Review.Mar 17 2020, 2:07 PM

Change 580331 merged by jenkins-bot:
[operations/mediawiki-config@master] Set up read new term store up to Q70M

https://gerrit.wikimedia.org/r/580331

Mentioned in SAL (#wikimedia-operations) [2020-03-17T14:28:00Z] <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: [[gerrit:579925|Set up read new term store up to Q70M (T219123)]] (duration: 01m 10s)

Mentioned in SAL (#wikimedia-operations) [2020-03-17T14:29:39Z] <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: [[gerrit:579925|Set up read new term store up to Q70M (T219123)]], take II (duration: 01m 04s)

Maintenance_bot removed a project: Patch-For-Review.Mar 17 2020, 3:10 PM

Mentioned in SAL (#wikimedia-operations) [2020-03-17T17:52:07Z] <Amir1> warming up cache for Q70M to Q80M for new term store on db1111, db1126, db1104, db1092 (T219123)

Change 580397 had a related patch set uploaded (by Ladsgroup; owner: Ladsgroup):
[operations/mediawiki-config@master] Set up read new term store up to Q80M

https://gerrit.wikimedia.org/r/580397

gerritbot added a project: Patch-For-Review.Mar 17 2020, 5:58 PM

Change 580397 merged by jenkins-bot:
[operations/mediawiki-config@master] Set up read new term store up to Q80M

https://gerrit.wikimedia.org/r/580397

Mentioned in SAL (#wikimedia-operations) [2020-03-17T19:00:28Z] <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: [[gerrit:579925|Set up read new term store up to Q80M (T219123)]] (duration: 01m 07s)

Mentioned in SAL (#wikimedia-operations) [2020-03-17T19:01:40Z] <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: [[gerrit:579925|Set up read new term store up to Q80M (T219123)]], take II (duration: 01m 06s)

Maintenance_bot removed a project: Patch-For-Review.Mar 17 2020, 7:11 PM

Mentioned in SAL (#wikimedia-operations) [2020-03-17T22:49:25Z] <Amir1> warming up cache for Q80M to Q88M for new term store on db1111, db1126, db1104, db1092 (T219123)

Change 580416 had a related patch set uploaded (by Ladsgroup; owner: Ladsgroup):
[operations/mediawiki-config@master] Read from the new term store everywhere

https://gerrit.wikimedia.org/r/580416

gerritbot added a project: Patch-For-Review.Mar 18 2020, 12:54 AM

Change 580603 had a related patch set uploaded (by Ladsgroup; owner: Ladsgroup):
[operations/mediawiki-config@master] labs: Stop writing to the old term store for wikidatawiki

https://gerrit.wikimedia.org/r/580603

Change 580603 merged by jenkins-bot:
[operations/mediawiki-config@master] labs: Stop writing to the old term store for wikidatawiki

https://gerrit.wikimedia.org/r/580603

Mentioned in SAL (#wikimedia-releng) [2020-03-18T03:16:34Z] <Amir1> dropping wb_terms table from wikidatawiki in beta cluster (T219123 T219175 T208425)

Change 580416 merged by jenkins-bot:
[operations/mediawiki-config@master] Read from the new term store everywhere

https://gerrit.wikimedia.org/r/580416

Maintenance_bot removed a project: Patch-For-Review.Mar 18 2020, 10:11 AM

Mentioned in SAL (#wikimedia-operations) [2020-03-18T10:12:48Z] <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: [[gerrit:579925|Read from the new term store everywhere (T219123)]] (duration: 01m 08s)

Mentioned in SAL (#wikimedia-operations) [2020-03-18T10:14:44Z] <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: [[gerrit:579925|Read from the new term store everywhere (T219123)]], take II (duration: 01m 07s)

Mentioned in SAL (#wikimedia-operations) [2020-03-18T10:31:54Z] <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: [[gerrit:579925|Read from the new term store everywhere (T219123)]] (duration: 01m 07s)

Mentioned in SAL (#wikimedia-operations) [2020-03-18T10:33:11Z] <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: [[gerrit:579925|Read from the new term store everywhere (T219123)]], take II (duration: 01m 07s)

Ladsgroup moved this task from Doing to Test (Verification) on the Wikidata-Campsite (Wikidata-Campsite-Iteration-∞ (On Hold)) board.Mar 18 2020, 10:59 AM

Addshore closed this task as Resolved.Mar 23 2020, 9:18 AM

Migrate to and read from new store for item terms
Closed, ResolvedPublic
Actions

Description

Details

Related Objects
Search...

Event Timeline

	• alaa_wmde
	Mar 25 2019, 9:19 AM

	F31671113: image.png
	Mar 8 2020, 12:12 PM

	F31666491: image.png
	Mar 5 2020, 10:43 AM

	F31647231: image.png
	Feb 27 2020, 6:08 PM

Migrate to and read from new store for item termsClosed, ResolvedPublicActions

Description

Details

Related ObjectsSearch...

Event Timeline

Migrate to and read from new store for item terms
Closed, ResolvedPublic
Actions

Related Objects
Search...