Tech:Server admin log/2022

2022-01-06

 * 22:58 MirahezeLSBot: [universalomega@mw11] starting deploy of {'world': True} to all
 * 22:57 MirahezeLSBot: [universalomega@test3] starting deploy of {'world': True} to skip
 * 22:57 MirahezeLSBot: [universalomega@test3] starting deploy of {'world': True} to skip
 * 19:32 Universal Omega: ALTER TABLE searchindex ADD FULLTEXT si_text (si_text); on subcultureswiki
 * 19:32 Universal Omega: ALTER TABLE searchindex ADD FULLTEXT si_text (si_text); on subcultureswiki
 * 19:31 Universal Omega: ALTER TABLE searchindex ADD FULLTEXT si_title (si_title); on subcultureswiki
 * 19:21 Universal Omega: sudo -u www-data php /srv/mediawiki/w/maintenance/storage/checkStorage.php --fix /home/universalomega/wikibackups/templatewiki.xml --wiki=templatewiki
 * 19:21 Universal Omega: DELETE FROM revision WHERE rev_id='63249'; on templatewiki
 * 11:47 MirahezeLSBot: [reception@mwtask1] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=edhelwiki --username-prefix edhel --report 1 --no-updates /home/reception/edhelwiki.xml (END - exit=0)
 * 11:43 MirahezeLSBot: [reception@mwtask1] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=lgballtwiki (END - exit=0)
 * 11:43 MirahezeLSBot: [reception@mwtask1] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=lgballtwiki (START)
 * 11:41 MirahezeLSBot: [reception@mwtask1] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=edhelwiki --username-prefix edhel --report 1 --no-updates /home/reception/edhelwiki.xml (START)
 * 11:41 MirahezeLSBot: [reception@mwtask1] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=wikicryptoswiki (END - exit=0)
 * 11:38 MirahezeLSBot: [reception@mwtask1] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=lgballtwiki --username-prefix wikia:lgballt --report 1 --no-updates /home/reception/lgballt_pages_full.xml (END - exit=0)
 * 11:38 MirahezeLSBot: [reception@mwtask1] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=wikicryptoswiki (START)
 * 11:37 MirahezeLSBot: [reception@mwtask1] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=lgballtwiki --username-prefix wikia:lgballt --report 1 --no-updates /home/reception/lgballt_pages_full.xml (START)
 * 11:37 MirahezeLSBot: [reception@mwtask1] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=wikicryptoswiki --username-prefix w --report 1 --no-updates /home/reception/Wikipedia-cryptos.xml (END - exit=0)
 * 11:32 MirahezeLSBot: [reception@mwtask1] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=wikicryptoswiki --username-prefix w --report 1 --no-updates /home/reception/Wikipedia-cryptos.xml (START)
 * 11:16 MirahezeLSBot: [reception@mwtask1] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildtextindex.php --wiki=subcultureswiki --update (END - exit=256)
 * 11:16 MirahezeLSBot: [reception@mwtask1] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildtextindex.php --wiki=subcultureswiki --update (END - exit=256)
 * 02:42 MirahezeLSBot: [@mw11] starting deploy of {'config': True} to ovlon
 * 02:41 MirahezeLSBot: [@mw11] starting deploy of {'config': True} to ovlon
 * 02:24 MirahezeLSBot: [@test3] finished deploy of {'config': True} to skip - SUCCESS in 0s
 * 02:24 MirahezeLSBot: [@test3] starting deploy of {'config': True} to skip
 * 02:24 MirahezeLSBot: [@test3] starting deploy of {'config': True} to skip
 * 02:20 MirahezeLSBot: [paladox@test101] finished deploy of {'config': True} to skip - SUCCESS in 0s
 * 02:19 MirahezeLSBot: [paladox@test101] starting deploy of {'config': True} to skip
 * 02:19 MirahezeLSBot: [paladox@test101] starting deploy of {'config': True} to skip
 * 02:18 MirahezeLSBot: [paladox@mwtask111] finished deploy of {'config': True} to scsvg - SUCCESS in 6s
 * 02:18 MirahezeLSBot: [paladox@mwtask111] finished deploy of {'config': True} to scsvg - SUCCESS in 6s
 * 02:18 MirahezeLSBot: [paladox@mwtask111] starting deploy of {'config': True} to scsvg
 * 02:18 MirahezeLSBot: [@test101] finished deploy of {'config': True} to skip - SUCCESS in 0s
 * 02:17 MirahezeLSBot: [@test101] finished deploy of {'config': True} to skip - SUCCESS in 0s
 * 02:17 MirahezeLSBot: [@test101] starting deploy of {'config': True} to skip
 * 02:17 MirahezeLSBot: [@test101] starting deploy of {'config': True} to skip
 * 01:59 paladox: install libmemcached-tools on mem2
 * 01:59 paladox: install libmemcached-tools on mem2
 * 01:57 paladox: install libmemcached-tools on mem1
 * 00:55 MirahezeLSBot: [@test3] finished deploy of {'config': True} to skip - SUCCESS in 0s
 * 00:55 MirahezeLSBot: [@test3] starting deploy of {'config': True} to skip
 * 00:55 MirahezeLSBot: [@test3] finished deploy of {'config': True} to skip - SUCCESS in 0s
 * 00:55 MirahezeLSBot: [@test3] starting deploy of {'config': True} to skip
 * 00:52 MirahezeLSBot: [@mwtask111] finished deploy of {'config': True} to scsvg - SUCCESS in 6s
 * 00:52 MirahezeLSBot: [@mwtask111] starting deploy of {'config': True} to scsvg
 * 00:52 MirahezeLSBot: [@mwtask111] starting deploy of {'config': True} to scsvg
 * 00:48 MirahezeLSBot: [@test101] finished deploy of {'config': True} to skip - SUCCESS in 0s
 * 00:48 MirahezeLSBot: [@test101] starting deploy of {'config': True} to skip
 * 00:42 MirahezeLSBot: [@mw11] finished deploy of {'config': True} to ovlon - SUCCESS in 28s
 * 00:42 MirahezeLSBot: [@mw11] finished deploy of {'config': True} to ovlon - SUCCESS in 28s
 * 00:42 MirahezeLSBot: [@mw11] starting deploy of {'config': True} to ovlon
 * 00:25 MirahezeLSBot: [@test3] finished deploy of {'config': True} to skip - SUCCESS in 0s
 * 00:25 MirahezeLSBot: [@test3] finished deploy of {'config': True} to skip - SUCCESS in 0s
 * 00:25 MirahezeLSBot: [@test3] starting deploy of {'config': True} to skip

2022-01-05

 * 23:38 MirahezeLSBot: [@mw11] finished deploy of {'l10nupdate': True} to ovlon - SUCCESS in 2310s
 * 23:38 MirahezeLSBot: [@mw11] finished deploy of {'l10nupdate': True} to ovlon - SUCCESS in 2310s
 * 23:36 MirahezeLSBot: [@test3] finished deploy of {'l10nupdate': True} to skip - SUCCESS in 2189s
 * 23:36 MirahezeLSBot: [@test3] finished deploy of {'l10nupdate': True} to skip - SUCCESS in 2189s
 * 23:01 MirahezeLSBot: [@mwtask111] finished deploy of {'l10nupdate': True} to scsvg - SUCCESS in 75s
 * 23:00 MirahezeLSBot: [@test101] finished deploy of {'l10nupdate': True} to skip - SUCCESS in 40s
 * 23:00 MirahezeLSBot: [@test101] finished deploy of {'l10nupdate': True} to skip - SUCCESS in 40s
 * 23:00 MirahezeLSBot: [@test101] starting deploy of {'l10nupdate': True} to skip
 * 23:00 MirahezeLSBot: [@test101] starting deploy of {'l10nupdate': True} to skip
 * 23:00 MirahezeLSBot: [@mw11] starting deploy of {'l10nupdate': True} to ovlon
 * 23:00 MirahezeLSBot: [@mw11] starting deploy of {'l10nupdate': True} to ovlon
 * 23:00 MirahezeLSBot: [@mwtask111] starting deploy of {'l10nupdate': True} to scsvg
 * 23:00 MirahezeLSBot: [@mwtask111] starting deploy of {'l10nupdate': True} to scsvg
 * 23:00 MirahezeLSBot: [@test3] starting deploy of {'l10nupdate': True} to skip
 * 19:12 RhinosF1: deployed /home/rhinos/mf.patch to all servers
 * 19:12 RhinosF1: deployed /home/rhinos/mf.patch to all servers
 * 19:02 RhinosF1: deploying security patches
 * 17:12 MirahezeLSBot: [paladox@test3] finished deploy of {'config': True} to skip - SUCCESS in 0s
 * 17:12 MirahezeLSBot: [paladox@test3] starting deploy of {'config': True} to skip
 * 17:11 MirahezeLSBot: [paladox@mw11] starting deploy of {'config': True} to all
 * 17:11 MirahezeLSBot: [paladox@mw11] starting deploy of {'config': True} to all
 * 17:10 MirahezeLSBot: [paladox@mw11] finished deploy of {'config': True} to all - SUCCESS in 8s
 * 17:10 MirahezeLSBot: [paladox@test3] finished deploy of {'config': True} to skip - SUCCESS in 0s
 * 17:10 MirahezeLSBot: [paladox@test3] finished deploy of {'config': True} to skip - SUCCESS in 0s
 * 17:09 MirahezeLSBot: [paladox@test3] starting deploy of {'config': True} to skip
 * 17:07 MirahezeLSBot: [paladox@test3] finished deploy of {'config': True} to skip - SUCCESS in 0s
 * 17:07 MirahezeLSBot: [paladox@test3] starting deploy of {'config': True} to skip
 * 17:05 MirahezeLSBot: [paladox@mw11] finished deploy of {'config': True} to all - SUCCESS in 11s
 * 17:05 MirahezeLSBot: [paladox@mw11] starting deploy of {'config': True} to all
 * 03:11 MirahezeLSBot: [@mw11] starting deploy of {'config': True} to ovlon
 * 02:54 MirahezeLSBot: [@test3] finished deploy of {'config': True} to skip - SUCCESS in 0s
 * 02:54 MirahezeLSBot: [@test3] starting deploy of {'config': True} to skip
 * 02:46 MirahezeLSBot: [universalomega@test101] finished deploy of {'pull': 'config', 'config': True} to skip - SUCCESS in 1s
 * 02:46 MirahezeLSBot: [universalomega@test101] starting deploy of {'pull': 'config', 'config': True} to skip
 * 02:46 MirahezeLSBot: [universalomega@mwtask111] finished deploy of {'pull': 'config', 'config': True} to scsvg - SUCCESS in 7s
 * 02:46 MirahezeLSBot: [universalomega@mwtask111] starting deploy of {'pull': 'config', 'config': True} to scsvg
 * 02:41 MirahezeLSBot: [universalomega@mwtask1] sudo -u www-data php /srv/mediawiki/w/maintenance/initSiteStats.php --wiki=wildbowliteraryuniversewiki --active --update (END - exit=0)
 * 02:40 MirahezeLSBot: [universalomega@mwtask1] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=wildbowliteraryuniversewiki (END - exit=0)
 * 02:26 MirahezeLSBot: [universalomega@mwtask1] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=wildbowliteraryuniversewiki (END - exit=2)
 * 02:22 MirahezeLSBot: [universalomega@mwtask1] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=wildbowliteraryuniversewiki (START)
 * 02:20 MirahezeLSBot: [universalomega@mwtask1] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=wildbowliteraryuniversewiki /home/universalomega/Worm_Wiki.xml --username-prefix=wikia:worm --no-updates --report=1 (END - exit=0)
 * 02:09 MirahezeLSBot: [universalomega@mwtask1] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=wildbowliteraryuniversewiki /home/universalomega/Worm_Wiki.xml --username-prefix=wikia:worm --no-updates --report=1 (START)
 * 02:07 MirahezeLSBot: [universalomega@mwtask1] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=wildbowliteraryuniversewiki /home/universalomega/Worm_Wiki.xml --username-prefix=wikia:worm --no-updates --report=1 (END - exit=256)
 * 02:07 MirahezeLSBot: [universalomega@mwtask1] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=wildbowliteraryuniversewiki /home/universalomega/Worm_Wiki.xml --username-prefix=wikia:worm --no-updates --report=1 (START)
 * 01:42 MirahezeLSBot: [@mw11] finished deploy of {'config': True} to ovlon - SUCCESS in 22s
 * 01:42 MirahezeLSBot: [@mw11] starting deploy of {'config': True} to ovlon
 * 01:24 MirahezeLSBot: [@test3] finished deploy of {'config': True} to skip - SUCCESS in 1s
 * 01:24 MirahezeLSBot: [@test3] starting deploy of {'config': True} to skip
 * 01:17 MirahezeLSBot: [paladox@mwtask111] finished deploy of {'config': True} to scsvg - SUCCESS in 5s
 * 01:17 MirahezeLSBot: [paladox@mwtask111] starting deploy of {'config': True} to scsvg
 * 01:17 MirahezeLSBot: [paladox@test101] finished deploy of {'config': True} to skip - SUCCESS in 0s
 * 01:16 MirahezeLSBot: [paladox@test101] starting deploy of {'config': True} to skip
 * 01:16 MirahezeLSBot: [paladox@test101] finished deploy of {'config': True} to skip - SUCCESS in 0s
 * 01:16 MirahezeLSBot: [paladox@test101] starting deploy of {'config': True} to skip
 * 01:16 MirahezeLSBot: [paladox@mwtask111] finished deploy of {'config': True} to scsvg - SUCCESS in 44s
 * 01:15 MirahezeLSBot: [paladox@mwtask111] starting deploy of {'config': True} to scsvg
 * 00:49 MirahezeLSBot: [paladox@mw11] finished deploy of {'config': True} to all - SUCCESS in 16s
 * 00:49 MirahezeLSBot: [paladox@mw11] starting deploy of {'config': True} to all
 * 00:47 MirahezeLSBot: [@test101] finished deploy of {'config': True} to skip - SUCCESS in 6s
 * 00:47 MirahezeLSBot: [@test101] starting deploy of {'config': True} to skip
 * 00:42 MirahezeLSBot: [paladox@mwtask111] finished deploy of {'config': True} to scsvg - SUCCESS in 21s
 * 00:42 MirahezeLSBot: [paladox@mwtask111] starting deploy of {'config': True} to scsvg

2022-01-04

 * 23:35 MirahezeLSBot: [@mw11] finished deploy of {'l10nupdate': True} to ovlon - SUCCESS in 2139s
 * 23:34 MirahezeLSBot: [@test3] finished deploy of {'l10nupdate': True} to skip - SUCCESS in 2066s
 * 23:01 MirahezeLSBot: [@mwtask111] finished deploy of {'l10nupdate': True} to scsvg - SUCCESS in 94s
 * 23:00 MirahezeLSBot: [@test101] finished deploy of {'l10nupdate': True} to skip - SUCCESS in 46s
 * 23:00 MirahezeLSBot: [@mw11] starting deploy of {'l10nupdate': True} to ovlon
 * 23:00 MirahezeLSBot: [@mwtask111] starting deploy of {'l10nupdate': True} to scsvg
 * 23:00 MirahezeLSBot: [@test3] starting deploy of {'l10nupdate': True} to skip
 * 23:00 MirahezeLSBot: [@test101] starting deploy of {'l10nupdate': True} to skip
 * 22:33 MirahezeLSBot: [rhinos@mwtask111] finished deploy of {'folders': 'cache'} to scsvg - FAIL: [5888, 0, 0, 0, 0, 0, 0] in 21s
 * 22:33 MirahezeLSBot: [rhinos@mwtask111] starting deploy of {'folders': 'cache'} to scsvg
 * 22:29 MirahezeLSBot: [rhinos@mwtask111] sudo -u www-data php /srv/mediawiki/w/extensions/CreateWiki/maintenance/generateMissingCache.php --wiki=loginwiki (END - exit=0)
 * 22:24 MirahezeLSBot: [@test3] finished deploy of {'config': True} to skip - SUCCESS in 0s
 * 22:24 MirahezeLSBot: [@test3] starting deploy of {'config': True} to skip
 * 22:22 MirahezeLSBot: [@mwtask111] finished deploy of {'config': True} to scsvg - SUCCESS in 14s
 * 22:21 MirahezeLSBot: [@mwtask111] starting deploy of {'config': True} to scsvg
 * 22:18 MirahezeLSBot: [@test101] finished deploy of {'config': True} to skip - SUCCESS in 1s
 * 22:17 MirahezeLSBot: [@test101] starting deploy of {'config': True} to skip
 * 22:11 MirahezeLSBot: [@mw11] finished deploy of {'config': True} to ovlon - SUCCESS in 6s
 * 22:11 MirahezeLSBot: [@mw11] starting deploy of {'config': True} to ovlon
 * 21:55 MirahezeLSBot: [@test3] finished deploy of {'config': True} to skip - SUCCESS in 0s
 * 21:55 MirahezeLSBot: [@test3] starting deploy of {'config': True} to skip
 * 21:51 MirahezeLSBot: [@mwtask111] finished deploy of {'config': True} to scsvg - SUCCESS in 13s
 * 21:51 MirahezeLSBot: [@mwtask111] starting deploy of {'config': True} to scsvg
 * 21:47 MirahezeLSBot: [@test101] finished deploy of {'config': True} to skip - SUCCESS in 1s
 * 21:47 MirahezeLSBot: [@test101] starting deploy of {'config': True} to skip
 * 21:42 MirahezeLSBot: [@mw11] finished deploy of {'config': True} to ovlon - SUCCESS in 22s
 * 21:41 MirahezeLSBot: [@mw11] starting deploy of {'config': True} to ovlon
 * 20:54 MirahezeLSBot: [@test3] finished deploy of {'config': True} to skip - SUCCESS in 0s
 * 20:54 MirahezeLSBot: [@test3] starting deploy of {'config': True} to skip
 * 20:52 MirahezeLSBot: [@mwtask111] finished deploy of {'config': True} to scsvg - SUCCESS in 14s
 * 20:51 MirahezeLSBot: [@mwtask111] starting deploy of {'config': True} to scsvg
 * 20:48 MirahezeLSBot: [@test101] finished deploy of {'config': True} to skip - SUCCESS in 2s
 * 20:47 MirahezeLSBot: [@test101] starting deploy of {'config': True} to skip
 * 20:42 MirahezeLSBot: [@mw11] finished deploy of {'config': True} to ovlon - SUCCESS in 15s
 * 20:42 MirahezeLSBot: [@mw11] starting deploy of {'config': True} to ovlon
 * 20:36 MirahezeLSBot: [paladox@mwtask111] finished deploy of {'l10n': True, 'force': True} to scsvg - SUCCESS in 170s
 * 20:33 MirahezeLSBot: [paladox@mwtask111] starting deploy of {'l10n': True, 'force': True} to scsvg
 * 20:24 MirahezeLSBot: [@test3] finished deploy of {'config': True} to skip - SUCCESS in 0s
 * 20:24 MirahezeLSBot: [@test3] starting deploy of {'config': True} to skip
 * 20:23 MirahezeLSBot: [paladox@mwtask111] finished deploy of {'l10n': True, 'force': True} to scsvg - SUCCESS in 34s
 * 20:23 MirahezeLSBot: [paladox@mwtask111] starting deploy of {'l10n': True, 'force': True} to scsvg
 * 20:21 MirahezeLSBot: [paladox@mwtask111] finished deploy of {'config': True, 'force': True} to scsvg - SUCCESS in 7s
 * 20:20 MirahezeLSBot: [paladox@mwtask111] starting deploy of {'config': True, 'force': True} to scsvg
 * 20:20 MirahezeLSBot: [paladox@mwtask111] DEPLOY ABORTED: Canary check failed for mw101
 * 20:19 MirahezeLSBot: [paladox@mwtask111] starting deploy of {'config': True} to scsvg
 * 20:15 JohnLewis: db13->db121 replication started
 * 20:00 JohnLewis: db12->db111 replication started
 * 19:47 MirahezeLSBot: [rhinos@mwtask111] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildLocalisationCache.php --wiki=loginwiki --force --lang=en --no-database --skip-message-purge (END - exit=0)
 * 19:46 MirahezeLSBot: [rhinos@mwtask111] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildLocalisationCache.php --wiki=loginwiki --force --lang=en (END - exit=0)
 * 19:42 MirahezeLSBot: [paladox@mwtask111] starting deploy of {'l10nupdate': True, 'force': True} to scsvg
 * 19:28 JohnLewis: db11 -> db101 replication started
 * 19:28 MirahezeLSBot: [paladox@mwtask111] finished deploy of {'l10n': True, 'force': True} to scsvg - SUCCESS in 279s
 * 19:23 MirahezeLSBot: [paladox@mwtask111] starting deploy of {'l10n': True, 'force': True} to scsvg
 * 19:14 MirahezeLSBot: [rhinos@mwtask111] DEPLOY ABORTED: Canary check failed for localhost
 * 19:04 MirahezeLSBot: [rhinos@mwtask111] starting deploy of {'world': True, 'l10n': True} to scsvg
 * 19:04 MirahezeLSBot: [rhinos@mwtask111] DEPLOY ABORTED: Canary check failed for localhost
 * 18:56 MirahezeLSBot: [rhinos@mwtask111] starting deploy of {'world': True, 'l10n': True} to all
 * 16:19 MirahezeLSBot: [paladox@mwtask111] finished deploy of {'world': True, 'force': True} to scsvg - FAIL: [0, 0, 65280, 0, 0, 0, 0, 0, 0, 0, 5888, 5888, 5888, 5888, 5888, 5888] in 322s
 * 16:15 MirahezeLSBot: [paladox@test101] finished deploy of {'world': True, 'force': True} to skip - FAIL: [0, 0, 65280, 0] in 166s
 * 16:14 MirahezeLSBot: [paladox@mwtask111] starting deploy of {'world': True, 'force': True} to scsvg
 * 16:13 MirahezeLSBot: [paladox@mw11] finished deploy of {'world': True} to all - SUCCESS in 353s
 * 16:13 MirahezeLSBot: [paladox@test3] finished deploy of {'world': True} to skip - SUCCESS in 290s
 * 16:13 MirahezeLSBot: [paladox@mwtask111] starting deploy of {'world': True, 'force': True} to all
 * 16:13 MirahezeLSBot: [paladox@mwtask111] DEPLOY ABORTED: Canary check failed for localhost
 * 16:12 MirahezeLSBot: [paladox@test101] starting deploy of {'world': True, 'force': True} to skip
 * 16:12 MirahezeLSBot: [paladox@test101] DEPLOY ABORTED: Canary check failed for localhost
 * 16:11 MirahezeLSBot: [paladox@test101] starting deploy of {'world': True} to skip
 * 16:10 MirahezeLSBot: [paladox@mwtask111] starting deploy of {'world': True} to all
 * 16:08 MirahezeLSBot: [paladox@test3] starting deploy of {'world': True} to skip
 * 16:07 MirahezeLSBot: [paladox@mw11] starting deploy of {'world': True} to all
 * 06:53 MirahezeLSBot: [universalomega@mw11] finished deploy of {'world': True} to all - SUCCESS in 356s
 * 06:52 MirahezeLSBot: [universalomega@test3] finished deploy of {'world': True} to skip - SUCCESS in 275s
 * 06:47 MirahezeLSBot: [universalomega@test3] starting deploy of {'world': True} to skip
 * 06:47 MirahezeLSBot: [universalomega@mw11] starting deploy of {'world': True} to all
 * 06:45 MirahezeLSBot: [universalomega@mw11] finished deploy of {'world': True, 'l10n': True} to all - SUCCESS in 1208s
 * 06:37 MirahezeLSBot: [universalomega@test3] finished deploy of {'world': True, 'l10n': True} to skip - SUCCESS in 727s
 * 06:25 MirahezeLSBot: [universalomega@mw11] starting deploy of {'world': True, 'l10n': True} to all
 * 06:24 MirahezeLSBot: [universalomega@test3] starting deploy of {'world': True, 'l10n': True} to skip
 * 02:54 MirahezeLSBot: [@test3] finished deploy of {'config': True} to skip - SUCCESS in 0s
 * 02:54 MirahezeLSBot: [@test3] starting deploy of {'config': True} to skip
 * 02:51 MirahezeLSBot: [@mwtask111] DEPLOY ABORTED: Canary check failed for localhost
 * 02:51 MirahezeLSBot: [@mwtask111] starting deploy of {'config': True} to scsvg
 * 02:47 MirahezeLSBot: [@test101] DEPLOY ABORTED: Canary check failed for localhost
 * 02:47 MirahezeLSBot: [@test101] starting deploy of {'config': True} to skip
 * 02:41 MirahezeLSBot: [@mw11] finished deploy of {'config': True} to ovlon - SUCCESS in 11s
 * 02:41 MirahezeLSBot: [@mw11] starting deploy of {'config': True} to ovlon
 * 02:21 MirahezeLSBot: [@mwtask111] DEPLOY ABORTED: Canary check failed for localhost
 * 02:21 MirahezeLSBot: [@mwtask111] starting deploy of {'config': True} to scsvg
 * 02:18 MirahezeLSBot: [@test101] DEPLOY ABORTED: Canary check failed for localhost
 * 02:18 MirahezeLSBot: [@test101] starting deploy of {'config': True} to skip
 * 02:11 MirahezeLSBot: [@mw11] finished deploy of {'config': True} to ovlon - SUCCESS in 11s
 * 02:11 MirahezeLSBot: [@mw11] starting deploy of {'config': True} to ovlon
 * 01:55 MirahezeLSBot: [@test3] finished deploy of {'config': True} to skip - SUCCESS in 0s
 * 01:54 MirahezeLSBot: [@test3] starting deploy of {'config': True} to skip
 * 01:51 MirahezeLSBot: [@mwtask111] DEPLOY ABORTED: Canary check failed for localhost
 * 01:51 MirahezeLSBot: [@mwtask111] starting deploy of {'config': True} to scsvg
 * 01:47 MirahezeLSBot: [@test101] DEPLOY ABORTED: Canary check failed for localhost
 * 01:47 MirahezeLSBot: [@test101] starting deploy of {'config': True} to skip
 * 01:42 MirahezeLSBot: [@mw11] finished deploy of {'config': True} to ovlon - SUCCESS in 17s
 * 01:41 MirahezeLSBot: [@mw11] starting deploy of {'config': True} to ovlon

2022-01-03

 * 23:36 MirahezeLSBot: [@mw11] finished deploy of {'l10nupdate': True} to ovlon - SUCCESS in 2156s
 * 23:33 MirahezeLSBot: [@test3] finished deploy of {'l10nupdate': True} to skip - SUCCESS in 2004s
 * 23:00 MirahezeLSBot: [@test101] DEPLOY ABORTED: Canary check failed for localhost
 * 23:00 MirahezeLSBot: [@mw11] starting deploy of {'l10nupdate': True} to ovlon
 * 23:00 MirahezeLSBot: [@mwtask111] DEPLOY ABORTED: Canary check failed for localhost
 * 23:00 MirahezeLSBot: [@test3] starting deploy of {'l10nupdate': True} to skip
 * 23:00 MirahezeLSBot: [@test101] starting deploy of {'l10nupdate': True} to skip
 * 23:00 MirahezeLSBot: [@mwtask111] starting deploy of {'l10nupdate': True} to scsvg
 * 12:26 JohnLewis: redoing db backups with schemas, disabled automatic backups and increased binlogs so hopefully reduce long term db load for now
 * 12:21 MirahezeLSBot: [@mwtask111] DEPLOY ABORTED: Canary check failed for localhost
 * 12:17 MirahezeLSBot: [@test101] DEPLOY ABORTED: Canary check failed for localhost
 * 10:45 RhinosF1: deploy world+config to SCSVG with --force to fix
 * 10:36 RhinosF1: updated MW grafana-new to fix php alerts
 * 10:27 RhinosF1: downtime mwtask111 and test101 puppet alerts as they are flappy and annoying
 * 10:24 MirahezeLSBot: [@test3] finished deploy of {'config': True} to skip - SUCCESS in 0s
 * 10:24 MirahezeLSBot: [@test3] starting deploy of {'config': True} to skip
 * 10:22 MirahezeLSBot: [@mwtask111] DEPLOY ABORTED: Canary check failed for localhost
 * 10:21 MirahezeLSBot: [@mwtask111] starting deploy of {'config': True} to scsvg
 * 10:17 MirahezeLSBot: [@test101] DEPLOY ABORTED: Canary check failed for localhost
 * 10:17 MirahezeLSBot: [@test101] starting deploy of {'config': True} to skip
 * 10:11 MirahezeLSBot: [@mw11] finished deploy of {'config': True} to ovlon - SUCCESS in 6s
 * 10:11 MirahezeLSBot: [@mw11] starting deploy of {'config': True} to ovlon
 * 09:47 MirahezeLSBot: [@test101] DEPLOY ABORTED: Canary check failed for localhost
 * 09:47 MirahezeLSBot: [@test101] starting deploy of {'config': True} to skip
 * 09:42 MirahezeLSBot: [@mw11] finished deploy of {'config': True} to ovlon - SUCCESS in 22s
 * 09:41 MirahezeLSBot: [@mw11] starting deploy of {'config': True} to ovlon
 * 09:24 MirahezeLSBot: [@test3] finished deploy of {'config': True} to skip - SUCCESS in 0s
 * 09:24 MirahezeLSBot: [@test3] starting deploy of {'config': True} to skip
 * 09:21 MirahezeLSBot: [@mwtask111] DEPLOY ABORTED: Canary check failed for localhost
 * 09:21 MirahezeLSBot: [@mwtask111] starting deploy of {'config': True} to scsvg
 * 07:56 MirahezeLSBot: [@test3] finished deploy of {'config': True} to skip - SUCCESS in 1s
 * 07:55 MirahezeLSBot: [@test3] starting deploy of {'config': True} to skip
 * 07:54 MirahezeLSBot: [@mwtask111] DEPLOY ABORTED: Canary check failed for localhost
 * 07:52 MirahezeLSBot: [@mwtask111] starting deploy of {'config': True} to scsvg
 * 07:47 MirahezeLSBot: [@test101] DEPLOY ABORTED: Canary check failed for localhost
 * 07:47 MirahezeLSBot: [@test101] starting deploy of {'config': True} to skip
 * 07:42 MirahezeLSBot: [@mw11] finished deploy of {'config': True} to ovlon - SUCCESS in 17s
 * 07:42 MirahezeLSBot: [@mw11] starting deploy of {'config': True} to ovlon
 * 03:46 MirahezeLSBot: [universalomega@mw11] finished deploy of {'world': True, 'l10n': True} to all - SUCCESS in 605s
 * 03:36 MirahezeLSBot: [universalomega@mw11] starting deploy of {'world': True, 'l10n': True} to all
 * 03:35 MirahezeLSBot: [universalomega@mw11] finished deploy of {'world': True, 'l10n': True} to all - SUCCESS in 1602s
 * 03:17 MirahezeLSBot: [universalomega@test3] finished deploy of {'world': True, 'l10n': True} to skip - SUCCESS in 256s
 * 03:12 MirahezeLSBot: [universalomega@test3] starting deploy of {'world': True, 'l10n': True} to skip
 * 03:08 MirahezeLSBot: [universalomega@mw11] starting deploy of {'world': True, 'l10n': True} to all
 * 03:07 MirahezeLSBot: [universalomega@mw11] starting deploy of {'world': True, 'l10n': True} to all
 * 03:07 MirahezeLSBot: [universalomega@test3] finished deploy of {'world': True, 'l10n': True} to skip - SUCCESS in 801s
 * 02:53 MirahezeLSBot: [universalomega@test3] starting deploy of {'world': True, 'l10n': True} to skip
 * 02:20 MirahezeLSBot: [universalomega@mwtask1] sudo -u www-data /usr/local/bin/foreachwikiindblist /srv/mediawiki/cache/databases.json /srv/mediawiki/w/extensions/ManageWiki/maintenance/toggleExtension.php wikiseo (END - exit=0)
 * 02:16 MirahezeLSBot: [universalomega@mw11] finished deploy of {'world': True} to all - SUCCESS in 605s
 * 02:09 MirahezeLSBot: [universalomega@test3] finished deploy of {'world': True} to skip - SUCCESS in 310s
 * 02:07 MirahezeLSBot: [universalomega@mw11] starting deploy of {'world': True} to all
 * 02:03 MirahezeLSBot: [universalomega@test3] starting deploy of {'world': True} to skip
 * 01:57 MirahezeLSBot: [universalomega@mwtask1] sudo -u www-data /usr/local/bin/foreachwikiindblist /srv/mediawiki/cache/databases.json /srv/mediawiki/w/extensions/ManageWiki/maintenance/toggleExtension.php wikiseo (START)
 * 01:46 MirahezeLSBot: [universalomega@mwtask1] sudo -u www-data /usr/local/bin/foreachwikiindblist /srv/mediawiki/cache/databases.json /srv/mediawiki/w/extensions/ManageWiki/maintenance/toggleExtension.php purge (END - exit=0)
 * 01:19 MirahezeLSBot: [universalomega@mwtask1] sudo -u www-data /usr/local/bin/foreachwikiindblist /srv/mediawiki/cache/databases.json /srv/mediawiki/w/extensions/ManageWiki/maintenance/toggleExtension.php purge (START)

2022-01-02

 * 23:53 paladox: set io threads to 32 on gluster101
 * 23:51 paladox: set io threads to 32 on gluster3-4
 * 23:36 MirahezeLSBot: [@mw11] finished deploy of {'l10nupdate': True} to ovlon - SUCCESS in 2194s
 * 23:36 MirahezeLSBot: [@test3] finished deploy of {'l10nupdate': True} to skip - SUCCESS in 2166s
 * 23:29 MirahezeLSBot: [@test3] finished deploy of {'config': True} to skip - SUCCESS in 2s
 * 23:29 MirahezeLSBot: [@test3] starting deploy of {'config': True} to skip
 * 23:22 MirahezeLSBot: [@mwtask111] DEPLOY ABORTED: Canary check failed for localhost
 * 23:22 MirahezeLSBot: [@mwtask111] starting deploy of {'config': True} to scsvg
 * 23:18 MirahezeLSBot: [@test101] DEPLOY ABORTED: Canary check failed for localhost
 * 23:17 MirahezeLSBot: [@test101] starting deploy of {'config': True} to skip
 * 23:12 MirahezeLSBot: [@mw11] finished deploy of {'config': True} to ovlon - SUCCESS in 24s
 * 23:12 MirahezeLSBot: [@mw11] starting deploy of {'config': True} to ovlon
 * 23:04 MirahezeLSBot: [@mwtask111] DEPLOY ABORTED: Canary check failed for localhost
 * 23:03 MirahezeLSBot: [@test101] DEPLOY ABORTED: Canary check failed for localhost
 * 23:02 MirahezeLSBot: [@test3] starting deploy of {'l10nupdate': True} to skip
 * 23:02 MirahezeLSBot: [@test101] starting deploy of {'l10nupdate': True} to skip
 * 23:01 MirahezeLSBot: [@mwtask111] starting deploy of {'l10nupdate': True} to scsvg
 * 23:00 MirahezeLSBot: [@mw11] starting deploy of {'l10nupdate': True} to ovlon
 * 22:31 MirahezeLSBot: [universalomega@mw11] finished deploy of {'world': True} to all - SUCCESS in 570s
 * 22:22 MirahezeLSBot: [universalomega@mw11] starting deploy of {'world': True} to all
 * 22:21 MirahezeLSBot: [universalomega@test3] finished deploy of {'world': True} to skip - SUCCESS in 185s
 * 22:18 MirahezeLSBot: [universalomega@test3] starting deploy of {'world': True} to skip
 * 22:10 MirahezeLSBot: [universalomega@test3] finished deploy of {'pull': 'config', 'config': True} to skip - SUCCESS in 0s
 * 22:09 MirahezeLSBot: [universalomega@test3] starting deploy of {'pull': 'config', 'config': True} to skip
 * 22:09 MirahezeLSBot: [universalomega@mw11] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 40s
 * 22:08 MirahezeLSBot: [universalomega@mw11] starting deploy of {'pull': 'config', 'config': True} to all
 * 22:07 MirahezeLSBot: [universalomega@mwtask111] finished deploy of {'pull': 'config', 'config': True, 'force': True} to scsvg - SUCCESS in 66s
 * 22:06 MirahezeLSBot: [universalomega@mwtask111] starting deploy of {'pull': 'config', 'config': True, 'force': True} to scsvg
 * 22:05 MirahezeLSBot: [universalomega@test101] finished deploy of {'pull': 'config', 'config': True, 'force': True} to skip - SUCCESS in 0s
 * 22:05 MirahezeLSBot: [universalomega@test101] starting deploy of {'pull': 'config', 'config': True, 'force': True} to skip
 * 22:02 MirahezeLSBot: [universalomega@test3] finished deploy of {'config': True} to skip - SUCCESS in 0s
 * 22:02 MirahezeLSBot: [universalomega@test3] starting deploy of {'config': True} to skip
 * 21:47 MirahezeLSBot: [universalomega@test3] starting deploy of {'world': True} to skip
 * 21:35 MirahezeLSBot: [universalomega@test3] finished deploy of {'folders': 'w/extensions/CreateWiki'} to skip - SUCCESS in 1s
 * 21:34 MirahezeLSBot: [universalomega@test3] starting deploy of {'folders': 'w/extensions/CreateWiki'} to skip
 * 21:27 MirahezeLSBot: [universalomega@test3] finished deploy of {'folders': 'w/extensions/CreateWiki'} to skip - SUCCESS in 0s
 * 21:26 MirahezeLSBot: [universalomega@test3] starting deploy of {'folders': 'w/extensions/CreateWiki'} to skip
 * 20:28 MirahezeLSBot: [universalomega@test3] finished deploy of {'folders': 'w/extensions/CreateWiki'} to skip - SUCCESS in 0s
 * 20:27 MirahezeLSBot: [universalomega@test3] starting deploy of {'folders': 'w/extensions/CreateWiki'} to skip
 * 19:54 MirahezeLSBot: [universalomega@mw11] starting deploy of {'pull': 'config', 'config': True} to all
 * 19:12 MirahezeLSBot: [paladox@mwtask1] test
 * 19:11 MirahezeLSBot: [paladox@mon2] test
 * 19:11 MirahezeLSBot: [paladox@mon2] test
 * 19:00 MirahezeLSBot: [paladox@mon2] test
 * 18:52 MirahezeLSBot: [@mwtask111] DEPLOY ABORTED: Canary check failed for localhost
 * 18:52 MirahezeLSBot: [universalomega@mw11] starting deploy of {'pull': 'config', 'config': True} to all
 * 18:52 MirahezeLSBot: [@mwtask111] starting deploy of {'config': True} to scsvg
 * 18:49 MirahezeLSBot: [@test101] DEPLOY ABORTED: Canary check failed for localhost
 * 18:48 MirahezeLSBot: [@test101] starting deploy of {'config': True} to skip
 * 18:41 MirahezeLSBot: [@mw11] starting deploy of {'config': True} to ovlon
 * 18:40 MirahezeLSBot: [universalomega@test3] finished deploy of {'pull': 'config', 'config': True} to skip - SUCCESS in 1s
 * 18:40 MirahezeLSBot: [universalomega@test3] starting deploy of {'pull': 'config', 'config': True} to skip
 * 18:39 MirahezeLSBot: [universalomega@test3] finished deploy of {'folders': 'w/extensions/CreateWiki'} to skip - SUCCESS in 0s
 * 18:39 MirahezeLSBot: [universalomega@test3] starting deploy of {'folders': 'w/extensions/CreateWiki'} to skip
 * 18:37 MirahezeLSBot: [universalomega@test3] finished deploy of {'config': True} to skip - SUCCESS in 0s
 * 18:36 MirahezeLSBot: [universalomega@test3] starting deploy of {'config': True} to skip
 * 18:26 MirahezeLSBot: [@test3] finished deploy of {'config': True} to skip - SUCCESS in 1s
 * 18:25 MirahezeLSBot: [@test3] starting deploy of {'config': True} to skip
 * 17:24 MirahezeLSBot: [@test3] finished deploy of {'config': True} to skip - SUCCESS in 0s
 * 17:24 MirahezeLSBot: [@test3] starting deploy of {'config': True} to skip
 * 17:22 MirahezeLSBot: [@mwtask111] DEPLOY ABORTED: Canary check failed for localhost
 * 17:22 MirahezeLSBot: [@mwtask111] starting deploy of {'config': True} to scsvg
 * 17:18 MirahezeLSBot: [@test101] DEPLOY ABORTED: Canary check failed for localhost
 * 17:18 MirahezeLSBot: [@test101] starting deploy of {'config': True} to skip
 * 17:11 MirahezeLSBot: [@mw11] starting deploy of {'config': True} to ovlon
 * 04:25 MirahezeLSBot: [@test3] finished deploy of {'config': True} to skip - SUCCESS in 1s
 * 04:25 MirahezeLSBot: [@test3] starting deploy of {'config': True} to skip
 * 03:54 MirahezeLSBot: [@test3] finished deploy of {'config': True} to skip - SUCCESS in 0s
 * 03:54 MirahezeLSBot: [@test3] starting deploy of {'config': True} to skip
 * 02:54 MirahezeLSBot: [@test3] finished deploy of {'config': True} to skip - SUCCESS in 1s
 * 02:54 MirahezeLSBot: [@test3] starting deploy of {'config': True} to skip
 * 02:37 MirahezeLSBot: [universalomega@mw11] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 9s
 * 02:37 MirahezeLSBot: [universalomega@mw11] starting deploy of {'pull': 'config', 'config': True} to all
 * 02:12 MirahezeLSBot: [@mw11] finished deploy of {'config': True} to ovlon - SUCCESS in 33s
 * 02:12 MirahezeLSBot: [@mw11] finished deploy of {'config': True} to ovlon - SUCCESS in 33s
 * 02:12 MirahezeLSBot: [@mw11] starting deploy of {'config': True} to ovlon
 * 01:55 MirahezeLSBot: [@test3] finished deploy of {'config': True} to skip - SUCCESS in 0s
 * 01:54 MirahezeLSBot: [@test3] starting deploy of {'config': True} to skip
 * 00:42 MirahezeLSBot: [@mw11] finished deploy of {'config': True} to ovlon - SUCCESS in 22s
 * 00:41 MirahezeLSBot: [@mw11] starting deploy of {'config': True} to ovlon
 * 00:27 MirahezeLSBot: [@test3] finished deploy of {'config': True} to skip - SUCCESS in 0s
 * 00:26 MirahezeLSBot: [@test3] starting deploy of {'config': True} to skip
 * 00:14 MirahezeLSBot: [@mw11] finished deploy of {'config': True} to ovlon - SUCCESS in 82s

2022-01-01

 * 23:34 MirahezeLSBot: [@mw11] finished deploy of {'l10nupdate': True} to ovlon - SUCCESS in 2035s
 * 23:33 MirahezeLSBot: [@test3] finished deploy of {'l10nupdate': True} to skip - SUCCESS in 2010s
 * 23:01 MirahezeLSBot: [@mw11] starting deploy of {'l10nupdate': True} to ovlon
 * 23:00 MirahezeLSBot: [@test3] starting deploy of {'l10nupdate': True} to skip
 * 18:42 MirahezeLSBot: [@mw11] finished deploy of {'config': True} to ovlon - SUCCESS in 13s
 * 18:41 MirahezeLSBot: [@mw11] starting deploy of {'config': True} to ovlon
 * 18:37 RhinosF1: starting full deploy-mediawiki to all SCSVG servers
 * 18:24 MirahezeLSBot: [@test3] finished deploy of {'config': True} to skip - SUCCESS in 1s
 * 18:24 MirahezeLSBot: [@test3] starting deploy of {'config': True} to skip
 * 18:12 MirahezeLSBot: [@mw11] finished deploy of {'config': True} to ovlon - SUCCESS in 41s
 * 18:12 MirahezeLSBot: [@mw11] starting deploy of {'config': True} to ovlon
 * 15:38 paladox: restart php7.3/7.4 on mw*
 * 14:44 MirahezeLSBot: [paladox@test3]
 * 14:44 MirahezeLSBot: [paladox@test3]
 * 10:54 RhinosF1: forcefully change password for BrowserStackAccount via CLI to one from K12
 * 08:57 RhinosF1: downtime sslhost on icinga-new for 7 days
 * 03:12 Universal Omega: sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=sunrinwiki