Tech:Server admin log/2018

2015-10-05

 * 04:16 revi: restarted HHVM, 502

2015-10-04

 * 16:56 SPF|Cloud: imported bgowiki
 * 09:12 SPF|Cloud: restarted MariaDB

2015-10-03

 * 18:16 SPF|Cloud: killed one runJobs.php process, and set nice +19 on the other running one
 * 11:39 revi: imported szkwiki

2015-10-02

 * 20:25 SPF|Cloud: restarted HHVM
 * 15:00 revi: imported wikiconstituciowiki
 * 12:18 SPF|Cloud: restarted MariaDB

2015-10-01

 * 23:58 mutante: restarted nginx on mw1
 * 16:47 SPF|Cloud: issued SIGKILL to all HHVM processes, afterwards service hhvm restart
 * 15:55 SPF|Cloud: restarted nginx
 * 14:12 JohnFLewis: converted all talk pages to flow on permanentfuturelabwiki
 * 06:08 revi: imported batch 1 of poserdazfreebieswiki, 5 imported (batch 3: 3 imported) closing #141.
 * 06:05 revi: imported batch 3 of poserdazfreebieswiki 3 mins ago
 * 04:25 revi: restart HHVM, 502 again

2015-09-30

 * 19:24 SPF|Cloud: update page set page_namespace = 1621 where page_namespace = 521; for ATT
 * 19:24 SPF|Cloud: update page set page_namespace = 1620 where page_namespace = 520; for ATT
 * 11:11 JohnFLewis: restarted hhvm, disable extension causing segfault *NOT* OOM
 * 10:08 revi: restarted HHVM hour ago (...) 502
 * 10:00 JohnFLewis: rebooting mw1 (mem leak.)
 * 01:14 NDK|Cloud: Restarted hhvm, 502 ( https://www.irccloud.com/pastebin/bGOaVBVy/ )

2015-09-29

 * 21:05 JohnFLewis: rebooted mw1; monitoring swap usage
 * 20:24 SPF|Cloud: HHVM restarted
 * 19:08 JohnFLewis: restarted hhvm again
 * 17:03 SPF|Cloud: restarted HHVM
 * 16:05 JohnFLewis: restarted MariaDB (crashed searchindexes again)
 * 14:50 JohnFLewis: MariaDB [(none)]> drop database cinemawiki;
 * 10:37 SPF|Cloud: Session issues, restarted Redis. Seems fixed now.
 * 03:22 revi: restarted HHVM 4mins ago (yes, 502)

2015-09-28

 * 16:04 SPF|Cloud: restart HHVM for https://github.com/miraheze/puppet/commit/6d1dfa48866ecd1afbd70a4479a0f3edf28e7d6a
 * 02:12 revi: restarted HHVM, 502
 * 01:26 revi: restarted HHVM, 502

2015-09-27

 * 15:25 SPF|Cloud: installed security updates on mw1
 * 14:13 SPF|Cloud: restarted MariaDB
 * 13:00 SPF|Cloud: imported second batch of ATT images
 * 12:28 SPF|Cloud: rebooted mw1. HHVM was not started automatically, so did this manually.
 * 11:18 revi: restarted HHVM
 * 08:56 JohnFLewis: restarted hhvm
 * 04:33 revi: restarted HHVM, was generating 502

2015-09-26

 * 11:22 revi: imported izanagiwiki (/home/revi/dumps/izanagiwiki.xml) and ran rebuildrecentchanges.php
 * 10:33 JohnFLewis: restarted MariaDB on db1
 * 02:46 revi: permanentfuturelabwiki imported (yesterday, forgot to log)

2015-09-25

 * 16:45 SPF|Cloud: import of ATT images done
 * 12:32 revi: php importImages.php --wiki poserdazfreebieswiki /home/southparkfan/poserdazfreebieswiki-images --skip-dupes JPG JPEG PNG SVG GIF gif svg png jpg jpeg
 * 12:28 revi: php importImages.php --wiki poserdazfreebieswiki /home/revi/images/Images --skip-dupes JPG JPEG PNG SVG GIF gif svg png jpg jpeg
 * 12:26 revi: php importImages.php --wiki poserdazfreebieswiki /home/revi/images/2 --skip-dupes JPG JPEG PNG SVG GIF gif svg png jpg jpeg

2015-09-24

 * 15:45 JohnFLewis: restarting MariaDB -- far too many searchindex crashes to work with

2015-09-23

 * 20:49 JohnFLewis: restart nginx to catch UA block for Wordpress -- will commit shortly
 * 13:07 SPF|Cloud: MariaDB crashed; restarted it

2015-09-22

 * 20:55 JohnFLewis: purged bin logs on db1; gains ~20GB
 * 18:48 SPF|Cloud: dropped ATT database
 * 17:37 SPF|Cloud: ran removeDeletedWikis.php for ATT

2015-09-21

 * 18:34 SPF|Cloud: ran following query on ATT database: update revision set rev_user = 7, rev_user_text = 'DocColress' where rev_id = 303275;
 * 15:49 JohnFLewis: restarted MariaDB on db1

2015-09-20

 * 09:25 SPF|Cloud: dropped allthetropeswiki database for import

2015-09-19

 * 22:33 SPF|Cloud: Poser and Daz Free Resources import running in screen now, this time without issues
 * 22:29 SPF|Cloud: deleted poserdazfreebieswiki database, to make sure the import goes without issues.
 * 22:22 SPF|Cloud: Poserdaz and Freebies Wiki import running in screen
 * 19:26 SPF|Cloud: restarted ganglia-monitor on all servers
 * 17:22 SPF|Cloud: ran importImages.php on 8stationwiki

2015-09-18

 * 20:52 SPF|Cloud: killed runJobs.php again
 * 20:46 SPF|Cloud: killed the remaining instances of runJobs.php on mw1
 * 20:43 SPF|Cloud: killed 4 instances of runJobs.php on mw1

2015-09-17

 * 22:31 JohnFLewis: backwards compatibility exists after a restart it seems
 * 22:29 JohnFLewis: upgrading parsoid; serious lack of any documentation. complete removal of setInterwiki
 * 00:08 JohnFLewis: quickly provisioned mw1 DDoS filtered IP

2015-09-16

 * 22:17 JohnFLewis: rebooted mw1, strange memory patterns