Incident Reports

Main Details

Service Component Affected

Visible Outage (Down to Partial)

286 minutes

Total Outage (Down to Up)

875 minutes

Basic Incident Cause

Technical

Has this incident been aggravated by anything? (Such as investigating, users etc.)

Section not applicable

Are there any known problems with this service?

Section not applicable

Was this incident preventable?

Section not applicable

Is there any other information which would be useful for this incident report?

Section not applicable

Who responded to this incident?

Who needs to review this report?

Report Published At

Wed, 18 Dec 2019 20:07:25 GMT

The following IDs are actionable tasks

No actions have been identified for this incident

Incident Logs

information at Wed, 18 Dec 2019 03:39:32 GMT - Service was down

First email sent to staff@ about inability to login

RhinosF1 at Wed, 18 Dec 2019 06:56:00 GMT - Service was down

alerted Reception123 (and other ops) about login issues and assisted debugging

Reception123 at Wed, 18 Dec 2019 07:46:00 GMT - Service was down

Restarted redis

Reception123 at Wed, 18 Dec 2019 08:26:00 GMT - Service was up

restarted Redis

Southparkfan at Wed, 18 Dec 2019 08:56:00 GMT - Service was down

Disabled puppet on misc2

Southparkfan at Wed, 18 Dec 2019 09:38:00 GMT - Service was down

Created cron to restart redis every 15 minutes

paladox at Wed, 18 Dec 2019 15:53:00 GMT - Service was down

contacted ramnode

information at Wed, 18 Dec 2019 16:07:00 GMT - Service was up

Ramnode resolved the issue

information at Wed, 18 Dec 2019 21:09:00 GMT - Service was down

User reports login issues on discord

John at Wed, 18 Dec 2019 21:47:00 GMT - Service was up

Restarted redis