Site Outage

Status
Not open for further replies.
A

Admin

Firstly, our sincere apologies for the site outage we've had over the past 24 hours or so. This is due to an issue with our files CDN (cdn.fellowsfilm.co.uk) that occurred last night at around 7:30PM (BST). We do not currently know exactly what caused this, but will be investigating further to ensure that this doesn't happen again.

No data, apart from files stored on our CDN between 31st August - 5th September, has been lost or compromised.

You can find a full log of the outage here:
A major issue with the CDN meant that all downloads and images became unavailable. The Forums have been taken offline while we work on the best resolution for the problem.

Update (2017-09-05T21:00):
Images have now been restored from backups, with the exception of all images between the server backup on the 31st August and approximately 10 pm on the 4th September. These files have been lost as they were not backed up, but still affected by the issue.

Work is continuing to restore the download centre files, which it is believed will remain intact.

Moderators are still deciding what action to take with posts that contain missing images. There is currently no ETA on normal service resuming.

Update (2017-09-05T21:45):
99 posts containing missing images or referencing a post with missing images have been hidden.

Update (2017-09-05T22:30):
We have now diagnosed the problem as a software issue. We've done our best to fix the problems caused, but it means that all images and files uploaded between 0600 UTC on 31st August and 2200 UTC on 4th September are lost forever and will have to be reuploaded.

7 download centre items have been unapproved while we attempt to restore these files from those downloaded by Content Control.

The site will remain offline overnight and possibly into tomorrow while we finish tidying up the mess, do a full backup of the working site and run tests to attempt to better identify the problem so it doesn't happen again.

Update (2017-09-06T00:30):
Site backup in progress. We hope to bring the main site back up soon, after which we will continue trying to diagnose the root cause of the issue in the first place.

Stay tuned for further updates.

Update (2017-09-06T16:28):
The main site is now back online whilst we continue investigating what has caused this issue behind the scenes. Some files on the Downloads Centre will be missing for the time being whilst we try and recover them, and we will be shortly leasing with file submitters regarding recovering lost files.
If you have uploaded a file on the Downloads Centre between around 7am on the 31st August and the time of the outage (around 7:30pm on the 5th September), it is likely that your uploaded files will need to be recovered. We have temporarily removed all affected downloads from public view, and will contact anybody who is required to re-upload their file via. PM in a timely manner.

Any images uploaded in posts or elsewhere on the site will unfortunately have also been lost.
Feel free to edit any posts you feel necessary, or report the post if you wish for it to be deleted by a moderator.

We appreciate your patience whilst we dealt with this issue, and welcome any questions or queries you may have below.
 

The British Gamer

Veteran Member
Dec 29, 2016
1,098
Aww no people if you have had any likes from people during the outage that had images, you have also lost those likes as i jjst found out as i had 85 or 86 before the outage and now just have 80 (at the time of writing this message!
 
A

Admin

Aww no people if you have had any likes from people during the outage that had images, you have also lost those likes as i jjst found out as i had 85 or 86 before the outage and now just have 80 (at the time of writing this message!
That'd be because I've deleted all of the SotM submissions, so your likes from that post would've been lost.
 
  • Like
Reactions: The British Gamer
Status
Not open for further replies.