Posts

For more information, see the search syntax documentation. Search results are sorted by creation date.

Search Results

Site and Policy » Maintenance 29-July-2013 » Post 5

Clover the Clever
Princess of Love - Extra special version for those who participated in the Canterlot Wedding 10th anniversary event by contributing art.
A Perfectly Normal Pony - <@CloverTheClever> I'd pay to see Carcer in a fursuit
Always Codes Drunk - It explains a lot
From the Night - I have technically banned myself a bunch of times...
Since the Beginning  - User number zero

Lord and Saviour
I can confirm that babies are employed by our hosts as server technicians. Possibly less confident than that fella appears to be. He at least knows which one’s the power cable. He’s even picked out the inlet.
 
Derpy’s far too competent, employing percussive maintenance like that.

Site and Policy » Maintenance 29-July-2013 » Post 4

Site and Policy » Maintenance 29-July-2013 » Post 3

Site and Policy » Maintenance 29-July-2013 » Post 2

Site and Policy » Maintenance 29-July-2013 » Post 1

The Frowning Pony

Administrator
13 blinks per minute
For those wanting a tl;dr of wtf happened, have some bullet points:
 
  1. Server handling arbitration, DNS and backups dies  
  2. Lack of proper arbitration causes data desync, hidden images  
  3. Backups temporarily set to a separate partition on cadance, the image server  
  4. New backup server goes online, but needs setting up  
  5. Datacenter where cadance lives suffers a network fault  
  6. cadance does not come back after network fault is resolved  
  7. Per host’s intervention guidelines, server is rebooted to ensure it’s not a software issue  
  8. Reboot triggers a file system check, as expected  
  9. Host tech notices a trivial fault with a remote control module and reboots the system during the check causing data corruption  
  10. After 8 hours on the phone with them insisting the machine was in perfect health and them looking at a login screen, we pay for KVM IP to have direct access to the machine  
  11. Machine is seen to obviously never have gotten anywhere near login; file system corrupted  
  12. Due to the gap in the backups, we begin very slow data recovery  
  13. To speed up the process, we order a USB drive for the server  
  14. After 18 hours, host plugs the drive in and reboots the server mid-data recovery, severely impacting the process  
  15. All data possible recovered between cadance and main backup, site goes back up  
  16. You are here

Site and Policy » Maintenance 29-July-2013 » Topic Opener

The Frowning Pony

Administrator
13 blinks per minute
News Tumblr
 
Basically, we have images missing from the data corruption, and images hidden from the DB desync of a few days earlier. The first problem we’ll fix by plugging in the images using another backup. The second problem requires a reindex. Neither of these can be done any time soon due to real life circumstances (ie. work), so don’t expect everything to be “back” until tomorrow.
 
As well, due to the way we had to re-set up the site, there’re a few nasty bugs, most notably the inability to upload any new images. That should be fixed today, but probably not for several hours.

Default search

If you do not specify a field to search over, the search engine will search for posts with a body that is similar to the query's word stems. For example, posts containing the words winged humanization, wings, and spread wings would all be found by a search for wing, but sewing would not be.

Allowed fields

Field SelectorTypeDescriptionExample
authorLiteralMatches the author of this post. Anonymous authors will never match this term.author:Joey
bodyFull TextMatches the body of this post. This is the default field.body:test
created_atDate/Time RangeMatches the creation time of this post.created_at:2015
idNumeric RangeMatches the numeric surrogate key for this post.id:1000000
myMetamy:posts matches posts you have posted if you are signed in. my:posts
subjectFull TextMatches the title of the topic.subject:time wasting thread
topic_idLiteralMatches the numeric surrogate key for the topic this post belongs to.topic_id:7000
topic_positionNumeric RangeMatches the offset from the beginning of the topic of this post. Positions begin at 0.topic_position:0
updated_atDate/Time RangeMatches the creation or last edit time of this post.updated_at.gte:2 weeks ago
user_idLiteralMatches posts with the specified user_id. Anonymous users will never match this term.user_id:211190
forumLiteralMatches the short name for the forum this post belongs to.forum:meta