Re: [pepysdiary] Site News: Recent Activity page problems
Sounds like a good compromise. Given the number of annotations over the time period the site has been up, and the resulting size of the DB, I'm surprised this hasn't happened sooner! As always, thanks for your hard work on the site, Phil.
--- On Sat, 1/21/12, Phil Gyford <lists@...> wrote:
From: Phil Gyford <lists@...>
Subject: [pepysdiary] Site News: Recent Activity page problems
Date: Saturday, January 21, 2012, 9:36 AM
[An update on what I was posting to this list above over the past few days...]
Recent Activity page problems
You may have noticed that the Recent Activity <http://www.pepysdiary.com/recent/> page has been problematic this past week, with the lists of recently-commented-on pages disappearing. It's all back now, and working OK, but it won't be updating as frequently as it used to.
The problem was that generating one of those lists took the database four or five minutes, and while this was happening many other operations were held up. It has been the case that whenever a new annotation was posted then the appropriate list would update immediately. Which, of course, meant that every single new annotation required the database to do nothing else for a few minutes.
I've looked into ways of making this operation more speedy but it looks like there's no easy way to do so. The only option for this to happen more quickly is to move this website to a more high-powered webserver -- which would be good, but this far into the Diary, and so close to the end, I'm not keen to make such a drastic move!
So for now we have a compromise: The Recent Activity page is back, but it will now only update once per hour. Occasionally you might notice some things slowing down a lot, but it will be rare. This will also, hopefully, mean that posting annotations will be faster than it used to be ("that's not hard" you might be thinking!).
As ever, let me know if you notice anything particularly wrong, and thanks for your patience.