Author Topic: Stability Issues  (Read 15262 times)

0 Members and 1 Guest are viewing this topic.

Offline GeekMaster

  • Administrator
  • *****
  • Posts: 8437
    • Michael Bartmon Computer Services
Stability Issues
« on: September 01, 2010, 11:24:40 AM »
We seem to be experiencing more stability issues as time goes by.

I'm wondering if the messages table should be pruned.  That's the table that contains all of the posts and there are over 666,900 of them.

I would like to cut that number by 50% if possible.

I propose to remove threads that have had no replies for 90 days.

Give me a list of threads that you think should NOT be removed.  I have not yet decided when to do this so you have some time to think about it.

Thanks,
Mike
"They will have to pry the keyboard from my cold, dead fingers."

"You're only given a little spark of madness. You mustn't lose it."  Robin Williams

"I would rather not understand things than be certain about something that is wrong." Feynman

one strange sentence

  • Guest
Re: Stability Issues
« Reply #1 on: September 01, 2010, 11:38:13 AM »
"Is this an issue of bandwidth or the level of service at which your database exists?" he asked, dimly aware of certain considerations but not really knowing a fucking thing about databases. "What I'm getting at is, if even fifty people were to pony up even five or ten bucks apiece, would that et you operate at a higher level?

"That said, I wouldn't have a problem with pruning topics older than X number of days," he added. "If I find myself desperate to unearth all of my old offensive remarks and such I can use the WayBack Machine."

longpig

  • Guest
Re: Stability Issues
« Reply #2 on: September 01, 2010, 11:40:33 AM »
"What I'm getting at is, if even fifty people were to pony up even five or ten bucks apiece, would that et you operate at a higher level?
I'd be up for that.

This could be a fun trawl through classic threads. :d
I think we should keep this one http://chrunners.net/forum/index.php?topic=37544.0

Belgian Lace

  • Guest
Re: Stability Issues
« Reply #3 on: September 01, 2010, 12:00:38 PM »
Prune after 90 days.

Otherwise, we'll all turn into a bunch of imaginary hoarders.

Let them go.

Offline GeekMaster

  • Administrator
  • *****
  • Posts: 8437
    • Michael Bartmon Computer Services
Re: Stability Issues
« Reply #4 on: September 01, 2010, 12:04:49 PM »
Quote
Is this an issue of bandwidth or the level of service at which your database exists?

"Yes", the GeekMeister replied, "those are always factors to consider."

"But", the High Priest of Geekdom continued, "It is more likely that the causes lie in our stars or, rather, elsewhere. Given that optimizing tables or restarting the MYSQL daemon often fixes the immediate problems I would say that the major issues are within the database."

"So", His Most Holy of Holy and Grand TechnoBabbleGivers proclaimed, "there will be blood of the database variety."



"They will have to pry the keyboard from my cold, dead fingers."

"You're only given a little spark of madness. You mustn't lose it."  Robin Williams

"I would rather not understand things than be certain about something that is wrong." Feynman

Offline AVP

  • I really have a life. It's around here someplace....
  • ****
  • Posts: 4960
    • Chloe + Isabel by Melissa
Re: Stability Issues
« Reply #5 on: September 01, 2010, 12:47:14 PM »
I'd be up for that.
This could be a fun trawl through classic threads. :d
I think we should keep this one http://chrunners.net/forum/index.php?topic=37544.0
Damn you Andy! I knew this would link to the THC thread, I knew it.
But you wrote "trawl" instead of "crawl", so I was hoping it wouldn't be that link.
Talk about "stability issues".
Andy, they even talked about it on The Emmy Awards! I was all "ahhhhh"!

 :bow2: Mike, Sir CH, O Captain My Captain,
I have zero clue what "levels of database and bandwiths" are.
I've only been here about 9 months, so my opinion doesn't really count.
Obviously I love it here, I would be willing to pay.
But, my thought would be to delete the threads that have had no reply in 365 days, NOT 90 days.
« Last Edit: September 01, 2010, 12:50:51 PM by AVP »
"Her Miami Heat obsession is obnoxious to the point of being endearing." -Brainwashed Troglodyte

one strange sentence

  • Guest
Re: Stability Issues
« Reply #6 on: September 01, 2010, 12:51:05 PM »
But, my thought would be to delete the threads that have had no reply in 365 days, NOT 90 days.

"180 days," he bargained devlishly, aware that he was negotiating with a pair of Jews and that this was akin to trying to outmaneuver LeBron in the paint.

Offline AVP

  • I really have a life. It's around here someplace....
  • ****
  • Posts: 4960
    • Chloe + Isabel by Melissa
Re: Stability Issues
« Reply #7 on: September 01, 2010, 12:52:37 PM »
"180 days," he bargained devlishly, aware that he was negotiating with a pair of Jews and that this was akin to trying to outmaneuver LeBron in the paint.
I AM ROARING WITH LAUGHTER!
"Her Miami Heat obsession is obnoxious to the point of being endearing." -Brainwashed Troglodyte

Offline AVP

  • I really have a life. It's around here someplace....
  • ****
  • Posts: 4960
    • Chloe + Isabel by Melissa
Re: Stability Issues
« Reply #8 on: September 01, 2010, 12:56:05 PM »
Otherwise, we'll all turn into a bunch of imaginary hoarders...

...with imaginary friends, living in an imaginary clubhouse with our very own imaginary reality show.  :hug:
"Her Miami Heat obsession is obnoxious to the point of being endearing." -Brainwashed Troglodyte

Belgian Lace

  • Guest
Re: Stability Issues
« Reply #9 on: September 01, 2010, 01:55:20 PM »
Whatever you do, please consider deleting the "Last Post Wins" thread now.

Offline gebuh

  • The Runners
  • ******
  • Posts: 21045
  • don't worry, I'm a doctor
    • cycle touring
Re: Stability Issues
« Reply #10 on: September 01, 2010, 02:05:38 PM »
what about archiving data over a certain age to a different table?

Offline GeekMaster

  • Administrator
  • *****
  • Posts: 8437
    • Michael Bartmon Computer Services
Re: Stability Issues
« Reply #11 on: September 01, 2010, 02:16:06 PM »
what about archiving data over a certain age to a different table?

We could do a dump of the db before the trim (good practice anyway) and keep that forever, even create a separate db to make it easy to retrieve items.  I really want to get the total size of the online database cut way down.
"They will have to pry the keyboard from my cold, dead fingers."

"You're only given a little spark of madness. You mustn't lose it."  Robin Williams

"I would rather not understand things than be certain about something that is wrong." Feynman

Offline this place is so lame

  • The Runners
  • ******
  • Posts: 4576
Re: Stability Issues
« Reply #12 on: September 01, 2010, 05:04:00 PM »
I propose to remove threads that have had no replies for 90 days.

Well that take out about half of my arsenal.   :sigh:
Every liberal principle I have that tells me to respect diversity of opinion is immediately quashed by the knowledge that I would, in the event of being among a group of air accident survivors, argue that we eat the people who like LOLcats first.

LilyLily

  • Guest
Re: Stability Issues
« Reply #13 on: September 01, 2010, 05:13:18 PM »
Whatever you do, please consider deleting the "Last Post Wins" thread now.

This! 

or

1!

or

I agree that thread sucks.

longpig

  • Guest
Re: Stability Issues
« Reply #14 on: September 01, 2010, 05:27:44 PM »
Whatever you do, please consider deleting the "Last Post Wins" thread now.
That frakker should have died with the rest of the PRT.

Damn you Andy! I knew this would link to the THC thread, I knew it.
But you wrote "trawl" instead of "crawl", so I was hoping it wouldn't be that link.
It's a CH classic. :D  And I'm hoping that this thread will bring up juicy threads that you and I weren't here to witness. So far, no joy. Go and bump my poor 'Save our threads' thread. Please? :-*

Offline GeekMaster

  • Administrator
  • *****
  • Posts: 8437
    • Michael Bartmon Computer Services
Re: Stability Issues
« Reply #15 on: September 01, 2010, 05:29:28 PM »
This! 

or

1!

or

I agree that thread sucks.

I posted an announcement to that effect in that thread causing gnashing of teeth and pulling of hair.

I will announce the locking of the thread an hour or two ahead of time, lock it, let the last poster have a couple of seconds of empty triumph and then delete it.

"They will have to pry the keyboard from my cold, dead fingers."

"You're only given a little spark of madness. You mustn't lose it."  Robin Williams

"I would rather not understand things than be certain about something that is wrong." Feynman

Offline AVP

  • I really have a life. It's around here someplace....
  • ****
  • Posts: 4960
    • Chloe + Isabel by Melissa
Re: Stability Issues
« Reply #16 on: September 01, 2010, 08:14:52 PM »
I will announce the locking of the thread an hour or two ahead of time, lock it, let the last poster have a couple of seconds of empty triumph and then delete it.

"It's good to be the king." -Mel
"Her Miami Heat obsession is obnoxious to the point of being endearing." -Brainwashed Troglodyte

Offline Hobie1

  • I Can't now, I'm Busy Posting
  • ***
  • Posts: 3627
Re: Stability Issues
« Reply #17 on: September 01, 2010, 08:52:43 PM »
Take all the really shitty threads and post them in the PRT en masse.
“It’s easier to fool people than convince them they have been fooled.”

-Mark Twain

Offline kemibe

  • The Runners
  • ******
  • Posts: 10897
Re: Stability Issues
« Reply #18 on: September 07, 2010, 09:24:05 AM »
I'm thinking based on my limited knowledge of relevant issues that keeping the number of server requests/database queries down might keep disruptions to a minimum. That could mean doing things that would be effective but possibly unpopular, like requiring people to log in before they can so much as read the board, ditching the proprietary search engine in favor of a site-specific (and free) Google one like many sites have, and dispensing of extraneous features that rustle the DB such as who's logged on and other stats most could do without. Just a thought.

Offline GeekMaster

  • Administrator
  • *****
  • Posts: 8437
    • Michael Bartmon Computer Services
Re: Stability Issues
« Reply #19 on: September 07, 2010, 09:31:05 AM »
I'm thinking based on my limited knowledge of relevant issues that keeping the number of server requests/database queries down might keep disruptions to a minimum. That could mean doing things that would be effective but possibly unpopular, like requiring people to log in before they can so much as read the board, ditching the proprietary search engine in favor of a site-specific (and free) Google one like many sites have, and dispensing of extraneous features that rustle the DB such as who's logged on and other stats most could do without. Just a thought.

Quite right.

In fact, as we post I am investigating an apache issue.  It seems to run out of memory as the number online reaches about 60.  I have made the configuration changes that I can to reduce apache resource usage but the log shows it continuing to happen.

I created a support ticket to see if the host can do something on the system configuration side.

As for the database [fingers crossed] since the trim, there have been no crashes [/fingers crossed].  While it is too soon to say that the trim eliminated them, for the moment that factor has been addressed.
"They will have to pry the keyboard from my cold, dead fingers."

"You're only given a little spark of madness. You mustn't lose it."  Robin Williams

"I would rather not understand things than be certain about something that is wrong." Feynman

 

+-SUPPORT US

Powered by EzPortal