NMP crashing when performing scheduled PowerPurge

IYQ2

NMP appears to be crashing on me when performing a scheduled PowerPurge. I've got it set to download new headers at 1:00am and then perform a PowerPurge at 5:00am. When I leave for work at 6:00am I can see that a PowerPurge is running. However, when I get home after work NMP has shut down and when it restarts I get a warning notice that the program terminated unexpectedly and I have to do a repair. The repair runs, everything works fine, and then the problem repeats the next day. Any suggestions? Thanks!

administrator · Posted: Thu Feb 22, 2007 1:05 am Post subject:

Are there any errors recorded in the Errorlog files stored in NMP's UserAppData folder?

Are there any errors reported in MySQL's error log?

Have you tried running a PowerPurge while you are at the computer to see if it crashes then?

How much RAM do you have?

Regards

IYQ2 · Posted: Thu Feb 22, 2007 1:41 am Post subject:

Since posting this question, I've gone back to scratch with NMP and reloaded MySQL using the 4.x version rather than 5.x. The difference in performance is ASTOUNDING. It was dog slow before, now it's screaming so fast I can't believe it. I've got 1 Gig of RAM.

Couldn't see the folder you were talking about with the error files. Where would it be located?

Crossing my fingers and hoping this fixes the issues. Possibly, this was a SQL problem. With MySQL 5.x it took a very, very long time to process headers -- up to two or three DAYS if downloading headers for a large group. Now, it's processing headers almost as fast as they come in.

administrator · Posted: Thu Feb 22, 2007 2:30 am Post subject:

The UserAppData folder for NMP would be located:

BZB · Expert Joined: 26 Apr 2005 Posts: 1387

I've also been seeing these kinds of intermittent Powerpurge crashes, and NMP just bombs out at various points during the powerpurge, closing down without leaving anything in the logs. I think it's more likely to happen when you have more messages to purge.

administrator · Posted: Thu Feb 22, 2007 12:02 pm Post subject:

I really do think it is memory related. The original PowerPurge was a script written by one of our users that NMP passed to MySQL. The current PowerPurge has NMP performing the queries internally, so this may be where the problem is.

We'll have to re-examine the PowerPurge queries and see if some of them can be broken down into smaller queries or whether we should go back to using a script...

Regards

administrator · Posted: Thu Feb 22, 2007 8:23 pm Post subject:

We've added logging of the entire PowerPurge process to a log file for the next beta. This will allow those of you who are experiencing this issue to tell us exactly at what point the process is failing.

Regards

codethought · Experienced Joined: 12 Feb 2007 Posts: 63

Speaking of which, when will the next beta happen, anyway? Wink

administrator · Posted: Fri Feb 23, 2007 2:30 pm Post subject:

As soon as it's ready...

We are in the process of adding Par2 verification/repair and Rar extraction to the post processing engine.

The par2 stuff has been tested and seems to be working well. Last night was our first successful test of the Rar extraction.

The bigger issue with this is that the Post Processing engine never really got a lot of working out from users, so we've been trying to anticipate issues that will come up now that there is a good reason to learn how to use it.

Regards

codethought · Experienced Joined: 12 Feb 2007 Posts: 63

BinaryTB · Experienced Joined: 25 May 2005 Posts: 210

BinaryTB · Experienced Joined: 25 May 2005 Posts: 210

Nevermind...

Just ran PowerPurge with about ~40k headers in the trash, bam, NMP crashes silently. Upon starting it up again I get a Repair option. I never did try it with that many headers in my trash after the reinstall. Back to background purging.

Kinda ironic that the crash actually happened after I posted about it not happening on my system anymore. How poltergeist-y.

administrator · Posted: Sun Feb 25, 2007 6:55 am Post subject:

Very strange. I regularly run PowerPurge with 200,000+ headers in the Trash...never a crash.

It's got to be something peculiar that we just can't see. Hopefully the new PowerPurge logging will give some direction.

Regards

BinaryTB · Experienced Joined: 25 May 2005 Posts: 210

Crash with 2.7.0.0:

administrator · Posted: Sat Apr 07, 2007 9:17 pm Post subject:

How much RAM do you have on your machine?

Regards