I have some really large pages. I know that. I have pushed the memory to 1296.

But some of the pages can be 1500k in size. Too many pictures I guess.

Ok, so what can I do, or how can I diaganose it better or clean up memory?

I know you have stated that the PLUCKER memory manager is not very efficient. Any other help?

I keep geting now this error message
unhandled response: HTTP /1.1 400 Bbad Request

"400 Bad Request" indicates an error at the server end, which should not have anything to do with memory usage. Which URL is this?

Incidentally, processing images does not contribute much to memory usage, since the image data is stored on disk in a temporary file.

I frequent the candle power forum. The link is
http://www.candlepowerforums.com/vb/

And if you can't tell they use
vBulletin Version 3.0.8
It seems that they work ok some times, but I have had to add more exceptions to the list to filter out links to keep the depth down. As it is, I am only crawling 1 deep. Might you be able to make any other suggestions so this does not get too memory hog like.

For example I have 1 link for each of the forums. I have color turned to 1 bit or 2 for most of the links. I have 40 topics per page set so I can crawl more topics from the first page. As it is I do maybe 9 forums and they are all mostly over 1 meg each so any suggestions to make them smaller would be great.