View Single Post
Old 03-02-2011, 08:31 PM   #43
ldolse
Wizard
ldolse is an accomplished Snipe hunter.ldolse is an accomplished Snipe hunter.ldolse is an accomplished Snipe hunter.ldolse is an accomplished Snipe hunter.ldolse is an accomplished Snipe hunter.ldolse is an accomplished Snipe hunter.ldolse is an accomplished Snipe hunter.ldolse is an accomplished Snipe hunter.ldolse is an accomplished Snipe hunter.ldolse is an accomplished Snipe hunter.ldolse is an accomplished Snipe hunter.
 
Posts: 1,337
Karma: 123455
Join Date: Apr 2009
Location: Malaysia
Device: PRS-650, iPhone
Quote:
Originally Posted by Starson17 View Post
I don't know if you will find it to be of any value, but defining Request objects, using cookiejars, addheader and add_header are used in a variety of recipes. Off the top of my head, the Economist and my Skeptic and GoComic recipes do some of those things.
I had assumed my searches of the source tree were including recipes when I was working through it. You just prompted me to double-check and I see the .recipe extension wasn't considered a text file type to search... I've fixed that, and I do see some useful examples there for general scraping code now. A couple initialize their own cookie jars, but apparently this website is fairly unique in it's ability to trip up mechanize, because none delete cookies or manipulate them the way I'm trying to do.
ldolse is offline   Reply With Quote