Quote:
Originally Posted by marbs
so if i do br.open (the 1st site) and then
br.open (the second site), that should work, as far as i can tell.
what is happening, is just visiting in the 1st site is enough to let me in to the second.
|
I did a quick test with cookies cleared, and that seems correct.
As long as we're covering all the gory details, note that although cookies are handled transparently, the Referer header is not (that's the correct spelling for the referrer header). You have to deal with that manually, if it's needed. (In this case, it seems to not be important.) You can also handle cookies manually, should you need to (I never have) and sometimes you may need to add other headers that are not added by default (Accept headers are sometimes needed to satisfy the Bad Behavior blog plugin).
Finally, the ignore robots.txt is turned on in Calibre by default when it uses Mechanize.
There's no substitute for a careful analysis of how the site responds and what it needs to give you what you're looking for.
It looks like you're on the right road!