[davidnye]

Originally Posted by wilderf3353

I apologize in advance if this has been discussed -- I couldn't find it.

Here is the RSS Feed: http://readingeagle.com/feeds/all/newsrss.xml

I only get the first few lines of each article...

I'm having the same problem with getting The Progressive magazine at http://feeds.feedburner.com/progressivefeed. The problem is that the feed returns the first few lines which are followed by "Read More" with the url for the whole article. I'm guessing this must not be an uncommon problem. I've tried setting use_embedded_content = True and using

def print_version(self, url):
return self.browser.open_novisit(url).geturl()

to no avail. How can I get my recipe to follow that Read More url? Is there a builtin recipe for another site that has the same problem that I could crib from? Maddeningly, there is a print version which downloads fine, but the url cannot be derived from the one for the non-print version because it uses a number unrelated to the original article title.