[Steven630]

Originally Posted by kovidgoyal

Use the source, Luke: http://bazaar.launchpad.net/~kovid/c.../feeds/news.py in particular look at the is_link_wanted() function.

Thanks. But seems that the next-page link on the last page cannot be simply filtered out since it's identical to previous links (just that it's redundant).

Speaking of 'print', will something like this do?

    def append_page(self, soup, appendtag, position):
        pager = ...
        if pager:
           self.log('Found pager')
...

Still, it failed to find the pager in the first place.

Could it be possible that the "soup" in index-parsing and the "soup" in append_page are confused? (So it's looking for the pager in the index page rather than the article page)