View Single Post
Old 09-12-2010, 02:49 AM   #2700
TonytheBookworm
Addict
TonytheBookworm is on a distinguished road
 
TonytheBookworm's Avatar
 
Posts: 264
Karma: 62
Join Date: May 2010
Device: kindle 2, kindle 3, Kindle fire
Quote:
Originally Posted by cynvision View Post
Ah yes. I'm still not comfortable with how the multiple page link following works. You'd have to follow the 'more articles' link at least once to get more than one article from that author.
I'll work on it tomorrow after the football games go off. I think I know how to solve it. Look at the down to earth recipe I posted. I think the same idea would work for this.
Basically take and parse the page for href's and put them in the soup. Then turn around and take that soup and parse it again and search using the re.compile that I already have in this. If you can't figure it out I'll see what I can come up with tomorrow. But it is 3am where I'm at and i'm tired zzzzzzzz
TonytheBookworm is offline