American Prospect recipe not working

[davidsmartin]

I ran the American Prospect recipe. It downloaded the titles of 25 articles but for each article there was only a notice about how to subscribe. I opened numerous articles on their webpage successfully so I am not sure what happened. I hope the author or someone else can fix it.

Thanks,

David

[sexymax15]

Originally Posted by davidsmartin

I ran the American Prospect recipe. It downloaded the titles of 25 articles but for each article there was only a notice about how to subscribe. I opened numerous articles on their webpage successfully so I am not sure what happened. I hope the author or someone else can fix it.

Thanks,

David

They stopped providing free rss now you will need subscribe for 14.99$.

[davidsmartin]

They have the full text of their stories on their web site for free. Is it difficult for a recipe to collect the stories from the website instead of from rss?

[sdow1]

I still can't download the American Prospect, and ran into this thread when trying to figure out the problem.

The response from sexymax15 doesn't make any sense, as I can access the RSS feed just fine through google reader, and clicking through the link takes me directly to the full articles - no subscription required. But the recipe itself still returns nothing but a table of contents and then a bunch of empty sections.

[Starson17]

Originally Posted by sdow1

I still can't download the American Prospect, and ran into this thread when trying to figure out the problem.

The response from sexymax15 doesn't make any sense, as I can access the RSS feed just fine through google reader, and clicking through the link takes me directly to the full articles - no subscription required. But the recipe itself still returns nothing but a table of contents and then a bunch of empty sections.

They may permit free access through Google, but not directly. Have you tried going to the RSS feed directly? Why not use the Greader recipe if it works in Greader?

[a.peter]

Originally Posted by sdow1

But the recipe itself still returns nothing but a table of contents and then a bunch of empty sections.

I took a look at the recipe. It seems that the page structure changed. The regular expressions were a little bit greedy and removed nearly the whole page.

I've modified the recipe to use keep_only_tags and remove_tags to clean up the pages. The result now contains the articles.

aprospect.recipe.txt

[Kevin8or]

Originally Posted by a.peter

I've modified the recipe to use keep_only_tags and remove_tags to clean up the pages. The result now contains the articles

If a.peter's modification repairs the recipe, could it please be included in a future calibre update along with other "improved news sources"? The built-in recipe still downloads only a table of contents.

Thank you to everyone who's effort and skills make the news feature such a great part of calibre.

[Kevin8or]

Thank you.

(Fix was included in latest update.)