Problem with Multi-file News Articles

[rozen]

Hi,

How does one get Fetch News to handle news articles which are spread across more than one URL? I would really like to fetch and read the news articles from Businessweek. However, almost all of the articles that appear in the menus have no content. It appears that the ones that have no contents are spread across several web pages, i. e., at the bottom of the web page it they have links to other pages of the article; the ones that do have content are single web pages. I noticed that many fetches say that maximum recursion levels are exceeded by increasing "recursions" to 100 does not yield content.

I would appreciate any suggestions. I am running version 0.8.21 on Linux Mint 11.

Thanks in Advance,
Don

Moderator Notice
Thread moved to Recipe subforum.

[Starson17]

Originally Posted by rozen

How does one get Fetch News to handle news articles which are spread across more than one URL?

If the feed points to multiple URLs, it's done automatically. If the article points to other URLs, you use recursions. See here.

I noticed that many fetches say that maximum recursion levels are exceeded by increasing "recursions" to 100 does not yield content.

Note that this seldom works very well. Each web site is designed uniquely, and to get it to display well, you need to control the tags from the site. Grabbing content from multiple sites means it's hard to know enough in advance to control the tags. If you are using any of the multiple keep or remove tag control options, you can try turning them off to see the content.

You may wish to read this for a detailed approach to handling multiple site recipes using auto_cleanup.