Troubleshooting slow user recipes

[Locarno]

I have a few user recipes that have 5-15 RSS feeds in them, and they simply take too long to fetch (some up to an hour). I would presume that one or two feeds are slow to fetch because of the nature of their site setup, server issues, or feed setup, but I'm not sure.

How would I go about troubleshooting these recipes to find out the problem feeds or otherwise figure out how to fix my recipe? My first thought was to look through the "job details" log, but there are no timestamps in there or other info to show me the slow steps. Any hints? Anything else I should try to speed these up?

[kovidgoyal]

You can implement populate_article_metadata in the recipe and have it print out a timestamp alongwith the article title/url for debugging

[TechnoCat]

Run them at the command line where you can see what's happening. e.g.
\Program Files\Calibre2\ebook-convert.exe" myrecipe.recipe .epub --test -vv --debug-pipeline debug

[Locarno]

Originally Posted by kovidgoyal

You can implement populate_article_metadata in the recipe and have it print out a timestamp alongwith the article title/url for debugging

Thanks Kovid. Where do I do this? I tried adding "populate_article_metadata = 1" to the class in advanced mode, but that didn't seem to do anything.

[kovidgoyal]

    def populate_article_metadata(article, soup, first):
          print (time.time(), article.title)

[Locarno]

Originally Posted by kovidgoyal

    def populate_article_metadata(article, soup, first):
          print (time.time(), article.title)

OK, I added this to the very beginning of my class, but still nothing. What else do I need to do? Here is my recipe:

class OPML2PY_1326333899(BasicNewsRecipe):
	def populate_article_metadata(article, soup, first):
		print (time.time(), article.title)
	
	title          = u'Baseball'
	oldest_article = 2
	max_articles_per_feed = 100
	populate_article_metadata = 1

	feeds          = [
		(u'38 Pitches', u'http://38pitches.com/feed/'), 
		(u'A Fans View', u'http://www.startribune.com/rss/?did=78693312'), 
	....
	]