Hi Kovid,
I am building a feed from seekingalpha.com. One thing I like is to include the "comments" from reader. I have tried very options and can not get this to work.
Here is my situation:
1> Recipe file is in below
2> I run this in the debug mode, and check the "input" folder: the "comments" are not part of the html file at all.
3> I tried with commenting out all the keep_only_tag.append below. That will leave the keep_only_tag as "". the comments still not appear in the html file
4> I open the webpage and "view page source", the "comments" are not as part of the source.
5> However, when I exam with firebug, "comments" are there.
6> When I save the web page, the "comments" are there.
7> you may check out this page:
http://seekingalpha.com/article/6431...nk?source=feed
What did I do wrong? Am I missing something?
I need some direction on this, please!
Regards,
class AdvancedUserRecipe1335053294(BasicNewsRecipe):
title = u'SA RSS'
no_stylesheets = True
use_embedded_content = False
remove_javascript = True
auto_cleanup = False
keep_only_tags = []
remove_tags = []
# heading
keep_only_tags.append(dict(name='div', attrs={'id':'page_header'}))
# author profile
keep_only_tags.append(dict(name='div', attrs={'class':'the_pic'}))
keep_only_tags.append(dict(name='div', attrs={'class':'followup_contributor_info_text'}))
keep_only_tags.append(dict(name='div', attrs={'class':'author_info_nav'}))
keep_only_tags.append(dict(name='div', attrs={'class':'user_followers_following'}))
# article body
keep_only_tags.append(dict(name='div', attrs={'id':'article_body'}))
# comments
# keep_only_tags.append(dict(name='div', attrs={'id':'content_follow_up'}))
# keep_only_tags.append(dict(name='div', attrs={'class':'comments_with_more'}))
# keep_only_tags.append(dict(name='div', attrs={'id':'comments_section'}))
# keep_only_tags.append(dict(name='div', attrs={'id':'comments'}))
# keep_only_tags.append(dict(name='ul', attrs={'id':'talkback_list'}))
# keep_only_tags.append(dict(name='div', attrs={'id':'comment_container'}))
# keep_only_tags.append(dict(name='div', attrs={'class':'base_level'}))
# keep_only_tags.append(dict(name='div', attrs={'class':'com_cont'}))
feeds = [(u'Most Popular Articles', u'http://seekingalpha.com/listing/most-popular-articles.xml')]