|
|
#1 |
|
Guru
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 735
Karma: 35936
Join Date: Apr 2011
Location: Shrewsury, MA
Device: Lenovo Android Tablet
|
customizing recipes
Is there a way to customize a recipe (in my case The Boston Globe) so that it only downloads articles from that day? The std recipe is downloading articles from up to a few days earlier, so I see the same thing I saw yesterday.
|
|
|
|
|
|
#2 |
|
creator of calibre
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 45,609
Karma: 28549044
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
|
You would need to modify parse_section to check the date and ignore tool old articles.
|
|
|
|
| Advert | |
|
|
|
|
#3 |
|
Guru
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 735
Karma: 35936
Join Date: Apr 2011
Location: Shrewsury, MA
Device: Lenovo Android Tablet
|
I found this but I don't see anything that looks like the date...
def parse_index(self): feeds = [] for sec in 'metro sports nation world business opinion lifestyle arts'.split(): articles = list(parse_section(self.index_to_soup(absolutize_u rl('/' + sec), raw=True).decode('utf-8'))) if articles: self.log(sec.capitalize()) self.log(pprint.pformat(articles)) feeds.append((sec.capitalize(), articles)) if self.test: del articles[self.test[1]:] if len(feeds) >= self.test[0]: break |
|
|
|
|
|
#4 |
|
creator of calibre
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 45,609
Karma: 28549044
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
|
parse_section not parse_index and there will be no date there already, you will have to search for it in the dtructure parse_section is parsing.
|
|
|
|
|
|
#5 | |
|
Guru
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 735
Karma: 35936
Join Date: Apr 2011
Location: Shrewsury, MA
Device: Lenovo Android Tablet
|
Quote:
def parse_section(raw_html): data = extract_json(raw_html)['content-feed'] def text(e): if not e: return '' return e.get('basic') or e.get('native', '') but I have no idea how to modify per your suggestion. |
|
|
|
|
| Advert | |
|
|
|
|
#6 |
|
creator of calibre
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 45,609
Karma: 28549044
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
|
|
|
|
|
|
|
#7 | |
|
Guru
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 735
Karma: 35936
Join Date: Apr 2011
Location: Shrewsury, MA
Device: Lenovo Android Tablet
|
Quote:
File "<string>", line 94, in parse_section NameError: name 'now' is not defined |
|
|
|
|
|
|
#8 |
|
creator of calibre
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 45,609
Karma: 28549044
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
|
Works fine for me. And there is no now at line 94 of the builting recipe.
|
|
|
|
|
|
#9 |
|
Guru
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 735
Karma: 35936
Join Date: Apr 2011
Location: Shrewsury, MA
Device: Lenovo Android Tablet
|
|
|
|
|
|
|
#10 |
|
Guru
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 735
Karma: 35936
Join Date: Apr 2011
Location: Shrewsury, MA
Device: Lenovo Android Tablet
|
Why does it still download old news when the std recipe has this command:
oldest_article = 1 # days, includes articles that were published no more than the specified number of days ago |
|
|
|
|
|
#11 |
|
Guru
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 735
Karma: 35936
Join Date: Apr 2011
Location: Shrewsury, MA
Device: Lenovo Android Tablet
|
|
|
|
|
|
|
#12 |
|
Guru
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 735
Karma: 35936
Join Date: Apr 2011
Location: Shrewsury, MA
Device: Lenovo Android Tablet
|
|
|
|
|
![]() |
|
Similar Threads
|
||||
| Thread | Thread Starter | Forum | Replies | Last Post |
| Customizing the library | centuryx476 | Library Management | 3 | 05-09-2013 10:31 PM |
| Free (iTunes) Tasting Chef's Recipes: Summer 2012 Cookbook [Enhanced Recipes] | ATDrake | Deals and Resources (No Self-Promotion or Affiliate Links) | 3 | 08-16-2012 12:15 AM |
| Asian Recipes - 50 Tasty & Easy Unique Exotic Recipes (With Images Of Each Dish And C | asiafoodguru | Self-Promotions by Authors and Publishers | 1 | 08-10-2012 06:01 AM |
| Customizing Calibre | lunixer | Calibre | 5 | 08-23-2010 02:21 PM |
| customizing built in recipes | jrasmussen | Calibre | 2 | 02-16-2010 12:26 AM |