Register Guidelines E-Books Search Today's Posts Mark Forums Read

Go Back   MobileRead Forums > E-Book Software > Calibre > Recipes

Notices

Reply
 
Thread Tools Search this Thread
Old 04-03-2022, 06:52 PM   #1
etmurphy
Emmet Murphy
etmurphy began at the beginning.
 
Posts: 2
Karma: 10
Join Date: Apr 2022
Location: San Francisco, CA, USA
Device: Kindle Oasis
Question WSJ downloads all links, but not all articles

Starting about a week ago (i.e. around March 26, 2022) the WSJ recipe downloads all links to articles in the Table of Contents, but does not actually download some of the articles. Typically the missing articles are the first three or four titles from the Front Page, U.S. News and World News sections. Fortunately the Opinion section has been reliably downloading all articles.

For example in the latest download from April 2, 2022 the following Front Page titles are included or not included (in this case every other one of the first six articles are missing):

- Ukraine Strikes Inside Russian Territory, Russians Say (missing)
- Russian Strategy in Ukraine Shifts After Setbacks, and a Lengthy War Looms (included)
- Roman Abramovich's Abrupt Transformation From Shunned Oligarch to Wartime Envoy (missing)
- They Attend Duke. And North Carolnia. Gulp. (included)
- Amazon Workers in New York Vote to Form Tech Giant's First U.S. Union (missing)
- U.S. March Jobs Report Shows Strong Hiring Momentum (included)
- Marketing Maverick Pitched Laser Mousetrap and Bone Fone Radio (included)
- Alex Mandl, Who Gave Up a Top AT&T Job to Lead a Startup, Has Died at Age 78 (included)
- Bar Code Pioneer Proved the Technology Was Robust (included)

Has anyone else experienced this problem or have ideas what might be the cause?
etmurphy is offline   Reply With Quote
Old 04-04-2022, 12:43 AM   #2
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 41,239
Karma: 18286997
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
Post the urls to some of these missing articles.
kovidgoyal is offline   Reply With Quote
Advert
Old 04-04-2022, 11:52 AM   #3
kaldrichjr
Junior Member
kaldrichjr began at the beginning.
 
Posts: 1
Karma: 10
Join Date: Apr 2022
Device: Kindle Paperwhite
Having same issue with both WSJ and New York Times recipes.

A couple examples of articles that are not dowloaded:
https://www.wsj.com/articles/egg-pri...ss_featst_pos1

https://www.wsj.com/articles/alaska-...ness_lead_pos7

The table of contents for each article will link to this article:
https://www.wsj.com/articles/hypebea...ts_pos2&page=1

Similar with NYT as well.
kaldrichjr is offline   Reply With Quote
Old 04-04-2022, 12:24 PM   #4
etmurphy
Emmet Murphy
etmurphy began at the beginning.
 
Posts: 2
Karma: 10
Join Date: Apr 2022
Location: San Francisco, CA, USA
Device: Kindle Oasis
Monday, April 4 World News missing articles

Quote:
Originally Posted by kovidgoyal View Post
Post the urls to some of these missing articles.
In the Monday, April 4 edition the first four Front Page articles are missing and all of the World News section. I cannot find the RSS Feed list of articles for the former, but following is the list page and URLs for the missing World News articles:

https://feeds.a.dj.com/rss/RSSWorldNews.xml

https://www.wsj.com/articles/oil-gas...pe-11649086062

https://www.wsj.com/articles/shangha...ts-11649053546

https://www.wsj.com/articles/release...ia-11649070001

https://www.wsj.com/articles/costa-r...on-11649073557

https://www.wsj.com/articles/the-wor...on-11649064601

The list page XML is also attached (since it will eventually cycle to tomorrow's listing).

Thank you for your help!
Attached Files
File Type: xml RSSWorldNews-April-4-2022.xml (5.0 KB, 64 views)
etmurphy is offline   Reply With Quote
Old 04-04-2022, 10:06 PM   #5
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 41,239
Karma: 18286997
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
https://github.com/kovidgoyal/calibr...78c436a8a69b65

THe site seems to be in the middle of a transition to a new architecture, so there may be continuing issues till the transition is complete.
kovidgoyal is offline   Reply With Quote
Advert
Old 04-11-2022, 11:08 PM   #6
magneticsubset
Junior Member
magneticsubset began at the beginning.
 
Posts: 7
Karma: 10
Join Date: Jan 2021
Device: Kindle Paperwhite
Quote:
Originally Posted by kovidgoyal View Post
https://github.com/kovidgoyal/calibr...78c436a8a69b65

THe site seems to be in the middle of a transition to a new architecture, so there may be continuing issues till the transition is complete.
I used your updates and the recipie is not downloading the full articles. I have a wsj account. Today and yesterday for Frontpage it downloads just the first two paragraphs for all the articles.
magneticsubset is offline   Reply With Quote
Old 04-11-2022, 11:27 PM   #7
magneticsubset
Junior Member
magneticsubset began at the beginning.
 
Posts: 7
Karma: 10
Join Date: Jan 2021
Device: Kindle Paperwhite
Upon further review there articles throughout the download that are just the first two paragraphs not just on the first page.
magneticsubset is offline   Reply With Quote
Old 04-12-2022, 01:09 AM   #8
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 41,239
Karma: 18286997
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
It will download two paragraphs if you are using the non-subscription recipe.
kovidgoyal is offline   Reply With Quote
Old 04-12-2022, 07:02 AM   #9
magneticsubset
Junior Member
magneticsubset began at the beginning.
 
Posts: 7
Karma: 10
Join Date: Jan 2021
Device: Kindle Paperwhite
Quote:
Originally Posted by kovidgoyal View Post
It will download two paragraphs if you are using the non-subscription recipe.
I am using the subscription recipie, I have a subscription and put in my login info. 60 - 80% of the articles fully downloaded. All the articles from the Frontpage on 4/10, 4/11, 4/12 and other sections had them spread out with the first two paragraphs.
magneticsubset is offline   Reply With Quote
Old 04-12-2022, 07:07 AM   #10
magneticsubset
Junior Member
magneticsubset began at the beginning.
 
Posts: 7
Karma: 10
Join Date: Jan 2021
Device: Kindle Paperwhite
Today, the Frontpage Elon musk article, Ukraine zelensky and Moscow central banker articles didn't go past two paragraphs but the new relief article and investors turn cautious downloaded the whole article. Haven't gone past the front page section. Also is not the what's news section I know those are short this was frontpage.
magneticsubset is offline   Reply With Quote
Old 05-01-2022, 03:51 PM   #11
mjfriedman
Enthusiast
mjfriedman began at the beginning.
 
Posts: 47
Karma: 10
Join Date: Dec 2010
Device: Kindle Oasis
I continue to experience this issue and am using subscriber recipe with my credentials entered.
mjfriedman is offline   Reply With Quote
Old 05-01-2022, 10:28 PM   #12
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 41,239
Karma: 18286997
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
Well PM me your login details and the URLs for some articles that dont work an dI will see if I can reproduce.
kovidgoyal is offline   Reply With Quote
Old 05-06-2022, 08:24 AM   #13
mjfriedman
Enthusiast
mjfriedman began at the beginning.
 
Posts: 47
Karma: 10
Join Date: Dec 2010
Device: Kindle Oasis
Sending credentials now. For today's paper, I receive the entire first article "Dow, S&P 500 Slide," but only the first two paragraphs of the second, "Inside Ukraine's Besieged Azovstal Steel Plant."
mjfriedman is offline   Reply With Quote
Old 05-17-2022, 03:16 PM   #14
ddavtian
Addict
ddavtian has a complete set of Star Wars action figures.ddavtian has a complete set of Star Wars action figures.ddavtian has a complete set of Star Wars action figures.ddavtian has a complete set of Star Wars action figures.
 
Posts: 269
Karma: 332
Join Date: Nov 2003
Location: San Francisco, USA
Device: Sage, Elipsa, Oasis, Galaxy Tab 8U, S22U
Kovid, did you get credentials for testing? If you need again, I can send mine to you. Last few days it was not downloading anything from WSJ. Today almost all articles have only first 2 paragraphs downloaded.
ddavtian is offline   Reply With Quote
Old 05-17-2022, 08:44 PM   #15
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 41,239
Karma: 18286997
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
Yes I got them, but I am travelling, so looking at this is rather difficult for me till I return.
kovidgoyal is offline   Reply With Quote
Reply

Tags
calibre, wsj, wsj.com

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Saving articles from news downloads sparks56 Calibre 1 02-17-2017 09:46 PM
How to insert links between articles? oecherprinte Recipes 3 11-27-2013 04:37 AM
ReadItLater recipe only downloads 10 saved articles? usuario74 Recipes 1 02-20-2011 04:24 PM
calibre only downloads some articles from FT St28 Recipes 0 01-21-2011 09:25 AM
Sharing/saving articles in news downloads for Kindle f1nkster Calibre 4 07-28-2010 01:53 PM


All times are GMT -4. The time now is 07:21 PM.


MobileRead.com is a privately owned, operated and funded community.