MobileRead Forums
Register Guidelines E-Books Today's Posts Search

Go Back   MobileRead Forums > E-Book Software > Calibre > Library Management
Reload this Page Metadata download fail

Notices

Reply
 
Thread Tools Search this Thread
Old 11-02-2011, 01:22 PM   #1
lathom
Kindle user
lathom began at the beginning.
 
Posts: 22
Karma: 10
Join Date: Mar 2011
Location: Falls Church, VA
Device: Kindle
Metadata download fail
All my metadata downloads have started timing out and failing. I'm assuming it's because of a new proxy configuration at work, but I can get to all the underlying sites (amazon, etc). Can someone point me in the right direction based on the following job details?
Spoiler:

Code:
Starting job: Download metadata for 1 books 
Running identify query with parameters: 
{u'authors': [u'Norris, Frank'], u'identifiers': {}, u'timeout': 30, u'title': u'The Pit'} 
Using plugins: Fantastic Fiction, Goodreads, Google, Amazon.com, Overdrive 
The log from individual plugins is below 

****************************** Amazon.com ****************************** 
Request extra headers: [('User-agent', 'Mozilla/5.0 (Windows NT 5.2; rv:2.0.1) Gecko/20100101 Firefox/4.0.1')] 
Found 0 results 
Downloading from Amazon.com took 21.2419998646 
Failed to make identify query: u'http://www.amazon.com/s/?sort=relevanceexprank&field-author=Frank+Norris&field-title=Pit&search-alias=stripbooks&unfiltered=1'
Traceback (most recent call last):
  File "site-packages\calibre\ebooks\metadata\sources\amazon.py", line 601, in identify
  File "site-packages\mechanize-0.2.4-py2.7.egg\mechanize\_mechanize.py", line 199, in open_novisit
  File "site-packages\mechanize-0.2.4-py2.7.egg\mechanize\_mechanize.py", line 230, in _mech_open
  File "site-packages\mechanize-0.2.4-py2.7.egg\mechanize\_opener.py", line 193, in open
  File "site-packages\mechanize-0.2.4-py2.7.egg\mechanize\_urllib2_fork.py", line 344, in _open
  File "site-packages\mechanize-0.2.4-py2.7.egg\mechanize\_urllib2_fork.py", line 332, in _call_chain
  File "site-packages\mechanize-0.2.4-py2.7.egg\mechanize\_urllib2_fork.py", line 1142, in http_open
  File "site-packages\mechanize-0.2.4-py2.7.egg\mechanize\_urllib2_fork.py", line 1118, in do_open
URLError:  

******************************************************************************** 

****************************** Google ****************************** 
Request extra headers: [('User-agent', 'Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US) AppleWebKit/534.3 (KHTML, like Gecko) Chrome/6.0.472.63 Safari/534.3')] 
Found 0 results 
Downloading from Google took 336.246999979 
Failed to make identify query: u'http://books.google.com/books/feeds/volumes?q=intitle%3APit%2Binauthor%3AFrank+inauthor%3ANorris&max-results=20&min-viewability=none&start-index=1'
Traceback (most recent call last):
  File "site-packages\calibre\ebooks\metadata\sources\google.py", line 299, in identify
  File "site-packages\mechanize-0.2.4-py2.7.egg\mechanize\_mechanize.py", line 199, in open_novisit
  File "site-packages\mechanize-0.2.4-py2.7.egg\mechanize\_mechanize.py", line 230, in _mech_open
  File "site-packages\mechanize-0.2.4-py2.7.egg\mechanize\_opener.py", line 193, in open
  File "site-packages\mechanize-0.2.4-py2.7.egg\mechanize\_urllib2_fork.py", line 344, in _open
  File "site-packages\mechanize-0.2.4-py2.7.egg\mechanize\_urllib2_fork.py", line 332, in _call_chain
  File "site-packages\mechanize-0.2.4-py2.7.egg\mechanize\_urllib2_fork.py", line 1142, in http_open
  File "site-packages\mechanize-0.2.4-py2.7.egg\mechanize\_urllib2_fork.py", line 1118, in do_open
URLError:  

******************************************************************************** 

****************************** Overdrive ****************************** 
Request extra headers: [('User-agent', 'Mozilla/5.0 (Windows NT 5.2; rv:2.0.1) Gecko/20100101 Firefox/4.0.1')] 
Found 0 results 
Downloading from Overdrive took 21.4500000477 

******************************************************************************** 

****************************** Fantastic Fiction ****************************** 
Request extra headers: [('User-agent', 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; rv:2.0.1) Gecko/20100101 Firefox/4.0.1')] 
Found 0 results 
Downloading from Fantastic Fiction took 21.0340001583 
Querying: http://db.fantasticfiction.co.uk/cgi...t+Frank+Norris
Failed to make identify query
Traceback (most recent call last):
  File "calibre_plugins.fantastic_fiction.__init__", line 208, in identify
  File "site-packages\mechanize-0.2.4-py2.7.egg\mechanize\_mechanize.py", line 199, in open_novisit
  File "site-packages\mechanize-0.2.4-py2.7.egg\mechanize\_mechanize.py", line 230, in _mech_open
  File "site-packages\mechanize-0.2.4-py2.7.egg\mechanize\_opener.py", line 193, in open
  File "site-packages\mechanize-0.2.4-py2.7.egg\mechanize\_urllib2_fork.py", line 344, in _open
  File "site-packages\mechanize-0.2.4-py2.7.egg\mechanize\_urllib2_fork.py", line 332, in _call_chain
  File "site-packages\mechanize-0.2.4-py2.7.egg\mechanize\_urllib2_fork.py", line 1142, in http_open
  File "site-packages\mechanize-0.2.4-py2.7.egg\mechanize\_urllib2_fork.py", line 1118, in do_open
URLError:  

******************************************************************************** 

****************************** Goodreads ****************************** 
Request extra headers: [('User-agent', 'Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US) AppleWebKit/534.3 (KHTML, like Gecko) Chrome/6.0.472.63 Safari/534.3')] 
Found 0 results 
Downloading from Goodreads took 21.1019999981 
Querying: http://www.goodreads.com/search?sear...e=books&search[query]=The+Pit+Frank+Norris
Failed to make identify query: u'http://www.goodreads.com/search?search_type=books&search[query]=The+Pit+Frank+Norris'
Traceback (most recent call last):
  File "calibre_plugins.goodreads.__init__", line 112, in identify
  File "site-packages\mechanize-0.2.4-py2.7.egg\mechanize\_mechanize.py", line 199, in open_novisit
  File "site-packages\mechanize-0.2.4-py2.7.egg\mechanize\_mechanize.py", line 230, in _mech_open
  File "site-packages\mechanize-0.2.4-py2.7.egg\mechanize\_opener.py", line 193, in open
  File "site-packages\mechanize-0.2.4-py2.7.egg\mechanize\_urllib2_fork.py", line 344, in _open
  File "site-packages\mechanize-0.2.4-py2.7.egg\mechanize\_urllib2_fork.py", line 332, in _call_chain
  File "site-packages\mechanize-0.2.4-py2.7.egg\mechanize\_urllib2_fork.py", line 1142, in http_open
  File "site-packages\mechanize-0.2.4-py2.7.egg\mechanize\_urllib2_fork.py", line 1118, in do_open
URLError:  

******************************************************************************** 
The identify phase took 336.32 seconds 
The longest time (336.247000) was taken by: Google 
Merging results from different sources and finding earliest publication dates from the xisbn service 
We have 0 merged results, merging took: 0.00 seconds 
Failed to download metadata for The Pit
Last edited by Starson17; 11-02-2011 at 01:52 PM.
lathom is offline   Reply With Quote
Old 11-02-2011, 01:55 PM   #2
Starson17
Wizard
Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.
 
Posts: 4,004
Karma: 177841
Join Date: Dec 2009
Device: WinMo: IPAQ; Android: HTC HD2, Archos 7o; Java:Gravity T
Quote:
Originally Posted by lathom View Post
All my metadata downloads have started timing out and failing. I'm assuming it's because of a new proxy configuration at work, but I can get to all the underlying sites (amazon, etc). Can someone point me in the right direction based on the following job details?
Check your proxy settings in Windows, if that's what you're using. Can you get to the sites in Internet Explorer?
Starson17 is offline   Reply With Quote
Advert
Old 11-03-2011, 10:18 AM   #3
lathom
Kindle user
lathom began at the beginning.
 
Posts: 22
Karma: 10
Join Date: Mar 2011
Location: Falls Church, VA
Device: Kindle
Quote:
Originally Posted by Starson17 View Post
Check your proxy settings in Windows, if that's what you're using. Can you get to the sites in Internet Explorer?
I am using a proxy - but the IE settings themselves haven't changed. I suspect something on the proxy itself may have.

Yes, as I mentioned, I can get to all the underlying metadata websites directly via IE.

As another data point - Get Books now hangs as well.

Is there any chance there is some intermediary website or url that calibre is going through before it actually queries the metadata sites? I'm just trying to better understand the "Failed to make identify query" error.

-Andy
lathom is offline   Reply With Quote
Old 11-03-2011, 10:51 AM   #4
Starson17
Wizard
Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.
 
Posts: 4,004
Karma: 177841
Join Date: Dec 2009
Device: WinMo: IPAQ; Android: HTC HD2, Archos 7o; Java:Gravity T
Quote:
Originally Posted by lathom View Post
as I mentioned, I can get to all the underlying metadata websites directly via IE.
You mentioned you could get to those sites, but not whether you could get there with IE. IE obeys the proxy settings, like calibre. Other browsers may not, which might allow them to reach those sites, but not IE. Hence the question specifically about IE.

AFAIK, in the Windows environment calibre does nothing different from IE. There are several threads here about proxy problems, but I can't immediately recall any that match a Windows OS where IE works, but calibre does not. Sorry I can't help more, but if no one else pops in to comment, I'd search those proxy threads here and also see if any other programs ping, traceroute, other browsers etc. can match the calibre symptoms.
Starson17 is offline   Reply With Quote
Old 11-03-2011, 11:16 AM   #5
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 43,849
Karma: 22666666
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
You can check what proxies calibre is using via Preferences->Miscellaneous.
kovidgoyal is offline   Reply With Quote
Advert
Old 11-15-2011, 02:23 PM   #6
lathom
Kindle user
lathom began at the beginning.
 
Posts: 22
Karma: 10
Join Date: Mar 2011
Location: Falls Church, VA
Device: Kindle
Just a followup - it turns out that one of the metadata sites WAS being blocked by my company proxy and this was resulting in all metadata downloads (bulk and individual) timing out and failing completely. When I uncheck the blocked site (Goodreads), everything works fine.

Not sure if there is a design reason why one unreachable site can't be skipped and let the download from the rest continue. Alternatively, a failure message that references the problem site by name?

Thanks for all the great support! Calibre is amazing.
lathom is offline   Reply With Quote
Old 11-15-2011, 03:25 PM   #7
fyoung
Member
fyoung began at the beginning.
 
Posts: 18
Karma: 10
Join Date: Mar 2011
Device: kobo
It seems that I am having a similar issue with downloading metadata.
I have copied the error message below. I get this with every search I do.
Any ideas?

calibre, version 0.8.9
ERROR: No matches found: <p>Failed to find any books that match your search. Try making the search <b>less specific</b>. For example, use only the author's last name and a single distinctive word from the title.<p>To see the full log, click Show Details.

Starting download
Query: title:My Lucky Life in and Out of Show Business: A Memoir; authorsick Van Dyke; isbn:9780307592262
Running identify query with parameters:
{u'authors': [u'Dick Van Dyke'], u'identifiers': {u'isbn': u'9780307592262'}, u'timeout': 30, u'title': u'My Lucky Life in and Out of Show Business: A Memoir'}
Using plugins: Google, Amazon.com
The log from individual plugins is below

****************************** Amazon.com ******************************
Request extra headers: [('User-agent', 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; rv:2.0.1) Gecko/20100101 Firefox/4.0.1')]
Found 0 results
Downloading from Amazon.com took 21.3109998703
Failed to make identify query: u'http://www.amazon.com/s/?sort=relevanceexprank&search-alias=aps&field-isbn=9780307592262&unfiltered=1'
Traceback (most recent call last):
File "site-packages\calibre\ebooks\metadata\sources\amazon.py ", line 523, in identify
File "site-packages\mechanize-0.2.4-py2.7.egg\mechanize\_mechanize.py", line 199, in open_novisit
File "site-packages\mechanize-0.2.4-py2.7.egg\mechanize\_mechanize.py", line 230, in _mech_open
File "site-packages\mechanize-0.2.4-py2.7.egg\mechanize\_opener.py", line 193, in open
File "site-packages\mechanize-0.2.4-py2.7.egg\mechanize\_urllib2_fork.py", line 344, in _open
File "site-packages\mechanize-0.2.4-py2.7.egg\mechanize\_urllib2_fork.py", line 332, in _call_chain
File "site-packages\mechanize-0.2.4-py2.7.egg\mechanize\_urllib2_fork.py", line 1142, in http_open
File "site-packages\mechanize-0.2.4-py2.7.egg\mechanize\_urllib2_fork.py", line 1118, in do_open
URLError: <urlopen error [Errno 10060] A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond>

************************************************** ******************************

****************************** Google ******************************
Request extra headers: [('User-agent', 'Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.2.11) Gecko/20101012 Firefox/3.6.11')]
Found 0 results
Downloading from Google took 126.244999886
Failed to make identify query: u'http://books.google.com/books/feeds/volumes?q=isbn%3A9780307592262&max-results=20&min-viewability=none&start-index=1'
Traceback (most recent call last):
File "site-packages\calibre\ebooks\metadata\sources\google.py ", line 296, in identify
File "site-packages\mechanize-0.2.4-py2.7.egg\mechanize\_mechanize.py", line 199, in open_novisit
File "site-packages\mechanize-0.2.4-py2.7.egg\mechanize\_mechanize.py", line 230, in _mech_open
File "site-packages\mechanize-0.2.4-py2.7.egg\mechanize\_opener.py", line 193, in open
File "site-packages\mechanize-0.2.4-py2.7.egg\mechanize\_urllib2_fork.py", line 344, in _open
File "site-packages\mechanize-0.2.4-py2.7.egg\mechanize\_urllib2_fork.py", line 332, in _call_chain
File "site-packages\mechanize-0.2.4-py2.7.egg\mechanize\_urllib2_fork.py", line 1142, in http_open
File "site-packages\mechanize-0.2.4-py2.7.egg\mechanize\_urllib2_fork.py", line 1118, in do_open
URLError: <urlopen error [Errno 10060] A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond>

************************************************** ******************************
The identify phase took 126.30 seconds
The longest time (126.245000) was taken by: Google
Merging results from different sources and finding earliest publication dates
We have 0 merged results, merging took: 0.00 seconds
fyoung is offline   Reply With Quote
Reply

« Previous Thread | Next Thread »

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
FAIL: Nook Book won't download zorah Apple Devices 11 08-07-2011 06:29 PM
[Metadata Download Plugin] Goodreads Metadata **Deprecated** kiwidude Plugins 30 04-23-2011 02:10 PM
HELP!! can't download metadata bsell1 Calibre 10 03-11-2011 10:17 AM
Does "Download Metadata & Covers" also download social metadata? iridius Library Management 3 02-22-2011 12:50 PM
Metadata download spacemonkey Calibre 13 08-13-2010 11:51 AM


All times are GMT -4. The time now is 10:29 PM.

Contact Us - FAQ - Guidelines - Privacy - Top

MobileRead.com is a privately owned, operated and funded community.