Register Guidelines E-Books Today's Posts Search

Go Back   MobileRead Forums > E-Book Software > Calibre > Library Management

Notices

Reply
 
Thread Tools Search this Thread
Old 08-02-2022, 07:23 PM   #1
McStubb
Connoisseur
McStubb began at the beginning.
 
Posts: 52
Karma: 10
Join Date: May 2014
Device: None
Google Books API

With Google now throwing more and more frequent 429 rate limit messages. Is it possible to use the google books API instead of trying to scrape the general search results? By default each person's API key has a 1,000 query limit per day, and its not hard to request an increase (I currently have 15,000 queries per day).
McStubb is offline   Reply With Quote
Old 08-03-2022, 01:07 AM   #2
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 45,344
Karma: 27182818
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
calibre does currently use the google books api first, and only if a match is not found is a web search done. And even for the amazon plugin when google starts return 429 errors, the plugin now fallsback automatically to using duckduckgo instead.
kovidgoyal is offline   Reply With Quote
Advert
Old 08-03-2022, 10:16 PM   #3
McStubb
Connoisseur
McStubb began at the beginning.
 
Posts: 52
Karma: 10
Join Date: May 2014
Device: None
I'm using the most recent version of calibre and all plugins are updated:
Its not falling back to duck duck go.

Code:
****************************** Google (1, 1, 0) ****************************** 
Found 0 results 
Downloading from Google took 3.369441032409668 
Making query: https://books.google.com/books/feeds/volumes?q=intitle%3ADay+intitle%3Aof+intitle%3AReckoning%2Binauthor%3AJohn+inauthor%3AWinchester&max-results=20&start-index=1&min-viewability=none
No results found, doing a web search instead
Making query: https://www.google.com/search?q=Day+of+Reckoning+John+Winchester&tbm=bks
Plugin Google failed
Traceback (most recent call last):
  File "calibre\ebooks\metadata\sources\identify.py", line 47, in run
  File "", line 533, in identify
  File "", line 438, in identify_via_web_search
  File "", line 93, in query
  File "mechanize\_mechanize.py", line 241, in open_novisit
  File "mechanize\_mechanize.py", line 313, in _mech_open
mechanize._response.get_seek_wrapper_class..httperror_seek_wrapper: HTTP Error 429: Too Many Requests
McStubb is offline   Reply With Quote
Old 08-03-2022, 10:20 PM   #4
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 45,344
Karma: 27182818
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
The fallback is in the amazon plugin not the google books plugin. I could add one to the google books plugin as well, but I dont think its particularly useful since web search there is done only as a fallback when the google books api fails. AAre you seeing a lot of failures for the google books api?
kovidgoyal is offline   Reply With Quote
Reply


Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
How to best write workaround for Google Books API Bug soilheart Development 3 11-03-2021 11:32 AM
Arc Google maps api v2 is not working in kobo arc Angel Shah Kobo Tablets 3 05-29-2013 11:27 AM
ePubs and Google Font API Justin Rotkowitz ePub 1 03-29-2011 11:33 AM
Amazon blocking Kindle Books in API? anurag Amazon Kindle 1 08-24-2009 08:46 PM
calibre now uses the Google Books API to get metadata kovidgoyal Calibre 9 03-23-2009 09:36 PM


All times are GMT -4. The time now is 03:36 AM.


MobileRead.com is a privately owned, operated and funded community.