Amazon metadata download error

08-03-2022, 07:55 AM	#1
thiago.eec Wizard Posts: 1,205 Karma: 1355861 Join Date: Dec 2016 Location: Goiânia - Brazil Device: iPad, Kindle Paperwhite, Kindle Oasis	Amazon metadata download error Hi, @Kovid. I'm having trouble downloading metadata from Amazon. Here is the log: Spoiler: Running identify query with parameters: {'title': 'A Ascensão da Sombra', 'authors': ['Robert Jordan'], 'identifiers': {'isbn': '9788580577747', 'skoob': '450262ed510131'}, 'timeout': 30} Using plugins: Goodreads (1, 5, 3), Skoob Books (1, 5, 4), Amazon.com (1, 3, 0) The log from individual plugins is below **************************** Goodreads (1, 5, 3) ************************** Found 1 results Downloading from Goodreads took 8.751164197921753 --- Title : A Ascensão da Sombra Author(s) : Robert Jordan Publisher : Intrínseca Tags : Fantasy, Science Fiction, Adventure, Adult Series : The Wheel of Time #4 Languages : por Rating : 2.1 Published : 1992-09-15T00:00:00+00:00 Identifiers : goodreads:25537962, isbn:9788580577747 Comments : <p>Os lacres de Shayol Ghul enfraquecem, e o Tenebroso avança. A sombra se ergue para encobrir definitivamente a humanidade. </p> <p>Em Tar Valon, Min tem visões de um destino terrível. Será o fim da Torre Branca? Em Dois Rios, os Mantos-brancos caçam o homem de olhos dourados e o Dragão Renascido. Em Cantorin, junto ao povo do mar, A Grã-lady Suroth vislumbra o retorno dos exércitos Seanchan ao continente. Enquanto na Pedra de Tear, o Lorde Dragão planeja seu próximo passo e ninguém será capaz de prevê-lo. Nem a Ajah Negra, as nobres de Tairen ou as Aes Sedai, nem mesmo Egwene, Elayne e Nynaeve. </p> <p>Declarado o escolhido da antiga profecia, Rand al’Thor, o Dragão Renascido, precisa seguir em frente e cumprir seu destino: proteger o mundo do retorno do Tenebroso. </p> <p>Em A Ascensão da Sombra, Jordan imprime ainda mais suspense à série trazendo uma ameaça até então desconhecida à cidade de Tar Valon, lar das poderosas Aes Sedai. Mergulhados no perigo constante representado pelos Mantos-brancos, os Amigos das Trevas e os Trollocs, entre outros inimigos mortais, ninguém está seguro de qual rumo seguir. Movimentos profundos e inesperados que fazem de A Roda do Tempo uma das mais extraordinárias séries já escritas.</p> identify - start. title=A Ascensão da Sombra, authors=['Robert Jordan'], identifiers={'isbn': '9788580577747', 'skoob': '450262ed510131'} get_goodreads_id_from_identifiers - isbn=9788580577747 get_goodreads_id_using_api - identifiers=9788580577747 Querying using autocomplete API: https://www.goodreads.com/book/auto_...=9788580577747 JSON Result: b'[{"imageUrl":"https://i.gr-assets.com/images/S/compressed.photo.goodreads.com/books/1451447163i/25537962._SY75_.jpg","bookId":"25537962","workId": "6591373","bookUrl":"/book/show/25537962-a-ascens-o-da-sombra","from_search":true,"from_srp":true,"qid":" tts7lprgLT","rank":1,"title":"A Ascens\xc3\xa3o da Sombra (A Roda do Tempo, #4)","bookTitleBare":"A Ascens\xc3\xa3o da Sombra","numPages":992,"avgRating":"4.26","ratings Count":203895,"author":{"id":6252,"name":"Robert Jordan","isGoodreadsAuthor":false,"profileUrl":"ht tps://www.goodreads.com/author/show/6252.Robert_Jordan","worksListUrl":"https://www.goodreads.com/author/list/6252.Robert_Jordan"},"kcrPreviewUrl":null,"descrip tion":{"html":"Os lacres de Shayol Ghul enfraquecem, e o Tenebroso avan\xc3\xa7a. A sombra se ergue para encobrir definitivamente a humanidade.\\u003cbr/\\u003e\\u003cbr/\\u003eEm Tar Valon, Min tem vis\xc3\xb5es de um destino terr\xc3\xadvel. S\xe2\x80\xa6","truncated":true,"fullContentUrl":" https://www.goodreads.com/book/show/25537962-a-ascens-o-da-sombra"}}]' Result using autocomplete API: 25537962 Goodreads book url: 'https://www.goodreads.com/book/show/25537962-aaaa' parse_title:: title_text='A Ascensão da Sombra' parse_authors - author: Robert Jordan parse_authors - author: Mariana Vollmer (Translator) parse_authors - author: Robert Jordan parse_authors - author: Mariana Vollmer parse_details - goodreads_id: 25537962, mi: Title : A Ascensão da Sombra Author(s) : Robert Jordan parse_series: series_node[0]='b'<a class="greyText" href="/series/41526-the-wheel-of-time">\n (The Wheel of Time #4)\n</a>'' parse_series: series_text='(The Wheel of Time #4)' parse_series: series_text='(The Wheel of Time #4)' parse_series: series_text after stripping parantheses='The Wheel of Time #4' parse_series: series_name='The Wheel of Time', series_index_str='#4' parse_series: returning - series_name='The Wheel of Time', series_index='4.0' parse_rating: rating_node= [<Element span at 0x214a17a8480>] parse_rating: have rating node - rating_node[0].text= 4.26 _parse_language: Have language node _parse_language: raw= Portuguese _parse_language: ans= por ********************************************** ************************** ************************** Skoob Books (1, 5, 4) ************************** Found 1 results Downloading from Skoob Books took 1.1593232154846191 --- Title : A Ascensão da Sombra Author(s) : Robert Jordan Publisher : Intrínseca Series : A Roda do Tempo #4 Languages : por Rating : 2.3 Published : 2015-01-02T00:00:00+00:00 Identifiers : skoob:450262ed510131, isbn:9788580577747 Comments : <p>Os lacres de Shayol Ghul enfraquecem, e o Tenebroso avança. A sombra se ergue para encobrir definitivamente a humanidade. Em Tar Valon, Min tem visões de um destino terrível. Será o fim da Torre Branca? Em Dois Rios, os Mantos-brancos caçam o homem de olhos dourados e o Dragão Renascido. Em Cantorin, junto ao povo do mar, A Grã-lady Suroth vislumbra o retorno dos exércitos Seanchan ao continente. Enquanto na Pedra de Tear, o Lorde Dragão planeja seu próximo passo e ninguém será capaz de prevê-lo. Nem a Ajah Negra, os nobres tairenos ou as Aes Sedai, nem mesmo Egwene, Elayne e Nynaeve. Declarado o escolhido da antiga profecia, Rand al'Thor, o Dragão Renascido, precisa seguir em frente e cumprir seu destino: proteger o mundo do retorno do Tenebroso. </p> <p>Em A Ascensão da Sombra, Jordan imprime ainda mais suspense à série trazendo uma ameaça até então desconhecida à cidade de Tar Valon, lar das poderosas Aes Sedai. Mergulhados no perigo constante representado pelos Mantos-brancos, os Amigos das Trevas e os Trollocs, entre outros inimigos mortais, ninguém está seguro de qual rumo seguir. Movimentos profundos e inesperados que fazem de A Roda do Tempo uma das mais extraordinárias séries já escritas. </p> <p>"A Ascensão da Sombra é o quarto livro da série A Roda do Tempo inédito no Brasil." A série foi indicada para o Prêmio Hugo, uma das maiores homenagens concedidas a obras de fantasia ou ficção científica. </p> <p>Romance / Fantasia / Literatura Estrangeira</p> Skoob url:'https://www.skoob.com.br/livro/450262ed510131' ---------------------------------------------------------------------- Title : A Ascensão da Sombra Author(s) : Robert Jordan Publisher : Intrínseca Series : A Roda do Tempo #4 Languages : por Rating : 2.3 Published : 2015-01-02T00:00:00+00:00 Identifiers : skoob:450262ed510131, isbn:9788580577747 Comments : <p>Os lacres de Shayol Ghul enfraquecem, e o Tenebroso avança. A sombra se ergue para encobrir definitivamente a humanidade. Em Tar Valon, Min tem visões de um destino terrível. Será o fim da Torre Branca? Em Dois Rios, os Mantos-brancos caçam o homem de olhos dourados e o Dragão Renascido. Em Cantorin, junto ao povo do mar, A Grã-lady Suroth vislumbra o retorno dos exércitos Seanchan ao continente. Enquanto na Pedra de Tear, o Lorde Dragão planeja seu próximo passo e ninguém será capaz de prevê-lo. Nem a Ajah Negra, os nobres tairenos ou as Aes Sedai, nem mesmo Egwene, Elayne e Nynaeve. Declarado o escolhido da antiga profecia, Rand al'Thor, o Dragão Renascido, precisa seguir em frente e cumprir seu destino: proteger o mundo do retorno do Tenebroso. </p> <p>Em A Ascensão da Sombra, Jordan imprime ainda mais suspense à série trazendo uma ameaça até então desconhecida à cidade de Tar Valon, lar das poderosas Aes Sedai. Mergulhados no perigo constante representado pelos Mantos-brancos, os Amigos das Trevas e os Trollocs, entre outros inimigos mortais, ninguém está seguro de qual rumo seguir. Movimentos profundos e inesperados que fazem de A Roda do Tempo uma das mais extraordinárias séries já escritas. </p> <p>"A Ascensão da Sombra é o quarto livro da série A Roda do Tempo inédito no Brasil." A série foi indicada para o Prêmio Hugo, uma das maiores homenagens concedidas a obras de fantasia ou ficção científica. </p> <p>Romance / Fantasia / Literatura Estrangeira</p> ---------------------------------------------------------------------- ********************************************** ************************** ************************** Amazon.com (1, 3, 0) ************************** Found 0 results Downloading from Amazon.com took 6.607127666473389 User-agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.93 Safari/537.36 Server: auto Making google query: https://www.google.com/search?q=%289....amazon.com.br Failed to find any results on results page, with title: (9788580577747 or 978-8580577747) site:www.amazon.com.br - Pesquisa Google No search engine results for terms: (9788580577747 OR 978-8580577747) Trying the bing search engine instead Making bing query: https://www.bing.com/search?q=%28978....amazon.com.br Failed to find any results on results page, with title: (9788580577747 or 978-8580577747) site:www.amazon.com.br - Search No search engine results for terms: (9788580577747 OR 978-8580577747) No matches found with identifiers, retrying using only title and authors. Query: ['(9788580577747', 'OR', '978-8580577747)'] User-agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/80.0.3987.87 Safari/537.36 Server: auto Making google query: https://www.google.com/search?q=Asce....amazon.com.br Ignoring 'Desbravando A Ascensão da Sombra - Amazonhttps://www.amazon.com.br › customer-reviews' as it has no cached page Ignoring 'Desbravando A Ascensão da Sombra - Amazonhttps://www.amazon.com.br › customer-reviews' as it has no cached page Ignoring 'Desbravando A Ascensão da Sombra - Amazonhttps://www.amazon.com.br › customer-reviews' as it has no cached page Ignoring 'Desbravando A Ascensão da Sombra - Amazonhttps://www.amazon.com.br › customer-reviews' as it has no cached page Skipping non-book result: Result(url='https://www.amazon.com.br/ascens%C3%A3o-sombra-roda-tempo-Livro-ebook/product-reviews/B011LWRJN6?pageNumber=2', title='Amazon.com.br:Avaliações de clientes: A Ascensão da Sombra ...https://www.amazon.com.br › product-reviews', cached_url='https://webcache.googleusercontent.com/search?q\\x3dcache:fHOWbIXuTjQJ:https://www.amazon.com.br/ascens%25C...6amp;gl\\x3dbr') Skipping non-book result: Result(url='https://www.amazon.com.br/ascens%C3%A3o-sombra-roda-tempo-Livro-ebook/product-reviews/B011LWRJN6?pageNumber=2', title='Amazon.com.br:Avaliações de clientes: A Ascensão da Sombra ...https://www.amazon.com.br › product-reviews', cached_url='https://webcache.googleusercontent.com/search?q\\x3dcache:fHOWbIXuTjQJ:https://www.amazon.com.br/ascens%25C...6amp;gl\\x3dbr') Skipping non-book result: Result(url='https://www.amazon.com.br/ascens%C3%A3o-sombra-roda-tempo-Livro-ebook/product-reviews/B011LWRJN6?pageNumber=2', title='Amazon.com.br:Avaliações de clientes: A Ascensão da Sombra ...https://www.amazon.com.br › product-reviews', cached_url='https://webcache.googleusercontent.com/search?q\\x3dcache:fHOWbIXuTjQJ:https://www.amazon.com.br/ascens%25C...6amp;gl\\x3dbr') Skipping non-book result: Result(url='https://www.amazon.com.br/ascens%C3%A3o-sombra-roda-tempo-Livro-ebook/product-reviews/B011LWRJN6?pageNumber=2', title='Amazon.com.br:Avaliações de clientes: A Ascensão da Sombra ...https://www.amazon.com.br › product-reviews', cached_url='https://webcache.googleusercontent.com/search?q\\x3dcache:fHOWbIXuTjQJ:https://www.amazon.com.br/ascens%25C...6amp;gl\\x3dbr') Skipping non-book result: Result(url='https://www.amazon.com.br/product-reviews/B011LWRJN6', title='Amazon.com.br:Avaliações de clientes: A Ascensão da Sombra ...https://www.amazon.com.br › product-reviews', cached_url='https://webcache.googleusercontent.com/search?q\\x3dcache:gv_KsZKoHZIJ:https://www.amazon.com.br/product-re...6amp;gl\\x3dbr') Skipping non-book result: Result(url='https://www.amazon.com.br/product-reviews/B011LWRJN6', title='Amazon.com.br:Avaliações de clientes: A Ascensão da Sombra ...https://www.amazon.com.br › product-reviews', cached_url='https://webcache.googleusercontent.com/search?q\\x3dcache:gv_KsZKoHZIJ:https://www.amazon.com.br/product-re...6amp;gl\\x3dbr') Skipping non-book result: Result(url='https://www.amazon.com.br/product-reviews/B011LWRJN6', title='Amazon.com.br:Avaliações de clientes: A Ascensão da Sombra ...https://www.amazon.com.br › product-reviews', cached_url='https://webcache.googleusercontent.com/search?q\\x3dcache:gv_KsZKoHZIJ:https://www.amazon.com.br/product-re...6amp;gl\\x3dbr') Skipping non-book result: Result(url='https://www.amazon.com.br/product-reviews/B011LWRJN6', title='Amazon.com.br:Avaliações de clientes: A Ascensão da Sombra ...https://www.amazon.com.br › product-reviews', cached_url='https://webcache.googleusercontent.com/search?q\\x3dcache:gv_KsZKoHZIJ:https://www.amazon.com.br/product-re...6amp;gl\\x3dbr') Skipping non-book result: Result(url='https://www.amazon.com.br/Livros-Robert-Jordan/s?rh=n%3A6740748011%2Cp_27%3ARobert+Jordan', title='Livros - Robert Jordan na Amazon.com.brhttps://www.amazon.com.br › Livros-Robert-Jordan › r...', cached_url='https://webcache.googleusercontent.com/search?q\\x3dcache:UV6fRtL11S4J:https://www.amazon.com.br/Livros-Rob...6amp;gl\\x3dbr') Skipping non-book result: Result(url='https://www.amazon.com.br/Livros-Robert-Jordan/s?rh=n%3A6740748011%2Cp_27%3ARobert+Jordan', title='Livros - Robert Jordan na Amazon.com.brhttps://www.amazon.com.br › Livros-Robert-Jordan › r...', cached_url='https://webcache.googleusercontent.com/search?q\\x3dcache:UV6fRtL11S4J:https://www.amazon.com.br/Livros-Rob...6amp;gl\\x3dbr') Skipping non-book result: Result(url='https://www.amazon.com.br/Livros-Robert-Jordan/s?rh=n%3A6740748011%2Cp_27%3ARobert+Jordan', title='Livros - Robert Jordan na Amazon.com.brhttps://www.amazon.com.br › Livros-Robert-Jordan › r...', cached_url='https://webcache.googleusercontent.com/search?q\\x3dcache:UV6fRtL11S4J:https://www.amazon.com.br/Livros-Rob...6amp;gl\\x3dbr') Skipping non-book result: Result(url='https://www.amazon.com.br/Livros-Robert-Jordan/s?rh=n%3A6740748011%2Cp_27%3ARobert+Jordan', title='Livros - Robert Jordan na Amazon.com.brhttps://www.amazon.com.br › Livros-Robert-Jordan › r...', cached_url='https://webcache.googleusercontent.com/search?q\\x3dcache:UV6fRtL11S4J:https://www.amazon.com.br/Livros-Rob...6amp;gl\\x3dbr') Skipping non-book result: Result(url='https://www.amazon.com.br/Robert-Jordan/e/B000AQ19X6%3Fref=dbs_a_mng_rwt_scns_share', title='Robert Jordan: Livros, biografia, blog, audiolivros, Kindlehttps://www.amazon.com.br › Robert-Jordan', cached_url='https://webcache.googleusercontent.com/search?q\\x3dcache:Tr9mRh_FaLQJ:https://www.amazon.com.br/Robert-Jor...6amp;gl\\x3dbr') Skipping non-book result: Result(url='https://www.amazon.com.br/Robert-Jordan/e/B000AQ19X6%3Fref=dbs_a_mng_rwt_scns_share', title='Robert Jordan: Livros, biografia, blog, audiolivros, Kindlehttps://www.amazon.com.br › Robert-Jordan', cached_url='https://webcache.googleusercontent.com/search?q\\x3dcache:Tr9mRh_FaLQJ:https://www.amazon.com.br/Robert-Jor...6amp;gl\\x3dbr') Skipping non-book result: Result(url='https://www.amazon.com.br/Robert-Jordan/e/B000AQ19X6%3Fref=dbs_a_mng_rwt_scns_share', title='Robert Jordan: Livros, biografia, blog, audiolivros, Kindlehttps://www.amazon.com.br › Robert-Jordan', cached_url='https://webcache.googleusercontent.com/search?q\\x3dcache:Tr9mRh_FaLQJ:https://www.amazon.com.br/Robert-Jor...6amp;gl\\x3dbr') Skipping non-book result: Result(url='https://www.amazon.com.br/Robert-Jordan/e/B000AQ19X6%3Fref=dbs_a_mng_rwt_scns_share', title='Robert Jordan: Livros, biografia, blog, audiolivros, Kindlehttps://www.amazon.com.br › Robert-Jordan', cached_url='https://webcache.googleusercontent.com/search?q\\x3dcache:Tr9mRh_FaLQJ:https://www.amazon.com.br/Robert-Jor...6amp;gl\\x3dbr') Skipping non-book result: Result(url='https://www.amazon.com.br/eBooks-Kindle-Robert-Jordan-Loja/s?rh=n%3A5475882011%2Cp_27%3ARobert+Jordan', title='Robert Jordan - eBooks Kindle na Amazon.com.brhttps://www.amazon.com.br › eBooks-Kindle-Robert-Jo...', cached_url='https://webcache.googleusercontent.com/search?q\\x3dcache:adLX3hmpsWwJ:https://www.amazon.com.br/eBooks-Kin...6amp;gl\\x3dbr') Skipping non-book result: Result(url='https://www.amazon.com.br/eBooks-Kindle-Robert-Jordan-Loja/s?rh=n%3A5475882011%2Cp_27%3ARobert+Jordan', title='Robert Jordan - eBooks Kindle na Amazon.com.brhttps://www.amazon.com.br › eBooks-Kindle-Robert-Jo...', cached_url='https://webcache.googleusercontent.com/search?q\\x3dcache:adLX3hmpsWwJ:https://www.amazon.com.br/eBooks-Kin...6amp;gl\\x3dbr') Skipping non-book result: Result(url='https://www.amazon.com.br/eBooks-Kindle-Robert-Jordan-Loja/s?rh=n%3A5475882011%2Cp_27%3ARobert+Jordan', title='Robert Jordan - eBooks Kindle na Amazon.com.brhttps://www.amazon.com.br › eBooks-Kindle-Robert-Jo...', cached_url='https://webcache.googleusercontent.com/search?q\\x3dcache:adLX3hmpsWwJ:https://www.amazon.com.br/eBooks-Kin...6amp;gl\\x3dbr') Skipping non-book result: Result(url='https://www.amazon.com.br/eBooks-Kindle-Robert-Jordan-Loja/s?rh=n%3A5475882011%2Cp_27%3ARobert+Jordan', title='Robert Jordan - eBooks Kindle na Amazon.com.brhttps://www.amazon.com.br › eBooks-Kindle-Robert-Jo...', cached_url='https://webcache.googleusercontent.com/search?q\\x3dcache:adLX3hmpsWwJ:https://www.amazon.com.br/eBooks-Kin...6amp;gl\\x3dbr') Skipping non-book result: Result(url='https://www.amazon.com.br/Literatura-e-Fic%C3%A7%C3%A3o-roda-do-tempo/s?rh=n%3A7872687011%2Cp_lbr_books_series_browse-bin%3Aroda+do+tempo', title='Livros - roda do tempo - Literatura e Ficção na Amazon.com.brhttps://www.amazon.com.br › Literatura-e-Ficção-roda-...', cached_url='https://webcache.googleusercontent.com/search?q\\x3dcache:tsc12GedTSUJ:https://www.amazon.com.br/Literatura...6amp;gl\\x3dbr') Skipping non-book result: Result(url='https://www.amazon.com.br/Literatura-e-Fic%C3%A7%C3%A3o-roda-do-tempo/s?rh=n%3A7872687011%2Cp_lbr_books_series_browse-bin%3Aroda+do+tempo', title='Livros - roda do tempo - Literatura e Ficção na Amazon.com.brhttps://www.amazon.com.br › Literatura-e-Ficção-roda-...', cached_url='https://webcache.googleusercontent.com/search?q\\x3dcache:tsc12GedTSUJ:https://www.amazon.com.br/Literatura...6amp;gl\\x3dbr') Skipping non-book result: Result(url='https://www.amazon.com.br/Literatura-e-Fic%C3%A7%C3%A3o-roda-do-tempo/s?rh=n%3A7872687011%2Cp_lbr_books_series_browse-bin%3Aroda+do+tempo', title='Livros - roda do tempo - Literatura e Ficção na Amazon.com.brhttps://www.amazon.com.br › Literatura-e-Ficção-roda-...', cached_url='https://webcache.googleusercontent.com/search?q\\x3dcache:tsc12GedTSUJ:https://www.amazon.com.br/Literatura...6amp;gl\\x3dbr') Skipping non-book result: Result(url='https://www.amazon.com.br/Literatura-e-Fic%C3%A7%C3%A3o-roda-do-tempo/s?rh=n%3A7872687011%2Cp_lbr_books_series_browse-bin%3Aroda+do+tempo', title='Livros - roda do tempo - Literatura e Ficção na Amazon.com.brhttps://www.amazon.com.br › Literatura-e-Ficção-roda-...', cached_url='https://webcache.googleusercontent.com/search?q\\x3dcache:tsc12GedTSUJ:https://www.amazon.com.br/Literatura...6amp;gl\\x3dbr') Skipping non-book result: Result(url='https://www.amazon.com.br/Literatura-e-Fic%C3%A7%C3%A3o-Robert-Jordan-Livros/s?rh=n%3A7872687011%2Cp_27%3ARobert+Jordan', title='Livros - Robert Jordan - Literatura e Ficção na Amazon.com.brhttps://www.amazon.com.br › Literatura-e-Ficção-Robe...', cached_url='https://webcache.googleusercontent.com/search?q\\x3dcache:azTKe2fXQJIJ:https://www.amazon.com.br/Literatura...6amp;gl\\x3dbr') Skipping non-book result: Result(url='https://www.amazon.com.br/Literatura-e-Fic%C3%A7%C3%A3o-Robert-Jordan-Livros/s?rh=n%3A7872687011%2Cp_27%3ARobert+Jordan', title='Livros - Robert Jordan - Literatura e Ficção na Amazon.com.brhttps://www.amazon.com.br › Literatura-e-Ficção-Robe...', cached_url='https://webcache.googleusercontent.com/search?q\\x3dcache:azTKe2fXQJIJ:https://www.amazon.com.br/Literatura...6amp;gl\\x3dbr') Skipping non-book result: Result(url='https://www.amazon.com.br/Literatura-e-Fic%C3%A7%C3%A3o-Robert-Jordan-Livros/s?rh=n%3A7872687011%2Cp_27%3ARobert+Jordan', title='Livros - Robert Jordan - Literatura e Ficção na Amazon.com.brhttps://www.amazon.com.br › Literatura-e-Ficção-Robe...', cached_url='https://webcache.googleusercontent.com/search?q\\x3dcache:azTKe2fXQJIJ:https://www.amazon.com.br/Literatura...6amp;gl\\x3dbr') Skipping non-book result: Result(url='https://www.amazon.com.br/Literatura-e-Fic%C3%A7%C3%A3o-Robert-Jordan-Livros/s?rh=n%3A7872687011%2Cp_27%3ARobert+Jordan', title='Livros - Robert Jordan - Literatura e Ficção na Amazon.com.brhttps://www.amazon.com.br › Literatura-e-Ficção-Robe...', cached_url='https://webcache.googleusercontent.com/search?q\\x3dcache:azTKe2fXQJIJ:https://www.amazon.com.br/Literatura...6amp;gl\\x3dbr') Skipping non-book result: Result(url='https://www.amazon.com.br/Literatura-e-Fic%C3%A7%C3%A3o-Robert-Jordan-Livros/s?rh=n%3A7872687011%2Cp_27%3ARobert+Jordan', title='Livros - Robert Jordan - Literatura e Ficção na Amazon.com.brhttps://www.amazon.com.br › Literatura-e-Ficção-Robe...', cached_url='https://webcache.googleusercontent.com/search?q\\x3dcache:azTKe2fXQJIJ:https://www.amazon.com.br/Literatura...6amp;gl\\x3dbr') Downloading details from: https://webcache.googleusercontent.c...26amp;gl\x3dbr Downloading details from: https://webcache.googleusercontent.c...26amp;gl\x3dbr URL malformed: 'https://webcache.googleusercontent.com/search?q\\x3dcacheAdtY67LSWsJ:https://www.amazon.com.br/Ascens%25C...6amp;gl\\x3dbr' get_details failed for url: 'https://webcache.googleusercontent.com/search?q\\x3dcacheAdtY67LSWsJ:https://www.amazon.com.br/Ascens%25C...6amp;gl\\x3dbr' Traceback (most recent call last): File "<string>", line 392, in run File "<string>", line 398, in get_details TypeError: cannot unpack non-iterable NoneType object URL malformed: 'https://webcache.googleusercontent.com/search?q\\x3dcache:t52I7RpMWA4J:https://www.amazon.com.br/Ascens%25C...6amp;gl\\x3dbr' get_details failed for url: 'https://webcache.googleusercontent.com/search?q\\x3dcache:t52I7RpMWA4J:https://www.amazon.com.br/Ascens%25C...6amp;gl\\x3dbr' Traceback (most recent call last): File "<string>", line 392, in run File "<string>", line 398, in get_details TypeError: cannot unpack non-iterable NoneType object ********************************************** **************************** The identify phase took 8.96 seconds The longest time (8.751164) was taken by: Goodreads Merging results from different sources We have 1 merged results, merging took: 0.00 seconds

08-03-2022, 09:26 AM	#2
kovidgoyal creator of calibre Posts: 45,260 Karma: 27110894 Join Date: Oct 2006 Location: Mumbai, India Device: Various	works for me, I even added a test for it. https://github.com/kovidgoyal/calibr...458fa597cd8cba

Advert

08-03-2022, 11:24 AM

thiago.eec

Wizard

Posts: 1,205

Karma: 1355861

Join Date: Dec 2016

Location: Goiânia - Brazil

Device: iPad, Kindle Paperwhite, Kindle Oasis

Quote:

Originally Posted by kovidgoyal

works for me, I even added a test for it. https://github.com/kovidgoyal/calibr...458fa597cd8cba

I'm getting this error most of the time. Sometimes it is something like an overflow error, but I could not reproduce now.

Here it is for other books:

Spoiler:

This one is English and I changed the server to US:

Spoiler:

Also in English with US server:

Spoiler:

08-03-2022, 11:56 AM	#4
DNSB Bibliophagist Posts: 45,513 Karma: 168929301 Join Date: Jul 2010 Location: Vancouver Device: Kobo Sage, Libra Colour, Lenovo M8 FHD, Paperwhite 4, Tolino epos	Out of curiosity, what happens if you change the metadata search to Amazon servers, Google or automatically select server from Bing search cache? I think calibre will now try DuckDuckGo if Google is returning 429 errors. Edit: Sorry, just noticed one of the spoilers is using Google so forget the suggestion. Edit2: I looked at the Kindle version of Perfect by Cecilia Ahern on Amazon (.com and .ca) and it shows the ASIN as being B01IN98T1Q while your spoiler shows it as being B01MEG63BI. On Amazon.com, the first shows as being published by Feiwel and Friends (a MacMillan imprint) on April 4, 2017 while the second shows as being published by Harper Collins Children’s Books on April 6, 2017. From a quick search, Feiwel and Friends has the US & Canadian rights. Clicking on the Look Inside for the B01MEG63BI version on Amazon.com shows the B01IN98T1Q version. Though this does not help with your "TypeError: cannot unpack non-iterable NoneType object " error message. Possibly due to having no results (None?) returned and the error checking is not handling that properly. Last edited by DNSB; 08-03-2022 at 12:16 PM. Reason: Too much time to waste this morning....

08-03-2022, 04:01 PM

thiago.eec

Wizard

Posts: 1,205

Karma: 1355861

Join Date: Dec 2016

Location: Goiânia - Brazil

Device: iPad, Kindle Paperwhite, Kindle Oasis

Quote:

Originally Posted by DNSB

Edit2: I looked at the Kindle version of Perfect by Cecilia Ahern on Amazon (.com and .ca) and it shows the ASIN as being B01IN98T1Q while your spoiler shows it as being B01MEG63BI. On Amazon.com, the first shows as being published by Feiwel and Friends (a MacMillan imprint) on April 4, 2017 while the second shows as being published by Harper Collins Children’s Books on April 6, 2017. From a quick search, Feiwel and Friends has the US & Canadian rights.

Clicking on the Look Inside for the B01MEG63BI version on Amazon.com shows the B01IN98T1Q version.

Though this does not help with your "TypeError: cannot unpack non-iterable NoneType object " error message. Possibly due to having no results (None?) returned and the error checking is not handling that properly.

Just looked here and it seems B01MEG63BI is the ASIN for the physical book.
Also, just to be clear, all this books I posted had their metadata fetched using calibre some time ago. Now, calibre can't find any match, even for books it had find in the past.

Advert

08-03-2022, 10:30 PM	#6
kovidgoyal creator of calibre Posts: 45,260 Karma: 27110894 Join Date: Oct 2006 Location: Mumbai, India Device: Various	The TypeError simply means the page was not found in the google webcache. Why that is, I have no idea, as I said it works for me. Maybe google webcache is returning 404s for you because of too many requests? I have changed the code to do better error logging, so you wont see the TypeErrors anymore.

08-03-2022, 10:31 PM

DNSB

Bibliophagist

Posts: 45,513

Karma: 168929301

Join Date: Jul 2010

Location: Vancouver

Device: Kobo Sage, Libra Colour, Lenovo M8 FHD, Paperwhite 4, Tolino epos

Quote:

Originally Posted by thiago.eec

The ASIN may be correct in some areas for an ebook but in the US/Canada, it is incorrect. Using your search string got me two hits from Amazon.com but B01MEG63BI is not the ASIN for the physical book in those links. The physical book is found under 1250074126 (the ISBN-10 number). Doing a search directly on Amazon.com and Amazon.ca with B01MEG63BI gave me a failed search. A search on Amazon.co.uk and Amazon.es for that ASIN worked while both Amazon.de and Amazon.ch failed the search but both found the book with B01IN98T1Q.

One other thing I've noticed is that while once I could search for a book with the title set to Whatever: A Novel (The Mindless series book 4) or whatever other garbage Amazon seems to love in book titles, most of the time I now have to trim the title before the search will work reliably.

Attached Thumbnails

Click image for larger version

Name: Screenshot 2022-08-03 191042.png
Views: 74
Size: 50.2 KB
ID: 195593

08-04-2022, 04:14 AM

thiago.eec

Wizard

Posts: 1,205

Karma: 1355861

Join Date: Dec 2016

Location: Goiânia - Brazil

Device: iPad, Kindle Paperwhite, Kindle Oasis

Quote:

Originally Posted by kovidgoyal

The TypeError simply means the page was not found in the google webcache. Why that is, I have no idea, as I said it works for me. Maybe google webcache is returning 404s for you because of too many requests?

I have changed the code to do better error logging, so you wont see the TypeErrors anymore.

Just did a search, after 10 hours or so and still no joy. It's been like that for a couple of weeks now.
The strange part is that looking at the error message, I can spot the right URL in there:

Code:

Traceback (most recent call last):
  File "<string>", line 404, in run
  File "<string>", line 410, in get_details
  File "<string>", line 110, in parse_details_page
UrlNotFound: The URL https://webcache.googleusercontent.com/search?q\x3dcache:5bpEhP6UzRUJ:https://www.amazon.com.br/As-vinhas-ira-John-Steinbeck-ebook/dp/B00EAQUPEQ+\x26amp;cd\x3d1\x26amp;hl\x3dpt-BR\x26amp;ct\x3dclnk\x26amp;gl\x3dbr was not found (HTTP 404)

Also, when looking manually, I can access the cached result and this is the link:

https://webcache.googleusercontent.c...&ct=clnk&gl=br

It seems to be same URL that is returning the HTTP 404 error for calibre.

Complete log:

Spoiler:

08-04-2022, 10:42 AM	#9
kovidgoyal creator of calibre Posts: 45,260 Karma: 27110894 Join Date: Oct 2006 Location: Mumbai, India Device: Various	If the same url is returning different results from the browser vs calibre, then it has to be some sort of bot detection causing the errors. I tried this: Code: calibre-debug -c 'from calibre import browser; br = browser(); import sys; print(br.open(sys.argv[-1]).read().decode())' 'https://webcache.googleusercontent.com/search?q=cache:5bpEhP6UzRUJ:https://www.amazon.com.br/As-vinhas-...&ct=clnk&gl=br' and it printed out the cached webpage for me.

08-04-2022, 11:06 AM

#10

thiago.eec

Wizard

Posts: 1,205

Karma: 1355861

Join Date: Dec 2016

Location: Goiânia - Brazil

Device: iPad, Kindle Paperwhite, Kindle Oasis

Quote:

Originally Posted by kovidgoyal

If the same url is returning different results from the browser vs calibre, then it has to be some sort of bot detection causing the errors.

I tried this:

Code:

calibre-debug -c 'from calibre import browser; br = browser(); import sys; print(br.open(sys.argv[-1]).read().decode())' 'https://webcache.googleusercontent.com/search?q=cache:5bpEhP6UzRUJ:https://www.amazon.com.br/As-vinhas-...&ct=clnk&gl=br'

and it printed out the cached webpage for me.

It prints for me too.

08-04-2022, 12:00 PM

#11

kovidgoyal

creator of calibre

Posts: 45,260

Karma: 27110894

Join Date: Oct 2006

Location: Mumbai, India

Device: Various

I think the google server in portugal is using a different URL encoding. Try applying the following patch:

Code:

diff --git a/src/calibre/ebooks/metadata/sources/search_engines.py b/src/calibre/ebooks/metadata/sources/search_engines.py
index 55e0053d50..6f6152d4b9 100644
--- a/src/calibre/ebooks/metadata/sources/search_engines.py
+++ b/src/calibre/ebooks/metadata/sources/search_engines.py
@@ -25,7 +25,7 @@
 from calibre.utils.lock import ExclusiveFile
 from calibre.utils.random_ua import accept_header_for_ua
 
-current_version = (1, 2, 0)
+current_version = (9, 9, 9)
 minimum_calibre_version = (2, 80, 0)
 webcache = {}
 webcache_lock = Lock()
@@ -297,6 +297,7 @@ def urepl(m):
     seen = set()
     ans = {}
     for m in pat.finditer(raw):
+        print(11111111111, repr(m.group(1)))
         cache_url = upat.sub(urepl, m.group(1))
         m = cache_pat.search(cache_url)
         cache_id, src_url = m.group(1), m.group(2)
@@ -326,6 +327,7 @@ def google_parse_results(root, raw, log=prints, ignore_uncached=True):
         else:
             try:
                 c = div.xpath('descendant::*[@role="menuitem"]//a[@class="fl"]')[0]
+                print(2222222, repr(c.get('href')))
             except IndexError:
                 if ignore_uncached:
                     log('Ignoring {!r} as it has no cached page'.format(title))
@@ -367,14 +369,14 @@ def google_search(terms, site=None, br=None, log=prints, safe_search=False, dump
     return google_parse_results(root, r[0], log=log), url
 
 
-def google_develop(search_terms='1423146786', raw_from=''):
+def google_develop(search_terms='B00EAQUPEQ', raw_from=''):
     if raw_from:
         with open(raw_from, 'rb') as f:
             raw = f.read()
         results = google_parse_results(parse_html(raw), raw)
     else:
         br = browser()
-        results = google_search(search_terms.split(), 'www.amazon.com', dump_raw='/t/raw.html', br=br)[0]
+        results = google_search(search_terms.split(), 'www.amazon.com.br', dump_raw='raw.html', br=br)[0]
     for result in results:
         if '/dp/' in result.url:
             print(result.title)

Then run

Code:

calibre-debug -c "from calibre.ebooks.metadata.sources.search_engines import *; google_develop()"

and post the output and also the raw.html file which this command will create in the current directory

08-04-2022, 01:07 PM

#12

thiago.eec

Wizard

Posts: 1,205

Karma: 1355861

Join Date: Dec 2016

Location: Goiânia - Brazil

Device: iPad, Kindle Paperwhite, Kindle Oasis

Here you are:

Command output:

Spoiler:

Attached Files

raw.html.txt (313.0 KB, 68 views)

08-04-2022, 09:38 PM	#13
kovidgoyal creator of calibre Posts: 45,260 Karma: 27110894 Join Date: Oct 2006 Location: Mumbai, India Device: Various	This should fix it: https://github.com/kovidgoyal/calibr...2b5778c6fb0090

08-05-2022, 08:58 AM

#14

thiago.eec

Wizard

Posts: 1,205

Karma: 1355861

Join Date: Dec 2016

Location: Goiânia - Brazil

Device: iPad, Kindle Paperwhite, Kindle Oasis

Quote:

Originally Posted by kovidgoyal

This should fix it: https://github.com/kovidgoyal/calibr...2b5778c6fb0090

Thank you! That fixed it.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
MetaData Download Error	MattWaso	Calibre	2	07-26-2022 11:23 PM
Metadata download error	booksandme	Calibre	11	07-18-2022 10:41 AM
Download Metadata then Error 32	Magnus	Calibre	1	11-21-2016 07:18 PM
Metadata download error. Over and over again	alacrity2005	Library Management	10	03-25-2011 12:58 PM
Error on Download Metadata	PCreighton	Calibre	1	09-03-2010 07:34 PM