[Metadata Source Plugin] Evrit

[HebrewReader]

This plugin gets the metadata for books in Hebrew from the Evrit store.

Main Features

• Can retrieve title, authors, comments, publisher, publication date, tags, ratings and cover.
• The identifier used is "evrit". It will show in the details as "עברית".

Installation Notes:

• Download the attached zip file and install the plugin as described in the Introduction to plugins thread.
• Note that this is not a GUI plugin so it is not intended/cannot be added to context menus/toolbars etc.

Configuration:
None.

Version History:

Spoiler:

Version 1.0.0 - 10 January 2023

• Initial release

Version 1.1.0 - 13 January 2023

• Fix identification of author names with unicode control characters, e.g. U+200E Left-to-Right Mark (LRM).
• More lenient matching: can ignore optional 'אהוי' letters in ktiv haser, e.g. "ג'ף פורשאו" vs. "ג'ף פורשו"
• Ignore punctuation when identifying titles, e.g. question mark.
• Partial title matching, e.g. 'עקצן איש העקרב' vs. 'השרביט והחרב 18 - עקצן איש העקרב'.
• Allow matching titles with extra tokens, e.g. 'ארו שאה ונקטר האלמוות' vs. 'ארו שאה 5 ונקטר האלמוות'.
• Allow matching authors with extra tokens, e.g. 'ליאת יקיר' vs. 'ד"ר ליאת יקיר'.
• Allow matching when not all authors are present.

Version 1.2.0 - 16 January 2023

• Improve high-res cover detection.
• Server GetCustomerProductsDetails api was changed from GET to POST. Previous plugin versions no longer work.

Version 1.3.0 - 18 February 2023

• Rename plugin from "Evrit metadata source" to "Evrit".
• Support titles with '/' character.
• Allow matching titles with subtitles, e.g. 'הארנק והחרב: המהפכה המשפטית ושברה' vs. 'הארנק והחרב'.
• Speed up matching.
• Support titles with Geresh (') character.
• Support titles with Gershayim (") character.
• Support matching titles which changed punctuation.
• Fix author matching bug.

Version 1.4.0 - 16 June 2023

• Fix socket exception ("A non-blocking socket operation could not be completed immediately on send") caused by
  sending timeout=0.
• Using edit distance as relevance score to distinguish between similar matching titles.
• Avoid repeated calls with identical query.
• Optimistically try querying the full title before doing partial lookups.
• Obtain additional tags from Evrit's product page.

[HebrewReader]

I have uploaded a new version (v1.1.0).

Changes are:

• Fix identification of author names with unicode control characters, e.g. U+200E Left-to-Right Mark (LRM).
• More lenient matching: can ignore optional 'אהוי' letters in ktiv haser, e.g. "ג'ף פורשאו" vs. "ג'ף פורשו"
• Ignore punctuation when identifying titles, e.g. question mark.
• Partial title matching, e.g. 'עקצן איש העקרב' vs. 'השרביט והחרב 18 - עקצן איש העקרב'.
• Allow matching titles with extra tokens, e.g. 'ארו שאה ונקטר האלמוות' vs. 'ארו שאה 5 ונקטר האלמוות'.
• Allow matching authors with extra tokens, e.g. 'ליאת יקיר' vs. 'ד"ר ליאת יקיר'.
• Allow matching when not all authors are present.

Unfortunately, I still don't have forum edit rights, so I can't update the original post until my rights are elevated.

[HebrewReader]

I have uploaded a new version (v1.2.0).

Previous versions stopped working due to breaking change in Evrit's api!

Changes are:

• Improve high-res cover detection.
• Server GetCustomerProductsDetails api was changed from GET to POST. Previous plugin versions no longer work.

Note: I still have no permissions to update the original post, so auto-update won't work.

[HebrewReader]

Can a moderator please replace the attachment in the original post with the latest one? At least until I get editing permission?

[theducks]

Originally Posted by HebrewReader

Can a moderator please replace the attachment in the original post with the latest one? At least until I get editing permission?

done

[HebrewReader]

I have uploaded a new version (v1.3.0).

Changes are:

• Rename plugin from "Evrit metadata source" to "Evrit".
• Support titles with '/' character.
• Allow matching titles with subtitles, e.g. 'הארנק והחרב: המהפכה המשפטית ושברה' vs. 'הארנק והחרב'.
• Speed up matching.
• Support titles with Geresh (') character.
• Support titles with Gershayim (") character.
• Support matching titles which changed punctuation.
• Fix author matching bug.

Note: I still have no permissions to update the original post, so auto-update won't work.

Moderator Notice
Moved

[HebrewReader]

Can a moderator please replace the attachment in the original post with the latest one? At least until I get editing permission?

[BetterRed]

You are now at 10 posts, I think that's the trigger to allowing Editing.

If not create some posts in the Lounge until you can edit.

BR

[HebrewReader]

Originally Posted by BetterRed

You are now at 10 posts, I think that's the trigger to allowing Editing.

You're correct - thanks!

[BetterRed]

Originally Posted by HebrewReader

You're correct - thanks!

Could you remove the attachment in post #2

Some PI developers reserve post #2 as a placeholder for test versions, which avoids having them scattered in random posts in the thread.

BR

[HebrewReader]

Originally Posted by BetterRed

Could you remove the attachment in post #2

np. done.

[tgiladi]

Hi, is this plugin still maintained?
I've been getting errors whenever I try to search for metadata with it, since the latest Calibre version. It did work previously.

[HebrewReader]

Originally Posted by tgiladi

Hi, is this plugin still maintained?
I've been getting errors whenever I try to search for metadata with it, since the latest Calibre version. It did work previously.

I did not actively worked on the plugin recently but I can still fix bugs.

I'll need to reproduce your error when I get time, but can you also paste the errors you get here? It should be visible when you look for the details of the job that failed.

[tgiladi]

Thanks for replying!
Here's the error I get:
calibre, version 7.1.0
ERROR: No matches found: <p>Failed to find any books that match your search. Try making the search <b>less specific</b>. For example, use only the author's last name and a single distinctive word from the title.<p>To see the full log, click "Show details".

Running identify query with parameters:
{'title': 'העיג', 'authors': ['רואלד דאל'], 'identifiers': {}, 'timeout': 30}
Using plugins: Evrit (1, 4, 0), Goodreads (1, 7, 9), Google (1, 1, 1), Amazon.com (1, 3, 5)
The log from individual plugins is below

****************************** Evrit (1, 4, 0) ******************************
Found 0 results
Downloading from Evrit took 0.19468021392822266
https://www.e-vrit.co.il/api/Product...יג
Plugin Evrit failed
Traceback (most recent call last):
File "mechanize\_urllib2_fork.py", line 1236, in do_open
File "http\client.py", line 1286, in request
File "http\client.py", line 1332, in _send_request
File "http\client.py", line 1281, in endheaders
File "http\client.py", line 1041, in _send_output
File "http\client.py", line 979, in send
File "http\client.py", line 1458, in connect
File "ssl.py", line 517, in wrap_socket
File "ssl.py", line 1108, in _create
File "ssl.py", line 1379, in do_handshake
ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1006)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "calibre\ebooks\metadata\sources\identify.py", line 47, in run
File "calibre_plugins.dummy1.__init__", line 242, in identify
File "calibre_plugins.dummy1.__init__", line 273, in search_for_evrit_id
File "calibre_plugins.dummy1.__init__", line 302, in get_product_values_from_book_teller
File "mechanize\_mechanize.py", line 241, in open_novisit
File "mechanize\_mechanize.py", line 287, in _mech_open
File "mechanize\_opener.py", line 193, in open
File "mechanize\_urllib2_fork.py", line 425, in _open
File "mechanize\_urllib2_fork.py", line 414, in _call_chain
File "calibre\utils\browser.py", line 28, in https_open
File "mechanize\_urllib2_fork.py", line 1240, in do_open
urllib.error.URLError: <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1006)>

************************************************** ******************************

****************************** Goodreads (1, 7, 9) ******************************
Found 0 results
Downloading from Goodreads took 1.2352917194366455
identify - start. title=העיג, authors=['רואלד דאל'], identifiers={}
Querying: https://www.goodreads.com/search?sea...e=books&search[query]=%D7%94%D7%A2%D7%99%D7%92+%D7%A8%D7%95%D7%90%D7%9C %D7%93+%D7%93%D7%90%D7%9C
No goodreads id via ISBN

************************************************** ******************************

****************************** Google (1, 1, 1) ******************************
Found 0 results
Downloading from Google took 13.974174499511719
Making query: https://books.google.com/books/feeds...ewability=none
No results found, doing a web search instead
Making query: https://www.google.com/search?q=%D7%...%D7%9C&tbm=bks
Excluding העי"ג by רואלד. דל & אורי בלסם as it does not match the query
Excluding The BFG (Colour Edition) by Roald Dahl as it does not match the query
Excluding The BFG by Roald Dahl & Natasha Richardson as it does not match the query
Excluding BFG by Roald Dahl as it does not match the query
Excluding Yr CMM by Roald Dahl as it does not match the query
Excluding The BFG by Roald Dahl as it does not match the query
Excluding The BFG: Plays for Children by Roald Dahl as it does not match the query
Excluding Sophiechen und der Riese by Roald Dahl as it does not match the query
Excluding The BFG in Scots by Roald Dahl as it does not match the query
Excluding The BFG by Roald Dahl as it does not match the query

************************************************** ******************************

****************************** Amazon.com (1, 3, 5) ******************************
Found 0 results
Downloading from Amazon.com took 3.739368200302124
User-agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/80.0.3987.87 Safari/537.36
Server: auto
Making google query: https://www.google.com/search?q=%D7%...www.amazon.com
Failed to find any results on results page, with title: העיג רואלד דאל site:www.amazon.com - חיפוש ב-Google
No search engine results for terms: העיג רואלד דאל
Trying the bing search engine instead
Making bing query: https://www.bing.com/search?q=%D7%94...www.amazon.com
Failed to find any results on results page, with title: העיג רואלד דאל site:www.amazon.com - חיפוש
No search engine results for terms: העיג רואלד דאל
No matches found with query: ['העיג', 'רואלד', 'דאל']

************************************************** ******************************
The identify phase took 14.04 seconds
The longest time (13.974174) was taken by: Google
Merging results from different sources
We have 0 merged results, merging took: 0.00 seconds

[tgiladi]

Thanks for replying!
Here's the error message I'm getting:

calibre, version 7.1.0
ERROR: No matches found: <p>Failed to find any books that match your search. Try making the search <b>less specific</b>. For example, use only the author's last name and a single distinctive word from the title.<p>To see the full log, click "Show details".

Running identify query with parameters:
{'title': 'הבלדרית', 'authors': ['דניאל סילבה'], 'identifiers': {'isbn': '9789654824729', 'google': '8fLAMQAACAAJ'}, 'timeout': 30}
Using plugins: Evrit (1, 4, 0)
The log from individual plugins is below

****************************** Evrit (1, 4, 0) ******************************
Found 0 results
Downloading from Evrit took 0.07528162002563477
https://www.e-vrit.co.il/api/Product...ית
Plugin Evrit failed
Traceback (most recent call last):
File "mechanize\_urllib2_fork.py", line 1236, in do_open
File "http\client.py", line 1286, in request
File "http\client.py", line 1332, in _send_request
File "http\client.py", line 1281, in endheaders
File "http\client.py", line 1041, in _send_output
File "http\client.py", line 979, in send
File "http\client.py", line 1458, in connect
File "ssl.py", line 517, in wrap_socket
File "ssl.py", line 1108, in _create
File "ssl.py", line 1379, in do_handshake
ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1006)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "calibre\ebooks\metadata\sources\identify.py", line 47, in run
File "calibre_plugins.dummy1.__init__", line 242, in identify
File "calibre_plugins.dummy1.__init__", line 273, in search_for_evrit_id
File "calibre_plugins.dummy1.__init__", line 302, in get_product_values_from_book_teller
File "mechanize\_mechanize.py", line 241, in open_novisit
File "mechanize\_mechanize.py", line 287, in _mech_open
File "mechanize\_opener.py", line 193, in open
File "mechanize\_urllib2_fork.py", line 425, in _open
File "mechanize\_urllib2_fork.py", line 414, in _call_chain
File "calibre\utils\browser.py", line 28, in https_open
File "mechanize\_urllib2_fork.py", line 1240, in do_open
urllib.error.URLError: <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1006)>

************************************************** ******************************
The identify phase took 0.20 seconds
The longest time (0.075282) was taken by: Evrit
Merging results from different sources
We have 0 merged results, merging took: 0.00 seconds