Beta testers for calibre 3.0 needed

[Divingduck]

Sorry, saw it to late. Here it is:

Spoiler:

calibre Fehlerdiagnoseprotokoll
calibre 2.99.6* [64bit]  embedded-python: True is64bit: True
Windows-10-10.0.14393-SP0 Windows ('64bit', 'WindowsPE')
('Windows', '10', '10.0.14393')
Python 2.7.12+
Windows: ('10', '10.0.14393', 'SP0', u'Multiprocessor Free')
Successfully initialized third party plugins: DeDRM (6, 5, 3) && Annotations (1, 4, 11) && Media File Importer (1, 0, 19) && Extract ISBN (1, 4, 4) && Manage Sony x50 Reader Book List (1, 2, 11) && Job Spy (1, 0, 55) && Goodreads Sync (1, 10, 1) && BOL_DE (0, 7, 5) && KindleUnpack - The Plugin (0, 81, 4) && EpubSplit (2, 2, 0) && KoboTouchExtended (2, 8, 2) && Diaps Editing Toolbag (0, 3, 4) && Wiki Reader (2, 1, 0) && ScrambleEbook (0, 0, 5) && Favourites Menu (1, 0, 4) && Library Codes (1, 0, 30) && Quality Check (1, 9, 11) && Modify ePub (1, 3, 13) && Search The Internet (1, 7, 6) && Import List (1, 1, 5) && food network Recipe Reader (1, 0, 2) && Find Duplicates (1, 6, 2) && EpubMerge (2, 1, 0) && Open With (1, 5, 10) && Count Pages (1, 7, 0) && Generate Cover (1, 5, 21) && Goodreads (1, 1, 12)
calibre 2.99.6* [64bit]  embedded-python: True is64bit: True
Windows-10-10.0.14393-SP0 Windows ('64bit', 'WindowsPE')
('Windows', '10', '10.0.14393')
Python 2.7.12+
Windows: ('10', '10.0.14393', 'SP0', u'Multiprocessor Free')
Successfully initialized third party plugins: DeDRM (6, 5, 3) && Annotations (1, 4, 11) && Media File Importer (1, 0, 19) && Extract ISBN (1, 4, 4) && Manage Sony x50 Reader Book List (1, 2, 11) && Job Spy (1, 0, 55) && Goodreads Sync (1, 10, 1) && BOL_DE (0, 7, 5) && KindleUnpack - The Plugin (0, 81, 4) && EpubSplit (2, 2, 0) && KoboTouchExtended (2, 8, 2) && Diaps Editing Toolbag (0, 3, 4) && Wiki Reader (2, 1, 0) && ScrambleEbook (0, 0, 5) && Favourites Menu (1, 0, 4) && Library Codes (1, 0, 30) && Quality Check (1, 9, 11) && Modify ePub (1, 3, 13) && Search The Internet (1, 7, 6) && Import List (1, 1, 5) && food network Recipe Reader (1, 0, 2) && Find Duplicates (1, 6, 2) && EpubMerge (2, 1, 0) && Open With (1, 5, 10) && Count Pages (1, 7, 0) && Generate Cover (1, 5, 21) && Goodreads (1, 1, 12)
Turning on automatic hidpi scaling
devicePixelRatio: 1.0
logicalDpi: 96.0 x 96.0
physicalDpi: 90.0253164557 x 90.1013513514
Using calibre Qt style: True
Starting up...
DEBUG:    0.0  ~~~~~~~~~~~~~~~~~~~~~ Annotations plugin 1.4.11 (Windows) ~~~~~~~~~~~~~~~~~~~~~~
DEBUG:    0.0 libiMobileDevice:__init__() 
DEBUG:    0.0 AnnotationsAction:genesis(ERROR) Error loading library libiMobileDevice: LoadLibrary() argument 1 must be string, not unicode
DEBUG:    0.0 AnnotationsAction:init_options(disable_caching: False) 
DEBUG:    0.0 AnnotationsDB:connect(db_version: 1) 
DEBUG:    0.0 AnnotationsAction:load_dynamic_reader_classes() 
DEBUG:    0.0   loading built-in class 'GoodReader'
DEBUG:    0.0   loading built-in class 'Kindle'
DEBUG:    0.0   loading built-in class 'KoboTouch-new'
DEBUG:    0.1   loading built-in class 'KoboTouch-old'
DEBUG:    0.1   loading built-in class 'KoboTouch'
DEBUG:    0.1   loading built-in class 'ParseKindleMyClippingsTxt'
DEBUG:    0.1   loading external class 'AGE31'
DEBUG:    0.1 AnnotationsAction:inflate_dialog_resources() 
DEBUG:    0.1 CompileUI:compile_ui() 
DEBUG:    0.1   recompiling C:\Users\Armin\AppData\Roaming\calibre\plugins\annotations_resources\dialogs\cc_wizard.ui
DEBUG:    0.2   recompiling C:\Users\Armin\AppData\Roaming\calibre\plugins\annotations_resources\dialogs\new_destination.ui
Calibre, and hence Job Spy, was gracefully shut down last time?  True
Last time daemon started:  Thu Feb 16 09:34:56 2017
Last time daemon failed:  never
Total daemon starts inception_to_date:  1
Total daemon failures inception-to-date:  0
Job Spy has finished initialization...
DEBUG:    0.0 HttpHelper::__init__: proxy=None
EpubMerge: DEBUG: 2017-05-26 12:02:16,698: calibre_plugins.epubmerge.epubmerge_plugin(152): macmenuhack file_path:C:\Users\Armin\AppData\Roaming\calibre\plugins\fanficfare_macmenuhack.txt
C:\Program Files\Calibre2\app\pylib.zip\dateutil\parser.py:601: UnicodeWarning: Unicode equal comparison failed to convert both arguments to Unicode - interpreting them as being unequal
Started up in 7.27 seconds with 3526 books
DEBUG:   15.6 AnnotationsAction:shutting_down() 
MFI self.tmp_directory never used; returning True for shutdown.

[kovidgoyal]

@DD: I'll need the log from when the error occurs. Did the error occur in this session, becaue I can see no trace of it in the log.

[JimmXinu]

Originally Posted by kovidgoyal

@JimmXinu: This should fix the library name issue, however, I currently dont have access to a windows machine to test, so I'd appreciate it if you could let me know if it works:

https://github.com/kovidgoyal/calibr...6d690906bb9002

That's fixed it, thanks.

Unrelated issue:

While sending books to my Kindle Voyage (using Reading List sync if it matters), there was a MemoryError:

DeviceJob: 38 Send metadata to device done, calling callback

Traceback (most recent call last):
  File "C:\Users\retief\Desktop\nook\calibre\src\calibre\gui2\device.py", line 88, in run
  File "C:\Users\retief\Desktop\nook\calibre\src\calibre\gui2\device.py", line 541, in _sync_booklists
  File "C:\Users\retief\Desktop\nook\calibre\src\calibre\devices\usbms\driver.py", line 448, in sync_booklists
  File "C:\Users\retief\Desktop\nook\calibre\src\calibre\devices\usbms\driver.py", line 446, in write_prefix
  File "C:\Users\retief\Desktop\nook\calibre\src\calibre\ebooks\metadata\book\json_codec.py", line 134, in encode_to_file
  File "json\__init__.py", line 251, in dumps
  File "json\encoder.py", line 210, in encode
MemoryError

I've only seen it once.

[kovidgoyal]

I doubt that has anything to do with the beta -- it seems to be in the python stdlib. Does it happen again if you resend that book?

[Divingduck]

It seems there is nothing in. I become this short time after starting the GUI (~5 to 8 sec) with more or less nothing in the log file. Then I try to start the server from GUI via connect/share and get the error again w/o additional info in the log file

Spoiler:

calibre, version 2.99.6
FEHLER: Inhalteserver konnte nicht gestartet werden: Inhalteserver konnte nicht gestartet werden. Fehler:

[Errno 13] Permission denied: u'C:\\Program Files\\Calibre2\\app\\resources\\content-server\\index-generated.html.tmp'

Then I took the way via preferences and do not get any warnings (start botton change to gray but no server access and the following in the log.

Spoiler:

calibre Fehlerdiagnoseprotokoll
calibre 2.99.6* [64bit]  embedded-python: True is64bit: True
Windows-10-10.0.14393-SP0 Windows ('64bit', 'WindowsPE')
('Windows', '10', '10.0.14393')
Python 2.7.12+
Windows: ('10', '10.0.14393', 'SP0', u'Multiprocessor Free')
Successfully initialized third party plugins: DeDRM (6, 5, 3) && EpubMerge (2, 1, 0) && Goodreads (1, 1, 12) && EpubSplit (2, 2, 0) && Wiki Reader (2, 1, 0) && Annotations (1, 4, 11) && Extract ISBN (1, 4, 4) && KoboTouchExtended (2, 8, 2) && Open With (1, 5, 10) && Library Codes (1, 0, 30) && food network Recipe Reader (1, 0, 2) && Modify ePub (1, 3, 13) && Media File Importer (1, 0, 19) && ScrambleEbook (0, 0, 5) && Quality Check (1, 9, 11) && Search The Internet (1, 7, 6) && Job Spy (1, 0, 55) && Generate Cover (1, 5, 21) && Goodreads Sync (1, 10, 1) && Count Pages (1, 7, 0) && KindleUnpack - The Plugin (0, 81, 4) && Diaps Editing Toolbag (0, 3, 4) && Favourites Menu (1, 0, 4) && Find Duplicates (1, 6, 2) && Import List (1, 1, 5) && Manage Sony x50 Reader Book List (1, 2, 11) && BOL_DE (0, 7, 5)
calibre 2.99.6* [64bit]  embedded-python: True is64bit: True
Windows-10-10.0.14393-SP0 Windows ('64bit', 'WindowsPE')
('Windows', '10', '10.0.14393')
Python 2.7.12+
Windows: ('10', '10.0.14393', 'SP0', u'Multiprocessor Free')
Successfully initialized third party plugins: DeDRM (6, 5, 3) && EpubMerge (2, 1, 0) && Goodreads (1, 1, 12) && EpubSplit (2, 2, 0) && Wiki Reader (2, 1, 0) && Annotations (1, 4, 11) && Extract ISBN (1, 4, 4) && KoboTouchExtended (2, 8, 2) && Open With (1, 5, 10) && Library Codes (1, 0, 30) && food network Recipe Reader (1, 0, 2) && Modify ePub (1, 3, 13) && Media File Importer (1, 0, 19) && ScrambleEbook (0, 0, 5) && Quality Check (1, 9, 11) && Search The Internet (1, 7, 6) && Job Spy (1, 0, 55) && Generate Cover (1, 5, 21) && Goodreads Sync (1, 10, 1) && Count Pages (1, 7, 0) && KindleUnpack - The Plugin (0, 81, 4) && Diaps Editing Toolbag (0, 3, 4) && Favourites Menu (1, 0, 4) && Find Duplicates (1, 6, 2) && Import List (1, 1, 5) && Manage Sony x50 Reader Book List (1, 2, 11) && BOL_DE (0, 7, 5)
Turning on automatic hidpi scaling
devicePixelRatio: 1.0
logicalDpi: 96.0 x 96.0
physicalDpi: 90.0253164557 x 90.1013513514
Using calibre Qt style: True
Starting up...
EpubMerge: DEBUG: 2017-05-26 19:11:36,803: calibre_plugins.epubmerge.epubmerge_plugin(152): macmenuhack file_path:C:\Users\Armin\AppData\Roaming\calibre\plugins\fanficfare_macmenuhack.txt
Calibre, and hence Job Spy, was gracefully shut down last time?  True
Last time daemon started:  Thu Feb 16 09:34:56 2017
Last time daemon failed:  never
Total daemon starts inception_to_date:  1
Total daemon failures inception-to-date:  0
Job Spy has finished initialization...
DEBUG:    0.0 HttpHelper::__init__: proxy=None
C:\Program Files\Calibre2\app\pylib.zip\dateutil\parser.py:601: UnicodeWarning: Unicode equal comparison failed to convert both arguments to Unicode - interpreting them as being unequal
Started up in 173.89 seconds with 3526 books
MFI self.tmp_directory never used; returning True for shutdown.

Originally Posted by kovidgoyal

@DD: I'll need the log from when the error occurs. Did the error occur in this session, becaue I can see no trace of it in the log.

[kovidgoyal]

@DD: Hmm I cannot replicate it and given that it is not very important (only affects people runnning from source and is easily worked around) I am not going to spend more time on it.

[kovidgoyal]

@JimmXinu: You said that the server did not work with Safari on your iPad. Can you elaborate? What was the problem?

[kovidgoyal]

Released version 2.99.7 with the following changes

1. Fix library name case changing in GUI when switching to a library that was used in the server
2. Fix incorrect search expression being generated when clicking on ++ entry for hierarchical items
3. Fix start server button in preferences causing a hang if the server fails to start
4. Fix failure to start content server causing the "Start content server" action to actually try to stop the server on the next invocation
5. Add a warning about content server needing re-configuration the first time it is started
6. Nicer error message when IndexedDB fails to initialize
7. Add a setting to the server Book details panel to show all metadata fields instead of only the enabled ones from Preferences->Look & Feel->Book details To access the setting click the three vertical dots in the top right corner of the book details panel
8. Add search the internet functionality to the book details page
9. Detailed list: On very narrow screens hide the comments and place the ratings and series below the title instead of to the right

These were all pretty small changes, so I'm hoping the beta is stabilizing.

[Divingduck]

Originally Posted by kovidgoyal

@DD: Hmm I cannot replicate it and given that it is not very important (only affects people runnning from source and is easily worked around) I am not going to spend more time on it.

It's ok, when I have time a bit later in the evening, I will look on it with the new beta.
Best regards, DD

[JimmXinu]

Originally Posted by kovidgoyal

@JimmXinu: You said that the server did not work with Safari on your iPad. Can you elaborate? What was the problem?

I get a very generic error on first load:


There is no second pop up with 'show details' to click.

It took a bunch of retries before it started working, but I did get remote safari debugging working long enough to see the error in a console:


After that, I can choose a library and browse the contents, switch to list view, view book details, download epub and open in iBooks.

Attempting to read the book in browser gets a download screen, then the 'tap here' instructions, then the cover image is presented. Nothing I tap at that point (except browser back button) does anything. I don't see anything else appear in console.

Chrome on iOS is very similar, except first I get:



Followed by an identical "cannot read book" with no second pop up with 'show details' to click.

The "unhandled error at :0" msg shows up more frequently in chrome (every page load? every click?).

I can choose a library and browse the contents, switch to list view, view book details, download epub and open in iBooks. Albeit frequently dismissing the error boxes.

Attempting to read in browser also goes to cover, but instead of tapping doing nothing, it pops the "unhandled error at :0" again each time.

I did find some indexeddb demo pages that iOS Chrome and Safari worked with, so it does at least work sometimes...

Let me know if there are specific tests I can try.

[kovidgoyal]

Hmm, it looks like IndexedDB is flaky on iOS. Not sure what I can do about that. I'll see if I can get hold of an iOS device of my own to test with.

[kovidgoyal]

For people running from source, you will need to update to beta 2.99.8 as I made a change in how some C code is organized. (the python-regex module's source code is no longer bundled with calibre).

[kovidgoyal]

Oh man, I got hold of an iPad and Safari is awful. I dont know if it will be possible to get the reader working in it at all. And given that Apple allows no other browsing engines on iOS, it maybe that iOS users are completely out of luck.

[Divingduck]

I've just recognize, you add some when virtual libraries in more actions. This is nice. Do you plan to add this as additional restriction option to user profiles too?

Regarding to my running from source I got now with version 2.99.8 a different error message. Maybe this help a bit more.

Spoiler:

calibre, version 2.99.8
ERROR: Failed to start Content server: Could not start the Content server. Error:

Failed to write to file: C:\Program Files\Calibre2\app\resources\rapydscript\lib/gettext.pyj-cached with error: [Errno 13] Permission denied: u'C:\\Program Files\\Calibre2\\app\\resources\\rapydscript\\lib\\_gettext.pyj-cached'

and a lot of errors in debug mode.

[JSWolf]

Originally Posted by Divingduck

I've just recognize, you add some when virtual libraries in more actions. This is nice. Do you plan to add this as additional restriction option to user profiles too?

Regarding to my running from source I got now with version 2.99.8, first run a slightly different error message. Maybe this help a bit more

Spoiler:

calibre, version 2.99.8
ERROR: Failed to start Content server: Could not start the Content server. Error:

Failed to write to file: C:\Program Files\Calibre2\app\resources\rapydscript\lib/gettext.pyj-cached with error: [Errno 13] Permission denied: u'C:\\Program Files\\Calibre2\\app\\resources\\rapydscript\\lib\\_gettext.pyj-cached'

and a lot of errors in debug mode.

The problem is not with Calibre. The problem is where you installed Calibre. Calibre does not have permission to write to Program Files unless you run it in admin mode. Uninstall Calibre and resinstall to a directory not inside Program Files or Program Files (x86).