Beta testers for calibre 3.0 needed

[kovidgoyal]

@eschwartz: There is currently no way to run the GUI against a server. That is do-able in principle, but requires a lot of work to get right, so it's something for the future. Currently if you want to run the server as a service and the GUI on the same machine, you need to do what I suggested earlier. Create a wrapper script that stops the server before running the GUI and restarts it after quitting. You can have the GUI autostart its embedded server so that the server is down for only a few seconds.

FYI: You should use http://127.0.0.1 not 0.0.0.0 as the server IP address.

That error is caused by an outdated version of mechanize, you need version 3.3

[kovidgoyal]

Incidentally, I've got posts from lots of windows and linux users, but I dont think there are any OS X users running the beta. If you are an OS X user, please post, even if you find no bugs.

[kovidgoyal]

@kacir I tried Rip van Winkle on my linux system, with firefox 53.0.2 and no extensions and it worked fine, and looks very nice

[kovidgoyal]

Released beta version 2.99.4 with fixes for the issues reported by DivingDuck and Martina

[Divingduck]

Works for me. Thanks.

I will do today some further tests with the server. Have you already wrote some documentation for the new functions and CLI changes? It would be fine to have something preliminary.

One thing I recognize by setting up the limited access for users was that it would be nice to have a selection box for existing libraries so that a admin do not need to search the libraries.
It seems that I loose from time to time the covers from the first page again (as already reported). I need to check more systematical these issues.

Any idea about the issue with restricted user account logins?

Best regards,
DD

[kovidgoyal]

@DD I still have to look into the issues you first reported, problem is I find them hard to replicate.

As for documentation, not really. I prefer to write documentation one the features are a bit more mature so I dont have to go back and change things.

Certainly the restrict libraries dialog can be made more friendly to use.

[Terisa de morgan]

Just a question: which are the libraries that are shown at the home page of the content server?

[Martina Schein]

Originally Posted by kovidgoyal

@Martina: I dont think that;s a bug in the beta, it would have happened in calibre 2.x as well. Regardless, this should fix it: https://github.com/kovidgoyal/calibr...c70f08cd89936b

It is correct Kovid. The error also occurs with version 2.85, which my husband has installed on his PC.
However, we do not get the error for all Word files that we have converted from PDF documents, but only at some.
This is not noticeable to me before, since we almost work with ePubs.

Originally Posted by kovidgoyal

Released beta version 2.99.4 with fixes for the issues reported by DivingDuck and Martina

Thanks a lot.

Addendum:
This error still exists. With my test document I still get the error message.

Spoiler:

calibre, version 2.99.4 (win32, embedded-python: True)
Konvertierungsfehler: Fehlgeschlagen: Buch 1 von 1 (Grundgesetz) konvertieren

Buch 1 von 1 (Grundgesetz) konvertieren
C:\Program Files\Calibre2\app\pylib.zip\dateutil\parser.py:60 1: UnicodeWarning: Unicode equal comparison failed to convert both arguments to Unicode - interpreting them as being unequal
Conversion options changed from defaults:
replace_scene_breaks: u'\u2217 \u2217 \u2217'
preserve_cover_aspect_ratio: True
base_font_size: 16.0
font_size_mapping: u'5.0, 7.0, 9.0, 12.0, 13.5, 17.0, 20.0, 22.0, 24.0'
remove_paragraph_spacing_indent_size: 1.0
read_metadata_from_opf: u'C:\\Users\\DARKAN~1\\AppData\\Local\\Temp\\calib re_kcrn3v\\iam0fy.opf'
margin_top: 0.0
insert_metadata: True
chapter_mark: u'none'
margin_bottom: 0.0
output_profile: 'tablet'
no_default_epub_cover: True
extra_css: u'body {page-break-before: always;}\np div {orphans: 3; widows: 3;}\nh1, h2, h3, h4, h5, h6 {-webkit-hyphens: none !important; hyphens: none !important;}'
flow_size: 4096
margin_left: 0.0
minimum_line_height: 100.0
epub_flatten: True
margin_right: 0.0
verbose: 2
filter_css: u',font-family'
Resolved conversion options
calibre version: 2.99.4
{'asciiize': False,
'author_sort': None,
'authors': None,
'base_font_size': 16.0,
'book_producer': None,
'change_justification': u'original',
'chapter': u"//*[((name()='h1' or name()='h2') and re:test(., '\\s*((chapter|book|section|part)\\s+)|((prolog|pr ologue|epilogue)(\\s+|$))', 'i')) or @class = 'chapter']",
'chapter_mark': u'none',
'comments': None,
'cover': None,
'debug_pipeline': None,
'dehyphenate': True,
'delete_blank_paragraphs': True,
'disable_font_rescaling': False,
'docx_inline_subsup': False,
'docx_no_cover': False,
'docx_no_pagebreaks_between_notes': False,
'dont_split_on_page_breaks': False,
'duplicate_links_in_toc': False,
'embed_all_fonts': False,
'embed_font_family': None,
'enable_heuristics': False,
'epub_flatten': True,
'epub_inline_toc': False,
'epub_toc_at_end': False,
'expand_css': False,
'extra_css': u'body {page-break-before: always;}\np div {orphans: 3; widows: 3;}\nh1, h2, h3, h4, h5, h6 {-webkit-hyphens: none !important; hyphens: none !important;}',
'extract_to': None,
'filter_css': u',font-family',
'fix_indents': True,
'flow_size': 4096,
'font_size_mapping': u'5.0, 7.0, 9.0, 12.0, 13.5, 17.0, 20.0, 22.0, 24.0',
'format_scene_breaks': True,
'html_unwrap_factor': 0.4,
'input_encoding': None,
'input_profile': <calibre.customize.profiles.InputProfile object at 0x000001E3A0C1B3C8>,
'insert_blank_line': False,
'insert_blank_line_size': 0.5,
'insert_metadata': True,
'isbn': None,
'italicize_common_cases': True,
'keep_ligatures': False,
'language': None,
'level1_toc': None,
'level2_toc': None,
'level3_toc': None,
'line_height': 0.0,
'linearize_tables': False,
'margin_bottom': 0.0,
'margin_left': 0.0,
'margin_right': 0.0,
'margin_top': 0.0,
'markup_chapter_headings': True,
'max_toc_links': 50,
'minimum_line_height': 100.0,
'no_chapters_in_toc': False,
'no_default_epub_cover': True,
'no_inline_navbars': False,
'no_svg_cover': False,
'output_profile': <calibre.customize.profiles.TabletOutput object at 0x000001E3A0C1BE10>,
'page_breaks_before': u'/',
'prefer_metadata_cover': False,
'preserve_cover_aspect_ratio': True,
'pretty_print': True,
'pubdate': None,
'publisher': None,
'rating': None,
'read_metadata_from_opf': u'C:\\Users\\DARKAN~1\\AppData\\Local\\Temp\\calib re_kcrn3v\\iam0fy.opf',
'remove_fake_margins': True,
'remove_first_image': False,
'remove_paragraph_spacing': False,
'remove_paragraph_spacing_indent_size': 1.0,
'renumber_headings': True,
'replace_scene_breaks': u'\u2217 \u2217 \u2217',
'search_replace': '[]',
'series': None,
'series_index': None,
'smarten_punctuation': False,
'sr1_replace': None,
'sr1_search': None,
'sr2_replace': None,
'sr2_search': None,
'sr3_replace': None,
'sr3_search': None,
'start_reading_at': None,
'subset_embedded_fonts': False,
'tags': None,
'timestamp': None,
'title': None,
'title_sort': None,
'toc_filter': None,
'toc_threshold': 6,
'toc_title': None,
'transform_css_rules': '[]',
'unsmarten_punctuation': False,
'unwrap_lines': True,
'use_auto_toc': False,
'verbose': 2}
InputFormatPlugin: DOCX Input running
on C:\Users\DARKAN~1\AppData\Local\Temp\calibre_kcrn3 v\o4k_xw.docx
Settings word/word/settings.xml do not exist
Styles word/word/styles.xml do not exist
Numbering styles word/word/numbering.xml do not exist
Converting Word markup to HTML
Python function terminated unexpectedly
'Styles' object has no attribute 'theme' (Error Code: 1)
Traceback (most recent call last):
File "site.py", line 101, in main
File "site.py", line 78, in run_entry_point
File "site-packages\calibre\utils\ipc\worker.py", line 195, in main
File "site-packages\calibre\gui2\convert\gui_conversion.py", line 33, in gui_convert_override
File "site-packages\calibre\gui2\convert\gui_conversion.py", line 26, in gui_convert
File "site-packages\calibre\ebooks\conversion\plumber.py", line 1088, in run
File "site-packages\calibre\customize\conversion.py", line 245, in __call__
File "site-packages\calibre\ebooks\conversion\plugins\docx_in put.py", line 34, in convert
File "site-packages\calibre\ebooks\docx\to_html.py", line 122, in __call__
File "site-packages\calibre\ebooks\docx\to_html.py", line 429, in convert_p
File "site-packages\calibre\ebooks\docx\to_html.py", line 678, in convert_run
File "site-packages\calibre\ebooks\docx\styles.py", line 314, in resolve_run
AttributeError: 'Styles' object has no attribute 'theme'

[Divingduck]

@Terisa de morgan, so fare as I can see these are all libraries that you have setup/integrate with calibre

@Kovid,
Indeed, I figure out the same problem here to replicate it in a save way. Just now I think, it have something to do with cache-data within the browser. Anyway, I need to setup some small Test-VM's with clean OS and calibre only for further tests this WE. Maybe I then can give you a better answer for my issues.

Edit:
@Kovid,
Is it maybe possible to show the login username within the Web-Gui?

An other question: Is it allowed to have separate logins on the same machine e.g. in different tabs of an running firefox instance?

When I close a tab within firefox w/o closing firefox it self, the login-information seems to be still there if I open a new tab and connect to the server. There is no new login request. maybe this is one of the issue.

[Terisa de morgan]

Originally Posted by Divingduck

@Terisa de morgan, so fare as I can see these are all libraries that you have setup/integrate with calibre

No, that's the reason I ask Perhaps, if you don't have a lot (like me) you don't catch it.

[Terisa de morgan]

Windows 10, calibre 64, Firefox

1. Looking books by genre inside a virtual library
2. Press : "More books"
3. Error: No more books (the server returned a non-valid response)

I'm sure there are more books, and the details are:

Spoiler:

Traceback (most recent call last):

ρσ_anonfunc@http://localhost:8080/:4822:21
complete_callback@http://localhost:8080/:4793:17
got_more_books@http://localhost:8080/:18841:21
render_ids@http://localhost:8080/:18754:21
append_item@http://localhost:8080/:17395:13

[church mouse]

Originally Posted by kovidgoyal

Incidentally, I've got posts from lots of windows and linux users, but I dont think there are any OS X users running the beta. If you are an OS X user, please post, even if you find no bugs.

I have been running the beta on my MacBook (OSX 10.12.4) for the last couple of days with no issues at all so far. I have been able to transfer using CC to my Android e-reader. Although I do not use the browser/server access usually, I have tested that too with no problems.

Anything specific you want me to keep my eye on?

[Divingduck]

@Terisa de morgan, only a couple

But you are right. I just rename one and regognize that the server didn't recognize the library. I do see also a double entry of one other library in the web-gui. calibre seems to save the drive location two times with drive location e:\... and E:\...

[kovidgoyal]

@Martina: In that case, please open a bug report and attach one of these DOCX files as it looks like there are many things wrong with it that I will have to handle.

@church mouse: Thanks, nothing specific -- as far as I know there is no reason to expect any problems specific to OS X. There was one issue with the OS X global menubar not working that I found in my own testing on OS X, but I fixed that before the beta.

@DD: No, the server uses HTTP authentication, not cookies. So it is not possible to have multiple users in the same browser. This is a limitation of HTTP authentication, and the server has to use it because it also has to work within non-browser software like OPDS readers. Yes, the name should be shown inside the web gui -- I just have not gotten around to implementing it yet.

@Terisa: if you run the server from the calibre GUI it should be all libraries the GUI knows about. You might have to press refresh in the browser to see them. When you say looking for books by genre, you mean doing a search inside a virtual library?

[kovidgoyal]

Originally Posted by Divingduck

But you are right. I just rename one and regognize that the server didn't recognize the library. I do see also a double entry of one other library in the web-gui. calibre seems to save the drive location two times with drive location e:\... and E:\...

Did you restart the server after renaming the library and press refresh in your browser? Generally renaming/adding.deleting libraries are "big" operations and you might have to do both of restart server/refresh browser to see the changes.