Beta testers for calibre 3.0 needed

[kovidgoyal]

This particular change is large enough that basically no old server settings survive, including port numbers.

I probably could write some code to migrate the settings, but given that everything about the server is changed, I think it warrants some user attention.

I cannot replicate the GUI showing the wrong port, however. And looking at the code, the only way I can see a mismatch being possible is if the user changes the server preferences and doesnt restart the server or calibre.

Finally, about monitoring the IP address I dont see how that can be done. There is no cross platform way of listening for changes to network configuration reliably.

I suppose what can be done is to re-check the IPs evey time that menu is shown. However, because of some technical details with how menus and actions in Qt work, this may or may not be very reliable.

[kovidgoyal]

Actually on second thoughts, I dont think I will have the menu update every time it is shown. This is because calculating the external IP is *expensive*, it can, depending on networking configuration require generating actual network traffic. Not to mention, I am not at all sure what happens to a server listening on a n interface if the networking config changes.

[kovidgoyal]

@KrayKiwi: Here's a warning dialog that pops up the first time you start the server, if it detects the old server settings. https://github.com/kovidgoyal/calibr...aef5ee07727ca6

[kovidgoyal]

@Wulfread; This should fix your issue with hierarchical series search: https://github.com/kovidgoyal/calibr...2fb9db7e80d4c3

[Krazykiwi]

Thanks Kovid, that popup looks great.

Also, I didn't really expect that you could check it every time the menu is shown, but once on startup if that was doable. If it's not, I think the popup is probably going to be enough to remind people.

[JimmXinu]

Originally Posted by kovidgoyal

@JimmXinu: Hmm can you post the server logs (get them from Preferences->Sharing over the net)

Pulled the lastest master. It took several tries and a considerable wait before the server would start. Now it works as expected--not sure what's up with that. I believe it happened before, too.

I do get a more meaningful error message now:
Error: Could not initialize database
You must allow calibre to use IndexedDB storage in your browser to read books

However, immediately after that, I still get:
Error: Unhandled error
UnknownError
Error at http://juuban.xinu.nu:8080/:9226:22

Here's the server log:

Spoiler:

10.37.99.54 port-53062 - 25/May/2017:13:51:19 -0500 "GET /auto-reload-port?1495738279080 HTTP/1.1" 200 288
10.37.99.54 port-53064 - 25/May/2017:13:51:19 -0500 "GET /calibre.appcache HTTP/1.1" 200 676
10.37.99.54 port-53062 - 25/May/2017:13:51:19 -0500 "GET /interface-data/update?1495738279157 HTTP/1.1" 200 -
10.37.99.54 port-53062 - 25/May/2017:13:51:19 -0500 "GET /favicon.png HTTP/1.1" 304 135
10.37.99.54 port-53062 - 25/May/2017:13:51:19 -0500 "GET /icon/book.png HTTP/1.1" 200 1470
10.37.99.54 port-53064 - 25/May/2017:13:51:19 -0500 "GET /icon/catalog.png HTTP/1.1" 200 946
10.37.99.54 port-53065 - 25/May/2017:13:51:19 -0500 "GET /icon/column.png HTTP/1.1" 200 657
10.37.99.54 port-53062 - 25/May/2017:13:51:19 -0500 "GET /icon/identifiers.png HTTP/1.1" 200 2682
10.37.99.54 port-53064 - 25/May/2017:13:51:19 -0500 "GET /icon/languages.png HTTP/1.1" 200 3163
10.37.99.54 port-53065 - 25/May/2017:13:51:19 -0500 "GET /icon/news.png HTTP/1.1" 200 1401
10.37.99.54 port-53066 - 25/May/2017:13:51:19 -0500 "GET /icon/rating.png HTTP/1.1" 200 2174
10.37.99.54 port-53067 - 25/May/2017:13:51:19 -0500 "GET /icon/publisher.png HTTP/1.1" 200 1701
10.37.99.54 port-53062 - 25/May/2017:13:51:19 -0500 "GET /icon/search.png HTTP/1.1" 200 1663
10.37.99.54 port-53062 - 25/May/2017:13:51:19 -0500 "GET /icon/series.png HTTP/1.1" 200 1608
10.37.99.54 port-53066 - 25/May/2017:13:51:19 -0500 "GET / HTTP/1.1" 200 -
10.37.99.54 port-53064 - 25/May/2017:13:51:19 -0500 "GET /icon/tags.png HTTP/1.1" 200 1834
10.37.99.54 port-53065 - 25/May/2017:13:51:19 -0500 "GET /icon/tb_folder.png HTTP/1.1" 200 1713
10.37.99.54 port-53067 - 25/May/2017:13:51:19 -0500 "GET /icon/user_profile.png HTTP/1.1" 200 1934
10.37.99.54 port-53063 - 25/May/2017:13:51:19 -0500 "GET /interface-data/books-init?library_id=TestingCalibreLibrary&sort=timestamp.desc&1495738279165 HTTP/1.1" 200 -
10.37.99.54 port-53066 - 25/May/2017:13:51:19 -0500 "GET /calibre.appcache HTTP/1.1" 200 676
10.37.99.54 port-53066 - 25/May/2017:13:51:22 -0500 "GET /auto-reload-port?1495738282033 HTTP/1.1" 200 288
10.37.99.54 port-53066 - 25/May/2017:13:51:22 -0500 "GET /interface-data/update?1495738282083 HTTP/1.1" 200 -
10.37.99.54 port-53064 - 25/May/2017:13:51:22 -0500 "GET /calibre.appcache HTTP/1.1" 304 135
10.37.99.54 port-53063 - 25/May/2017:13:51:22 -0500 "GET /interface-data/books-init?library_id=TestingCalibreLibrary&sort=timestamp.desc&1495738282089 HTTP/1.1" 200 -

FYI, I've tried a couple IndexedDB demo pages and they also failed with some unknown error during the DB open() call.

So apparently this is something wrong with my Firefox install.
(Update -- uninstall and reinstall of FF didn't help.)

Unrelated New Issue:

In the GUI, if I switch to a library that I have open in a browser (currently or previously?--not sure), I end up with a second, all lowercase entry for the same library. Those remain even after switch back to 2.85 and have to be removed manually:

[BetterRed]

I added a format file to an existing book, it didn't appear on the running server. It did appear after I installed a new version of Chrome, but I assume that was a red herring

I recall seeing a message referring to the need to refresh the server 'cache' (or something similar), I think that was after installing a new version of the beta. My questions are:

What triggers the refresh? Can something be added to Settings to force a refresh. Or would a Library switch do the trick?
=======================

Any chance of adding a third choice, Open in default handler (perhaps for non-EPUB formats only), to:



BR

[Wulfread]

Originally Posted by kovidgoyal

@Wulfread:

As for your errors reading books, they look like timeouts in the proxy. Does it work if you access the server directly without a proxy?

Via Apache-ProxyPass (LAN)
Small CBZ: Work
Big CBZ: Don't Work (i don't really know ... 150+ MByte?!)
ePub: Don't work

Directly (LAN)
Small CBZ: Work
Big CBZ: Work
ePub: Work

Mhhhh

Looks like a problem with my Apache-ProxyPass-Config ...

My Config:
Calibre: prefix /blabla/blubb

Apache:
# Reverse-Proxy
RewriteEngine on
RewriteRule ^/blabla/blubb/(.*) http://127.0.0.1:8080/blabla/blubb/$1 [proxy]
RewriteRule ^/blabla/blubb http://127.0.0.1:8080 [proxy]
SetEnv force-proxy-request-1.0 1
SetEnv proxy-nokeepalive 1

---
I use http/2, ssl, 64bit @ Windows. Firewall/Virusscan for Apache "off"

[JimmXinu]

Originally Posted by JimmXinu

...
So apparently this is something wrong with my Firefox install.
(Update -- uninstall and reinstall of FF didn't help.)

I've found a 'fix' for this. Some googling lead me to this FireFox bug comment. I found that my 'storage' dir was dated Feb 2015. Deleting everything in it (with FireFox off, then restart) and IndexedDB started working for me.

Originally Posted by JimmXinu

Unrelated New Issue:

In the GUI, if I switch to a library that I have open in a browser (currently or previously?--not sure), I end up with a second, all lowercase entry for the same library. Those remain even after switch back to 2.85 and have to be removed manually:

I am definitely seeing this. Replicate steps

• Run GUI
• Start content server
• Visit content server web server
• Enter a library in browser, 'read' a book
• Return to GUI, switch to any library that has been visited in the running content server
• The library switched to will an all-lowercase named version and both will now appear in your library list.

I don't have any libraries without uppercase, so I don't know what happens then.

[JSWolf]

I restarted Firefox in safe mode and the 4th columns till does not show up.

[BetterRed]

Originally Posted by JimmXinu

I am definitely seeing this. Replicate steps

• Run GUI
• Start content server
• Visit content server web server
• Enter a library in browser, 'read' a book
• Return to GUI, switch to any library that has been visited in the running content server
• The library switched to will an all-lowercase named version and both will now appear in your library list.

I don't have any libraries without uppercase, so I don't know what happens then.

Confirmed



I've visited and read books in both the Calibre Library and the _Test libraries, but it seems only the _Test library ever gets lower cased, couldn't make it happen with the Calibre Library

Originally Posted by JSWolf

I restarted Firefox in safe mode and the 4th columns till does not show up.

Maybe because the Fourth Estate and the Fifth Column are becoming one and the same, according to some

BR

[kovidgoyal]

@JimmXinu: You get a long delay at first start when running from source because the RapydScript code is being compiled to JavaScript. I'll look into the library naming issue.

@BR: Doesn't Download book do that already? As far as I know there is no way to open files in a program on the local computer from within a webpage.

@Wulfread: Not sure what to tell you, I dont have much experience with Apache proxying -- it's been several years since I last used apache. Since the server itself works but you only get timeouts when transferring large files, I'd look into some Proxy keep alive settings.

@JSWolf: Yeah, like I said, it is hard for me to do anything about it until I can replicate it. It simply isn't happening in my Firefox, I've tried with many different font sizes, margin sizes, window sizes, number of columns.

[kovidgoyal]

@JimmXinu: This should fix the library name issue, however, I currently dont have access to a windows machine to test, so I'd appreciate it if you could let me know if it works:

https://github.com/kovidgoyal/calibr...6d690906bb9002

[Divingduck]

Hi Kovid,
I just run calibre from actual source (dl 10 minutes ago):

Spoiler:

calibre, version 2.99.6
FEHLER: Inhalteserver konnte nicht gestartet werden: Inhalteserver konnte nicht gestartet werden. Fehler:

[Errno 13] Permission denied: u'C:\\Program Files\\Calibre2\\app\\resources\\content-server\\index-generated.html.tmp'

The GUI starts normal (automatically start server checked) and I went to servers preferences and short time late I got this message w/o server start.

[kovidgoyal]

That's odd, can you run calibre in debug mode and post the log