New database backend - testers needed - Page 2

mbovenka · 07-28-2013, 01:13 PM

Quote:

Originally Posted by jgoguen

Can you unplug your device, disable the KoboTouchExtended driver, enable the main KoboTouch driver, restart calibre, and see if this still happens?

Yes, it happens with the main driver as well. But it happens with my Kindle DX as well, so it's not a device driver issue as such. Must be something fishy with my setup...

kovidgoyal · 07-28-2013, 01:20 PM

Hmm, according to that log, the last action is to call metadata_downloaded() at line 1073 in gui2/device.py

To debug further, someone that can reproduce the issue is going to have to run from source and stick a few print statements in that function to see where exactly it is hanging.

I initially suspected a deadlock, but if you say that one CPU is pegged, then it cannot be a deadlock.

kovidgoyal · 07-28-2013, 01:21 PM

One thing to try is to disable all third party plugins via Preferences->Plugins and see if that fixes it. I remember that some plugins subscribe to the device connected event and do some processing on it, so uit may be a problem in one of them.

chaley · 07-28-2013, 01:26 PM

FWIW: it works fine with Calibre Companion and the Reading List plugin, although I didn't trigger any Reading List transfers.

Debug log is:

Spoiler:

gbm · 07-28-2013, 02:12 PM

On my Ubuntu 12.04 using gnome all I get is the splash screen. I have to kill calibre using System Monitor and open and edit tweaks.py in a text editor to go back. Was using a new library.

bernie

BetterRed · 07-28-2013, 06:33 PM

On Windows 7 SP 1 calibre, version 0.9.41 64 bit

Start Calibre - seems to be snappier when it gets to the screen display steps, I see three transitions. Not noticeably faster in getting to that stage. But Calibre start times have never been an issue for me - anything that starts faster than firefox is a bonus

Problems

1. Custom Dates that were Undefined are displayed in their spreadsheet cells as "0101 01 01 09 00 00", previously they displayed an empty cell. Format for these dates is "yyyy MM dd hh mm ss"

2. Find Duplicates

Right arrow ALWAYS throws this error (not a crash)

Code:

calibre, version 0.9.41
ERROR: Unhandled exception: <b>AttributeError</b>:'FindDuplicatesAction' object has no attribute 'duplicate_finder'

Traceback (most recent call last):
  File "calibre_plugins.find_duplicates.action", line 200, in show_next_result
AttributeError: 'FindDuplicatesAction' object has no attribute 'duplicate_finder'

Tried to disable Find Duplicates got this error

Code:

calibre, version 0.9.41
ERROR: Plugin cannot be disabled: The plugin: Find Duplicates cannot be disabled

Uninstalled Find Duplicates - could not repeat problem

Its many months since I used Find Duplicates on this library. Today I use it in a 'preparation' library before moving 'clean books' to one of my three 'production' libraries.

I am using Find Duplicates (1.6.1) - which I think is the latest
The problem persists if I uninstall and reinstall Find Duplicates

These two problems will drive me nuts, so I wont do any further testing for now.

BR

gbm · 07-28-2013, 07:05 PM

Quote:

Originally Posted by gbm

On my Ubuntu 12.04 using gnome all I get is the splash screen. I have to kill calibre using System Monitor and open and edit tweaks.py in a text editor to go back. Was using a new library.

bernie

Here is what happens when start in debug.

Spoiler:

bernie

jgoguen · 07-28-2013, 07:48 PM

Install python-apsw. At least that's the Fedora name, there's probably a similar name for Debian. Search for 'apsw' and install the related Python (not Python3!) package.

Is calibre from the official installer supposed to include all these? Are you using the official installer?

I roll my own RPM so I don't really know what the official installer is supposed to have...

gbm · 07-28-2013, 07:55 PM

Quote:

Originally Posted by jgoguen

Install python-apsw. At least that's the Fedora name, there's probably a similar name for Debian. Search for 'apsw' and install the related Python (not Python3!) package.

Is calibre from the official installer supposed to include all these? Are you using the official installer?

I roll my own RPM so I don't really know what the official installer is supposed to have...

Yes Installed using:

Code:

sudo python -c "import sys; py3 = sys.version_info[0] > 2; u = __import__('urllib.request' if py3 else 'urllib', fromlist=1); exec(u.urlopen('http://status.calibre-ebook.com/linux_installer').read()); main(install_dir='/opt')"

Will try installing python-apsw.

bernie

theducks · 07-28-2013, 08:39 PM

Like BR, Find duplicates throws an error on XP

Code:

calibre, version 0.9.41
ERROR: Unhandled exception: <b>AttributeError</b>:'FindDuplicatesAction' object has no attribute 'duplicate_finder'

Traceback (most recent call last):
  File "calibre_plugins.find_duplicates.action", line 190, in toolbar_button_clicked
AttributeError: 'FindDuplicatesAction' object has no attribute 'duplicate_finder'

Right or Left arrow in Library view works without fuss

, even at the ends where it just stops (as it is supposed to do)

A unassigned date mm/dd/yyyy in a custom column is just blank

BetterRed · 07-28-2013, 10:04 PM

Quote:

Originally Posted by theducks

Right or Left arrow in Library view works without fuss

, even at the ends where it just stops (as it is supposed to do)

A unassigned date mm/dd/yyyy in a custom column is just blank

What's Library View ?

See attachments for what i see in Undefined custom dates with olddb and newdb, Meta Date and Last Action Date are custom columns - Publisher Date, a factory column, is OK.

The Find Dup error on right arrow seems intermittent. I've seen the error when I switch physical and virtual libraries and Right Arrow will be OK. But once I get the error with Right Arrow then I get it for all subsequent Right Arrow presses until I do a restart.

I can induce the Right Arrow Problem by doing the following

Select book at top of spreadsheet
Sort spreadsheet on a column that will throw selected book down the list so its not in first page of list,
Ctrl/Home, Right Arrow

With the olddb Ctrl/Home, Right Arrow will make cell 1:1 current
With the newdb it will throw the Find Dup error, as will all subsequent Right Arrows.
If I press Down Arrow/Up Arrow after the Ctrl/Home that will make cell 1:1 current and Right Arrow will be OK - until I do something that makes the error happen on a Right Arrow

And it happens often enough as to render the spreadsheet more or less unusable - particular when combined with the date display issue.

BR

theducks · 07-28-2013, 10:19 PM

Library view is what you show. (other views are Book Details and Metadata Edit)

I have a custom column: Edit EPUB(#edited), Aligned Left

All dates look normal .

Have you tried to change the date display format?

davidfor · 07-28-2013, 10:45 PM

Just changed over to test the Kobo related stuff.

The first thing I noticed was that my custom date column shows "01 Jan 0101" if the date hasn't been set.

Then when I tried to change libraries, it crashed with the Windows "calibre.exe has stopped working". It started with the other library OK, so I did a check library and had the same error. I didn't have a device connected at the time.

I tried both when running from source with the same results. No messages went to the console. I updated the source around the time you release 0.9.41.

I'm running Windows 7, 32bit with all the latest updates.

kovidgoyal · 07-28-2013, 10:49 PM

@davidfor: Send me the metadata.db file from the calibre library for which you get a crash.

davidfor · 07-28-2013, 11:22 PM

@kovid: As far as I can tell, it's all of them. I went back to the old db backend and checked, they all seem OK there. I also ran an SQLite integrity check with no errors. Other than changing library or the check library, everything seems OK.

I have just put a database at http://www.alpha.net.au/~dforrester/metadata.db.

07-28-2013, 01:26 PM	#19
chaley Grand Sorcerer Posts: 11,733 Karma: 6690881 Join Date: Jan 2010 Location: Notts, England Device: Kobo Libra 2	FWIW: it works fine with Calibre Companion and the Reading List plugin, although I didn't trigger any Reading List transfers. Debug log is: Spoiler: Started up in 2.78 seconds with 2312 books SMART_DEV ( 0.01: 0.011) _attach_to_port try ip address "" on port 9090 SMART_DEV ( 0.89: 0.813) startup_on_demand listening on port 9090 SMART_DEV ( 0.93: 0.022) _attach_to_port try ip address "" on port 54982 SMART_DEV ( 0.95: 0.000) startup_on_demand broadcast socket listening on port 54982 SMART_DEV ( 2.00: 1.032) run All IP addresses {'{846EE342-7039-11DE-9D20-806E6F6E6963}': [{'broadcast': '127.255.255. 255', 'netmask': '255.0.0.0', 'addr': '127.0.0.1'}], '{079F0E0A-8581-485F-BE57-EE3E77DEA19E}': [{'addr': '169.254.227.25 3'}], '{850AA568-3020-4789-B1B0-2058B85B1B38}': [{'broadcast': '192.168.220.255', 'netmask': '255.255.255.0', 'addr': '192.168.220.38'}]} SMART_DEV ( 16.21: 14.196) run received broadcast ('localhost', ('192.168.220.6', 54982)) calibre wireless device client (on WALLABY);8080,9090 SMART_DEV ( 18.26: 2.028) run attempt to open device socket SMART_DEV ( 19.08: 0.812) reset SMART_DEV ( 19.10: 0.000) set_progress_reporter SMART_DEV ( 19.13: 0.000) open SMART_DEV ( 19.13: 0.000) _call_client GET_INITIALIZATION_INFO wfr True SMART_DEV ( 19.66: 0.515) open App version #: 40 SMART_DEV ( 19.68: 0.000) open Device can stream books True SMART_DEV ( 19.69: 0.000) open Device can stream metadata True SMART_DEV ( 19.69: 0.000) open Device can receive book binary True SMART_DEV ( 19.71: 0.000) open Device can delete multiple books True SMART_DEV ( 19.72: 0.000) open Client device kind Galaxy Nexus SMART_DEV ( 19.72: 0.000) open Client device name Wireless Device: Galaxy Nexus SMART_DEV ( 19.74: 0.000) open max_book_packet_len 4096 SMART_DEV ( 19.74: 0.000) open Device wants UUID file names True SMART_DEV ( 19.77: 0.016) open selected formats [u'epub', u'mobi', u'azw', u'azw1', u'azw3', u'azw4', u'pdf'] SMART_DEV ( 19.79: 0.000) open extension path lengths {u'azw1': 38, u'azw3': 38, u'azw4': 38, u'mobi': 38, u'pdf': 38, u'epub': 38, u'azw': 38} SMART_DEV ( 19.80: 0.000) open cover height 160 SMART_DEV ( 19.80: 0.000) card_prefix SMART_DEV ( 19.83: 0.015) set_progress_reporter Job: 1 Get device information started SMART_DEV ( 19.85: 0.000) get_device_information SMART_DEV ( 19.86: 0.000) _call_client GET_DEVICE_INFORMATION wfr True SMART_DEV ( 20.11: 0.218) _call_client SET_CALIBRE_DEVICE_INFO wfr True SMART_DEV ( 20.64: 0.515) card_prefix SMART_DEV ( 20.68: 0.000) free_space SMART_DEV ( 20.69: 0.000) _call_client FREE_SPACE wfr True DeviceJob: 1 Get device information done, calling callback DeviceJob: 1 Get device information callback returned SMART_DEV ( 21.00: 0.312) set_progress_reporter Job: 2 Get list of books on device started SMART_DEV ( 21.03: 0.000) books None SMART_DEV ( 21.07: 0.016) _call_client GET_BOOK_COUNT wfr True SMART_DEV ( 21.38: 0.297) books getting book metadata. Done 0 of 116 Job: 1 Get device information finished No details available. SMART_DEV ( 24.08: 2.684) books getting book metadata. Done 100 of 116 SMART_DEV ( 24.50: 0.421) books finished getting book metadata SMART_DEV ( 24.50: 0.000) books carda SMART_DEV ( 24.51: 0.000) books cardb DeviceJob: 2 Get list of books on device done, calling callback SMART_DEV ( 24.61: 0.078) set_plugboards READING LIST: Metadata available: {u'main': {u'device_store_uuid': u'ed8fe3f1-00c7-4d4b-988f-f42f6cc76704', u'prefix': u'', u'device_name': u'Wireless Device: Galaxy Nexus', u'calibre_version': u'0.9.41', u'location_code': u'main', u'last_library_uuid': u'3127fd4f-6e7e-4058-bdd0-7c911eac6456', u'date_last_connected': u'2013-07-28T17:21:18.989000+00:00'}} READING LIST: Sync Now - force_sync= False DeviceJob: 2 Get list of books on device callback returned SMART_DEV ( 24.98: 0.358) set_progress_reporter Job: 3 Send metadata to device startedJob: 2 Get list of books on device finished No details available. SMART_DEV ( 25.00: 0.000) sync_booklists collection attributes [u'tags'] DEBUG: 0.0 Starting get_collections: on_connect DEBUG: 0.0 Renaming rules: {} DEBUG: 0.0 Formatting template: {value}{category:\| (\|)} DEBUG: 0.0 Sorting rules: [] SMART_DEV ( 25.07: 0.062) _call_client SEND_BOOKLISTS wfr False SMART_DEV ( 25.09: 0.000) card_prefix SMART_DEV ( 25.11: 0.000) free_space SMART_DEV ( 25.12: 0.000) _call_client FREE_SPACE wfr True DeviceJob: 3 Send metadata to device done, calling callback DeviceJob: 3 Send metadata to device callback returned SMART_DEV ( 25.59: 0.453) _call_client NOOP wfr True Job: 3 Send metadata to device finished No details available. SMART_DEV ( 35.95: 10.343) _call_client NOOP wfr True

07-28-2013, 06:33 PM	#21
BetterRed null operator (he/him) Posts: 20,550 Karma: 26954694 Join Date: Mar 2012 Location: Sydney Australia Device: none	Date Display in Spreadsheet & Find Duplicates On Windows 7 SP 1 calibre, version 0.9.41 64 bit Start Calibre - seems to be snappier when it gets to the screen display steps, I see three transitions. Not noticeably faster in getting to that stage. But Calibre start times have never been an issue for me - anything that starts faster than firefox is a bonus Problems 1. Custom Dates that were Undefined are displayed in their spreadsheet cells as "0101 01 01 09 00 00", previously they displayed an empty cell. Format for these dates is "yyyy MM dd hh mm ss" 2. Find Duplicates Right arrow ALWAYS throws this error (not a crash) Code: calibre, version 0.9.41 ERROR: Unhandled exception: <b>AttributeError</b>:'FindDuplicatesAction' object has no attribute 'duplicate_finder' Traceback (most recent call last): File "calibre_plugins.find_duplicates.action", line 200, in show_next_result AttributeError: 'FindDuplicatesAction' object has no attribute 'duplicate_finder' Tried to disable Find Duplicates got this error Code: calibre, version 0.9.41 ERROR: Plugin cannot be disabled: The plugin: Find Duplicates cannot be disabled Uninstalled Find Duplicates - could not repeat problem Its many months since I used Find Duplicates on this library. Today I use it in a 'preparation' library before moving 'clean books' to one of my three 'production' libraries. I am using Find Duplicates (1.6.1) - which I think is the latest The problem persists if I uninstall and reinstall Find Duplicates These two problems will drive me nuts, so I wont do any further testing for now. BR Last edited by BetterRed; 07-28-2013 at 08:04 PM.

07-28-2013, 07:48 PM	#23
jgoguen Generally Awesome Person Posts: 1,061 Karma: 2178845 Join Date: Jan 2013 Location: /dev/kmem Device: Kobo Clara HD, Kindle Oasis	Install python-apsw. At least that's the Fedora name, there's probably a similar name for Debian. Search for 'apsw' and install the related Python (not Python3!) package. Is calibre from the official installer supposed to include all these? Are you using the official installer? I roll my own RPM so I don't really know what the official installer is supposed to have... Last edited by jgoguen; 07-28-2013 at 07:50 PM.

07-28-2013, 08:39 PM	#25
theducks Well trained by Cats Posts: 29,779 Karma: 54830978 Join Date: Aug 2009 Location: The Central Coast of California Device: Kobo Libra2,Kobo Aura2v1, K4NT(Fixed: New Bat.), Galaxy Tab A	Like BR, Find duplicates throws an error on XP Code: calibre, version 0.9.41 ERROR: Unhandled exception: <b>AttributeError</b>:'FindDuplicatesAction' object has no attribute 'duplicate_finder' Traceback (most recent call last): File "calibre_plugins.find_duplicates.action", line 190, in toolbar_button_clicked AttributeError: 'FindDuplicatesAction' object has no attribute 'duplicate_finder' Right or Left arrow in Library view works without fuss , even at the ends where it just stops (as it is supposed to do) A unassigned date mm/dd/yyyy in a custom column is just blank

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
MTP support: Testers needed	kovidgoyal	Calibre	68	09-21-2012 03:54 AM
shared backend database?	perler	Calibre	4	01-26-2012 05:37 AM
Windows testers needed	kovidgoyal	Calibre	51	11-21-2010 05:58 AM
OS X testers needed	kovidgoyal	Calibre	23	11-18-2010 12:11 PM
calibre ereader output testers needed	user_none	Other formats	24	05-11-2009 12:00 AM

07-28-2013, 01:20 PM	#17
kovidgoyal creator of calibre Posts: 43,842 Karma: 22666666 Join Date: Oct 2006 Location: Mumbai, India Device: Various	Hmm, according to that log, the last action is to call metadata_downloaded() at line 1073 in gui2/device.py To debug further, someone that can reproduce the issue is going to have to run from source and stick a few print statements in that function to see where exactly it is hanging. I initially suspected a deadlock, but if you say that one CPU is pegged, then it cannot be a deadlock.

07-28-2013, 01:21 PM	#18
kovidgoyal creator of calibre Posts: 43,842 Karma: 22666666 Join Date: Oct 2006 Location: Mumbai, India Device: Various	One thing to try is to disable all third party plugins via Preferences->Plugins and see if that fixes it. I remember that some plugins subscribe to the device connected event and do some processing on it, so uit may be a problem in one of them.

07-28-2013, 02:12 PM	#20
gbm Wizard Posts: 2,082 Karma: 8796704 Join Date: Jun 2010 Device: Kobo Clara HD,Hisence Sero 7 Pro RIP, Nook STR, jetbook lite	On my Ubuntu 12.04 using gnome all I get is the splash screen. I have to kill calibre using System Monitor and open and edit tweaks.py in a text editor to go back. Was using a new library. bernie

07-28-2013, 10:19 PM	#27
theducks Well trained by Cats Posts: 29,779 Karma: 54830978 Join Date: Aug 2009 Location: The Central Coast of California Device: Kobo Libra2,Kobo Aura2v1, K4NT(Fixed: New Bat.), Galaxy Tab A	Library view is what you show. (other views are Book Details and Metadata Edit) I have a custom column: Edit EPUB(#edited), Aligned Left All dates look normal . Have you tried to change the date display format?

07-28-2013, 10:45 PM	#28
davidfor Grand Sorcerer Posts: 24,907 Karma: 47303748 Join Date: Jul 2011 Location: Sydney, Australia Device: Kobo:Touch,Glo, AuraH2O, GloHD,AuraONE, ClaraHD, Libra H2O; tolinoepos	Just changed over to test the Kobo related stuff. The first thing I noticed was that my custom date column shows "01 Jan 0101" if the date hasn't been set. Then when I tried to change libraries, it crashed with the Windows "calibre.exe has stopped working". It started with the other library OK, so I did a check library and had the same error. I didn't have a device connected at the time. I tried both when running from source with the same results. No messages went to the console. I updated the source around the time you release 0.9.41. I'm running Windows 7, 32bit with all the latest updates.

07-28-2013, 10:49 PM	#29
kovidgoyal creator of calibre Posts: 43,842 Karma: 22666666 Join Date: Oct 2006 Location: Mumbai, India Device: Various	@davidfor: Send me the metadata.db file from the calibre library for which you get a crash.

07-28-2013, 11:22 PM	#30
davidfor Grand Sorcerer Posts: 24,907 Karma: 47303748 Join Date: Jul 2011 Location: Sydney, Australia Device: Kobo:Touch,Glo, AuraH2O, GloHD,AuraONE, ClaraHD, Libra H2O; tolinoepos	@kovid: As far as I can tell, it's all of them. I went back to the old db backend and checked, they all seem OK there. I also ran an SQLite integrity check with no errors. Other than changing library or the check library, everything seems OK. I have just put a database at http://www.alpha.net.au/~dforrester/metadata.db.

Advert

Advert