calibre 0.6.0 released

[melanti]

Hopefully this is fixable since I like this program.

It started when I upgraded to version 0.6.6 for Linux. I don't recall specifically what version I had before this, but it'd been a few months since I updated versions.

My regular expression for parsing the author/title is:
(?P<author>[^-]+) - (?P<title>.+)

When I put in a file name and click the "test" button, it works fine. It detects the authors and titles as it should.
But... when I try to add books to the database, the Author shows up fine, but the title is the full file name minus the extension. In other words, it's the author - title.
I tried changing the expression and change it back, but it didn't help.

This worked just fine until I upgraded. I even tried readding things that worked before the upgrade, but it doesn't work now.
Any ideas?

If it makes any difference, my distribution is the Hardy heron, so it's not available in the repositories; I have to install it manually.
Thanks!

update: Just uninstalled/reinstalled, and got the same thing. Even leaving it at the default regular expression, it detects the title as the entire string.

[gai-jin]

Kovid -- I see you added a database check in the new version, thank you! That is exactly what I needed to address my problem.

THANKS!

[artbatista]

EDIT: I ran the html thru a cleaner and now it converts fine. Must have been some crud in there somewhere.

Art


Kovid, I seem to not be able to post new tickets. I get this when I log on:



I get this error converting a html file to epub:

ERROR: Conversion Error: <b>Failed</b>: Convert book 1 of 1 (u"Kushiel's Scion")

Convert book 1 of 1 (u"Kushiel's Scion")
Processing archive...
InputFormatPlugin: HTML Input running on c:\users\arturo\appdata\local\temp\calibre_0.6.6_anrplh_plumber\content.opf
Parsing all content...
Manifest item 'toc.ncx' not found
Parsing Jacqueline%20Carey%20-%20%5bKushiel%2004%5d%20-%20Kushiel%27s%20Scion%20%28v1.0%29.html ...
Parsing style.css ...
Property: Unknown Property name. [155:5: backround]
Generating default TOC from spine...
Merging user specified metadata...
Detecting structure...
	Detected chapter: KUSHIEL'S SCION
	Detected chapter: Jacqueline Carey
	Detected chapter: Contents
	Detected chapter: 
	Detected chapter: 
	Detected chapter: DRAMATIS PERSONAE
	Detected chapter: 
	Detected chapter: Prologue
	Detected chapter: Chapter One
	Detected chapter: Chapter Two
	Detected chapter: Chapter Three
	Detected chapter: Chapter Four
	Detected chapter: Chapter Five
	Detected chapter: Chapter Six
	Detected chapter: Chapter Seven
	Detected chapter: Chapter Eight
	Detected chapter: Chapter Nine
	Detected chapter: Chapter Ten
	Detected chapter: Chapter Eleven
	Detected chapter: Chapter Twelve
	Detected chapter: Chapter Thirteen
	Detected chapter: Chapter Fourteen
	Detected chapter: Chapter Fifteen
	Detected chapter: Chapter Sixteen
	Detected chapter: Chapter Seventeen
	Detected chapter: Chapter Eighteen
	Detected chapter: Chapter Nineteen
	Detected chapter: Chapter Twenty
	Detected chapter: Chapter Twenty-One
	Detected chapter: Chapter Twenty-Two
	Detected chapter: Chapter Twenty-Three
	Detected chapter: Chapter Twenty-Four
	Detected chapter: Chapter Twenty-Five
	Detected chapter: Chapter Twenty-Six
	Detected chapter: Chapter Twenty-Seven
	Detected chapter: Chapter Twenty-Eight
	Detected chapter: Chapter Twenty-Nine
	Detected chapter: Chapter Thirty
	Detected chapter: Chapter Thirty-One
	Detected chapter: Chapter Thirty-Two
	Detected chapter: Chapter Thirty-Three
	Detected chapter: Chapter Thirty-Four
	Detected chapter: Chapter Thirty-Five
	Detected chapter: Chapter Thirty-Six
	Detected chapter: Chapter Thirty-Seven
	Detected chapter: Chapter Thirty-Eight
	Detected chapter: Chapter Thirty-Nine
	Detected chapter: Chapter Forty
	Detected chapter: Chapter Forty-One
	Detected chapter: Chapter Forty-Two
	Detected chapter: Chapter Forty-Three
	Detected chapter: Chapter Forty-Four
	Detected chapter: Chapter Forty-Five
	Detected chapter: Chapter Forty-Six
	Detected chapter: Chapter Forty-Seven
	Detected chapter: Chapter Forty-Eight
	Detected chapter: Chapter Forty-Nine
	Detected chapter: Chapter Fifty
	Detected chapter: Chapter Fifty-One
	Detected chapter: Chapter Fifty-Two
	Detected chapter: Chapter Fifty-Three
	Detected chapter: Chapter Fifty-Four
	Detected chapter: Chapter Fifty-Five
	Detected chapter: Chapter Fifty-Six
	Detected chapter: Chapter Fifty-Seven
	Detected chapter: Chapter Fifty-Eight
	Detected chapter: Chapter Fifty-Nine
	Detected chapter: Chapter Sixty
	Detected chapter: Chapter Sixty-One
	Detected chapter: Chapter Sixty-Two
	Detected chapter: Chapter Sixty-Three
	Detected chapter: Chapter Sixty-Four
	Detected chapter: Chapter Sixty-Five
	Detected chapter: Chapter Sixty-Six
	Detected chapter: Chapter Sixty-Seven
	Detected chapter: Chapter Sixty-Eight
	Detected chapter: Chapter Sixty-Nine
	Detected chapter: Chapter Seventy
	Detected chapter: Chapter Seventy-One
Auto generated TOC with 79 entries.
Flattening CSS and remapping font sizes...
Traceback (most recent call last):
  File "worker.py", line 103, in <module>
  File "worker.py", line 90, in main
  File "calibre\gui2\convert\gui_conversion.pyo", line 17, in gui_convert
  File "calibre\ebooks\conversion\plumber.pyo", line 719, in run
  File "calibre\ebooks\oeb\transforms\flatcss.pyo", line 123, in __call__
  File "calibre\ebooks\oeb\transforms\flatcss.pyo", line 167, in baseline_spine
ValueError: max() arg is an empty sequence

Here is the html book in question:

http://tradewars.dnsdojo.org/files/Kushiel's Scion - Jacqueline Carey.zip

Thank you for your help.

Art

[artbatista]

Got an email to verify my email. I can enter new tickets now.

Thank you.

Art

[titanliu]

ths, I had download the latest vision, but not good for Chinese Language.

[Yosa]

When I edit metadata and press the button at the bottom to "Fetch Metadata from Server" the new box that opens up and says "No Metadata found, try adjusting the title and author or the ISBN key." now only has a "copy" button and no "cancel" or anything so it hangs on that dialog and you're stuck until you force quit the program.

Running under Mac OSX

[itimpi]

Are you sure there is not a close-dialog checkbox at the top? There is on Windows so you can close the dialog that way. However I agree that an OK (or Cancel) button should be put back to give a tidy way close it.

[cutterjohn42]

Ok Kovid, I've got a real bug this time, but I don't have time to double check it:
Ubuntu 9.04 x86-64 Calibre 0.6.6
Could not unmount Sony Reader Main Memory from desktop, complained about root privileges.
(Gnome desktop standard install)

Unmounting memory card from desktop worked OK though. (I did that one first. Main memory still showed a smounted in a CLI check, memory card unmounted)

Manually unmounted by CLI.

Might be a permissions problem with the mount helper...

[kovidgoyal]

Originally Posted by Yosa

When I edit metadata and press the button at the bottom to "Fetch Metadata from Server" the new box that opens up and says "No Metadata found, try adjusting the title and author or the ISBN key." now only has a "copy" button and no "cancel" or anything so it hangs on that dialog and you're stuck until you force quit the program.

Running under Mac OSX

Known bug, will be fixed in next release.

[kovidgoyal]

Post the result of

ls -l calibre-mount-helper

[cutterjohn42]

-rws--s--x 1 root root 12158 2009-08-10 21:22 /opt/calibre/calibre-mount-helper

Hmm looks OK(I think). Let me try mounting the the PRS505(what I have) again and I'll update this post.

This time:
Dialog

Cannot unmount the volume 'Sony Reader Storage Card'.

details

umount: /dev/sdd1: not mounted

(First time complained about mtab entry)

a second dialog pops up:

Unable to unmount Sony Reader Storage Card

DBus error org.freedesktop.DBus.Error.NoReply: Did not receive reply.
Possible causes include: the remote application did not send a reply,
the message bus security policy blocked the reply, the reply
timeout expired, or the network connection was broken.

mtab

/dev/sda7 / ext3 rw,relatime,errors=remount-ro,commit=600 0 0
tmpfs /lib/init/rw tmpfs rw,nosuid,mode=0755 0 0
proc /proc proc rw,noexec,nosuid,nodev 0 0
sysfs /sys sysfs rw,noexec,nosuid,nodev 0 0
varrun /var/run tmpfs rw,nosuid,mode=0755 0 0
varlock /var/lock tmpfs rw,noexec,nosuid,nodev,mode=1777 0 0
udev /dev tmpfs rw,mode=0755 0 0
tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0
devpts /dev/pts devpts rw,noexec,nosuid,gid=5,mode=620 0 0
fusectl /sys/fs/fuse/connections fusectl rw 0 0

mount

/dev/sda7 on / type ext3 (rw,relatime,errors=remount-ro,commit=600)
tmpfs on /lib/init/rw type tmpfs (rw,nosuid,mode=0755)
proc on /proc type proc (rw,noexec,nosuid,nodev)
sysfs on /sys type sysfs (rw,noexec,nosuid,nodev)
varrun on /var/run type tmpfs (rw,nosuid,mode=0755)
varlock on /var/lock type tmpfs (rw,noexec,nosuid,nodev,mode=1777)
udev on /dev type tmpfs (rw,mode=0755)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,noexec,nosuid,gid=5,mode=620)
fusectl on /sys/fs/fuse/connections type fusectl (rw)

I've got an old Sony Main memory directory in media which wasn't removed before(have to clean that up), and a new one with an appended <space> and (1)

Trying to un mount main memory dialog:

Unable to unmount Sony Reader Main Memory (1)
umount: /media/Sony Reader Main Memory (1) is not mounted (according to mtab)

ls from CLI shows contents of both, so they're mounted.

Interesting:
/proc/mounts

rootfs / rootfs rw 0 0
none /sys sysfs rw,nosuid,nodev,noexec 0 0
none /proc proc rw,nosuid,nodev,noexec 0 0
udev /dev tmpfs rw,mode=755 0 0
/dev/disk/by-uuid/d08275b0-f5c1-4e7f-b128-caa93354ef3f / ext3 rw,relatime,errors=remount-ro,commit=600,data=ordered 0 0
tmpfs /lib/init/rw tmpfs rw,nosuid,mode=755 0 0
fusectl /sys/fs/fuse/connections fusectl rw 0 0
varrun /var/run tmpfs rw,nosuid,mode=755 0 0
varlock /var/lock tmpfs rw,nosuid,nodev,noexec 0 0
tmpfs /lib/modules/2.6.28-14-generic/volatile tmpfs rw,mode=755 0 0
tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0
devpts /dev/pts devpts rw,nosuid,noexec,gid=5,mode=620 0 0
/dev/sda4 /media/New_Volume fuseblk rw,nosuid,nodev,user_id=0,group_id=0,allow_other,blksize=4096 0 0
/dev/sda2 /media/windows fuseblk rw,nosuid,nodev,user_id=0,group_id=0,allow_other,blksize=4096 0 0
/dev/sda5 /media/misc2 fuseblk rw,nosuid,nodev,user_id=0,group_id=0,allow_other,blksize=4096 0 0
securityfs /sys/kernel/security securityfs rw 0 0
binfmt_misc /proc/sys/fs/binfmt_misc binfmt_misc rw,nosuid,nodev,noexec 0 0
gvfs-fuse-daemon /home/moylan/.gvfs fuse.gvfs-fuse-daemon rw,nosuid,nodev,user_id=1000,group_id=1000 0 0
/dev/sdd1 /media/Sony\040Reader\040Storage\040Card vfat rw,nosuid,nodev,uid=1000,fmask=0077,dmask=0077,codepage=cp437,iocharset=iso8859-1,shortname=mixed,utf8,flush 0 0
/dev/sdb /media/Sony\040Reader\040Main\040Memory\040(1) vfat rw,sync,nosuid,nodev,noexec,uid=1000,gid=1000,fmask=0177,dmask=0077,codepage=cp437,iocharset=iso8859-1,shortname=mixed,quiet,utf8 0 0

So it looks like /etc/mtab is NOT being properly updated now, typo? Or actually it looks like fuse doesn't update mtab either, so maybe you're relying on mtab when it appears that /proc/mount should be the source?

[kovidgoyal]

calibre's mount helper simply calls mount to do the mounting. One think to check is if the device is being mounted by calibre or bysomething else on your system?

Dont start claibre and plugin the deivce is it automounted? In which case whatever is doing the automounting is causing the problem.

[cutterjohn42]

Yes. It's always been automounted for me, and worked fine that way up to the 0.6.6 release.

I always plug it in before starting calibre, and the just unmount it from the desktop(after quitting calibre). I never use the unmount option inside of calibre, which is new for 0.6.x series I think anyways.

I'd prefer to keep the auto-mounting as shipped with Ubuntu. No idea what they do now as I haven't bothered digging into those details for years since most linux distros appear to be able to manage mounting fairly well nowadays... (although when installing 8.10 on this notebook I had to dredge up some rusty old skills as I had to use the alternate text installer since the video drivers didn't work. I thought that I had left those days behind forever... at least I didn't have to bootstrap gcc and build X...)

[EDIT]
Started digging a little, dmesg turns up

[132764.420800] usb 2-4: new high speed USB device using ehci_hcd and address 3
[132764.553933] usb 2-4: configuration #1 chosen from 2 choices
[132764.565342] scsi7 : SCSI emulation for USB Mass Storage devices
[132764.566083] usb-storage: device found at 3
[132764.566085] usb-storage: waiting for device to settle before scanning
[132769.564466] usb-storage: device scan complete
[132769.565064] scsi 7:0:0:0: Direct-Access     Sony     PRS-505/UC       1000 PQ: 0 ANSI: 2
[132769.565505] scsi 7:0:0:1: Direct-Access     Sony     PRS-505/UC:MS    1000 PQ: 0 ANSI: 2
[132769.566689] scsi 7:0:0:2: Direct-Access     Sony     PRS-505/UC:SD    1000 PQ: 0 ANSI: 2
[132769.577360] sd 7:0:0:0: [sdb] 430848 512-byte hardware sectors: (220 MB/210 MiB)
[132769.578106] sd 7:0:0:0: [sdb] Write Protect is off
[132769.578108] sd 7:0:0:0: [sdb] Mode Sense: 0f 00 00 00
[132769.578110] sd 7:0:0:0: [sdb] Assuming drive cache: write through
[132769.579731] sd 7:0:0:0: [sdb] 430848 512-byte hardware sectors: (220 MB/210 MiB)
[132769.580480] sd 7:0:0:0: [sdb] Write Protect is off
[132769.580481] sd 7:0:0:0: [sdb] Mode Sense: 0f 00 00 00
[132769.580483] sd 7:0:0:0: [sdb] Assuming drive cache: write through
[132769.580485]  sdb:
[132769.588982] sd 7:0:0:0: [sdb] Attached SCSI removable disk
[132769.589046] sd 7:0:0:0: Attached scsi generic sg2 type 0
[132769.591316] sd 7:0:0:1: [sdc] Attached SCSI removable disk
[132769.591368] sd 7:0:0:1: Attached scsi generic sg3 type 0
[132769.594869] sd 7:0:0:2: [sdd] 249344 512-byte hardware sectors: (127 MB/121 MiB)
[132769.687881] sd 7:0:0:2: [sdd] Write Protect is off
[132769.687885] sd 7:0:0:2: [sdd] Mode Sense: 0f 00 00 00
[132769.687887] sd 7:0:0:2: [sdd] Assuming drive cache: write through
[132769.716237] sd 7:0:0:2: [sdd] 249344 512-byte hardware sectors: (127 MB/121 MiB)
[132769.807869] sd 7:0:0:2: [sdd] Write Protect is off
[132769.807871] sd 7:0:0:2: [sdd] Mode Sense: 0f 00 00 00
[132769.807873] sd 7:0:0:2: [sdd] Assuming drive cache: write through
[132769.807878]  sdd: sdd1
[132769.814784] sd 7:0:0:2: [sdd] Attached SCSI removable disk
[132769.814845] sd 7:0:0:2: Attached scsi generic sg4 type 0

which would be the automounting, still looking around to see what they're actually doing though. If it's a userspace daemon, kernel module, or some sort of combination of the two.
[/EDIT]

[kovidgoyal]

I suggest you continue to use it that way then. Don't use the eject functionality in calibre.

On linux setting up automounting is often difficult for users, so I've decided to provide this facility in calibre (it should really be handled at the OS, not the application level). Because of the large variability on existing automount solutions/kernels, it's very hard to come up with a system that will work for everybody, so if you have a system that works, stick to it.

EDIT: I should also say that whatever automounting system you're using is broken if it is not creating entries in mtab

[cutterjohn42]

Thanks Kovid, might want to make the mount helper optional maybe by a text config file (or settings entry in the GUI) for now.

So far I've found the obvious, usb_storage kernel module, but am still looking for the details of how they do the automounting. The Ubuntu forums are a mess to search as they are so highly trafficked, may just risk annoying someone and see if someone in IRC know much about the desktop architecture. I hope that this doesn't turn into a day(s) wasting crusade though... I just get sidetracked into these things far too easily, but at leats they don't happen as often as they used to...