Strange behaviour with PDFs

[timlegge]

Hi

Just doing some testing on the Calibre kobo driver and ran into a strange issue with PDFs (or one pdf as the case may be).

It is on the device. I can read it but the document in not in referenced in the sqllite database and no image files get created.

I looked at the file name and title and I have not noticed anything that might prevent it from getting added to the database.

In fact, it is in the content table with a ContentType = 17. I don't see any rows in volume_shortcovers.

Has anyone noticed similar behavior. I am beginning to think that there is some issue with our understanding of the database.

Has anyone seen similar issues?

Tim

[PeterT]

Tim; I tried an experiment. I saved the SQLlite database; added a single PDF, let the Kobo process it, and then compared the databases.

I found a single row added to the content database.

And like you all I saw was a row with contentType = 17.

I am not that familair with PDF based eBooks. Do they even have a cover image in them?

[PeterT]

I now borrowed a library book in PDF format and added it to the Kobo. I now see 21 new records in the ShortCovers table and these correspond to the Chapters shown in the Table Of Contents on the Kobo.

I also see 22 records in the Content table; 21 records with ContentType=17; again one per entry in the ToC; and 1 record with ContentType=16

There do seem to be images in the .kobo\Images directory; however, I don't see these referenced in the database.

Changes in table content

CHANGE TYPE,ContentID,ContentType,MimeType,BookID,BookTitle,ImageId,Title,Attribution,Description,DateCreated,ShortCoverKey,adobe_location,Publisher,IsEncrypted,DateLastRead,FirstTimeReading,ChapterIDBookmarked,ParagraphBookmarked,BookmarkWordOffset,NumShortcovers,VolumeIndex,___NumPages,ReadStatus,___SyncTime,___UserID
ADDED,"file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf#(0)#pdfloc(c491,1)","17","application/pdf","file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf","Yeah! Yeah! Yeah!",,"Title Page","",,,,"#pdfloc(c491,1)",,False,,False,,0,0,,0,1743896,0,"2010-06-21T08:37:20","adobe_user"
ADDED,"file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf#(1)#pdfloc(c491,2)","17","application/pdf","file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf","Yeah! Yeah! Yeah!",,"Copyright Page","",,,,"#pdfloc(c491,2)",,False,,False,,0,0,,1,1743896,0,"2010-06-21T08:37:20","adobe_user"
ADDED,"file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf#(2)#pdfloc(c491,3)","17","application/pdf","file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf","Yeah! Yeah! Yeah!",,"Dedication","",,,,"#pdfloc(c491,3)",,False,,False,,0,0,,2,1743896,0,"2010-06-21T08:37:20","adobe_user"
ADDED,"file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf#(3)#pdfloc(c491,5)","17","application/pdf","file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf","Yeah! Yeah! Yeah!",,"Contents","",,,,"#pdfloc(c491,5)",,False,,False,,0,0,,3,1743896,0,"2010-06-21T08:37:20","adobe_user"
ADDED,"file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf#(4)#pdfloc(c491,6)","17","application/pdf","file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf","Yeah! Yeah! Yeah!",,"Chapter 1: An Incredible Discovery","",,,,"#pdfloc(c491,6)",,False,,False,,0,0,,4,1743896,0,"2010-06-21T08:37:20","adobe_user"
ADDED,"file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf#(5)#pdfloc(c491,20)","17","application/pdf","file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf","Yeah! Yeah! Yeah!",,"Chapter 2: Born Performers","",,,,"#pdfloc(c491,20)",,False,,False,,0,0,,5,1743896,0,"2010-06-21T08:37:20","adobe_user"
ADDED,"file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf#(6)#pdfloc(c491,38)","17","application/pdf","file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf","Yeah! Yeah! Yeah!",,"Chapter 3: Moondogs and Silver Beetles","",,,,"#pdfloc(c491,38)",,False,,False,,0,0,,6,1743896,0,"2010-06-21T08:37:20","adobe_user"
ADDED,"file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf#(7)#pdfloc(c491,58)","17","application/pdf","file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf","Yeah! Yeah! Yeah!",,"Chapter 4: Their Big Break","",,,,"#pdfloc(c491,58)",,False,,False,,0,0,,7,1743896,0,"2010-06-21T08:37:20","adobe_user"
ADDED,"file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf#(8)#pdfloc(c491,78)","17","application/pdf","file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf","Yeah! Yeah! Yeah!",,"Chapter 5: The Turning Point","",,,,"#pdfloc(c491,78)",,False,,False,,0,0,,8,1743896,0,"2010-06-21T08:37:20","adobe_user"
ADDED,"file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf#(9)#pdfloc(c491,94)","17","application/pdf","file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf","Yeah! Yeah! Yeah!",,"Chapter 6: Beatlemania","",,,,"#pdfloc(c491,94)",,False,,False,,0,0,,9,1743896,0,"2010-06-21T08:37:20","adobe_user"
ADDED,"file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf#(10)#pdfloc(c491,118)","17","application/pdf","file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf","Yeah! Yeah! Yeah!",,"Chapter 7: The British Invasion","",,,,"#pdfloc(c491,118)",,False,,False,,0,0,,10,1743896,0,"2010-06-21T08:37:20","adobe_user"
ADDED,"file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf#(11)#pdfloc(c491,140)","17","application/pdf","file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf","Yeah! Yeah! Yeah!",,"Chapter 8: The Bards of Pop","",,,,"#pdfloc(c491,140)",,False,,False,,0,0,,11,1743896,0,"2010-06-21T08:37:20","adobe_user"
ADDED,"file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf#(12)#pdfloc(c491,160)","17","application/pdf","file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf","Yeah! Yeah! Yeah!",,"Chapter 9: The End of Beatlemania","",,,,"#pdfloc(c491,160)",,False,,False,,0,0,,12,1743896,0,"2010-06-21T08:37:20","adobe_user"
ADDED,"file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf#(13)#pdfloc(c491,176)","17","application/pdf","file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf","Yeah! Yeah! Yeah!",,"Chapter 10: We’ve Had It","",,,,"#pdfloc(c491,176)",,False,,False,,0,0,,13,1743896,0,"2010-06-21T08:37:21","adobe_user"
ADDED,"file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf#(14)#pdfloc(c491,194)","17","application/pdf","file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf","Yeah! Yeah! Yeah!",,"Chapter 11: From Bad to Worse","",,,,"#pdfloc(c491,194)",,False,,False,,0,0,,14,1743896,0,"2010-06-21T08:37:21","adobe_user"
ADDED,"file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf#(15)#pdfloc(c491,212)","17","application/pdf","file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf","Yeah! Yeah! Yeah!",,"Chapter 12: The Dream Is Over","",,,,"#pdfloc(c491,212)",,False,,False,,0,0,,15,1743896,0,"2010-06-21T08:37:21","adobe_user"
ADDED,"file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf#(16)#pdfloc(c491,226)","17","application/pdf","file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf","Yeah! Yeah! Yeah!",,"Endnote","",,,,"#pdfloc(c491,226)",,False,,False,,0,0,,16,1743896,0,"2010-06-21T08:37:21","adobe_user"
ADDED,"file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf#(17)#pdfloc(c491,229)","17","application/pdf","file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf","Yeah! Yeah! Yeah!",,"Discography","",,,,"#pdfloc(c491,229)",,False,,False,,0,0,,17,1743896,0,"2010-06-21T08:37:21","adobe_user"
ADDED,"file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf#(18)#pdfloc(c491,234)","17","application/pdf","file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf","Yeah! Yeah! Yeah!",,"Selected Bibliography","",,,,"#pdfloc(c491,234)",,False,,False,,0,0,,18,1743896,0,"2010-06-21T08:37:21","adobe_user"
ADDED,"file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf#(19)#pdfloc(c491,236)","17","application/pdf","file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf","Yeah! Yeah! Yeah!",,"Index","",,,,"#pdfloc(c491,236)",,False,,False,,0,0,,19,1743896,0,"2010-06-21T08:37:21","adobe_user"
ADDED,"file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf#(20)#pdfloc(c491,240)","17","application/pdf","file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf","Yeah! Yeah! Yeah!",,"Acknowledgments","",,,,"#pdfloc(c491,240)",,False,,False,,0,0,,20,1743896,0,"2010-06-21T08:37:21","adobe_user"
ADDED,"file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf","16","application/pdf",,,"file____mnt_onboard_Digital_Editions_Yeah_Yeah_Yeah_pdf","Yeah! Yeah! Yeah!","Bob Spitz",,"2007-09-22T10:07:25",,,,False,,False,,0,0,21,,241,0,"2010-06-21T08:37:24","adobe_user"

Changes in table volume_shortcovers

CHANGE TYPE,volumeId,shortcoverId,VolumeIndex
ADDED,"file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf","file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf#(0)#pdfloc(c491,1)",0
ADDED,"file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf","file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf#(1)#pdfloc(c491,2)",1
ADDED,"file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf","file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf#(2)#pdfloc(c491,3)",2
ADDED,"file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf","file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf#(3)#pdfloc(c491,5)",3
ADDED,"file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf","file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf#(4)#pdfloc(c491,6)",4
ADDED,"file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf","file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf#(5)#pdfloc(c491,20)",5
ADDED,"file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf","file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf#(6)#pdfloc(c491,38)",6
ADDED,"file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf","file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf#(7)#pdfloc(c491,58)",7
ADDED,"file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf","file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf#(8)#pdfloc(c491,78)",8
ADDED,"file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf","file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf#(9)#pdfloc(c491,94)",9
ADDED,"file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf","file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf#(10)#pdfloc(c491,118)",10
ADDED,"file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf","file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf#(11)#pdfloc(c491,140)",11
ADDED,"file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf","file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf#(12)#pdfloc(c491,160)",12
ADDED,"file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf","file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf#(13)#pdfloc(c491,176)",13
ADDED,"file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf","file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf#(14)#pdfloc(c491,194)",14
ADDED,"file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf","file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf#(15)#pdfloc(c491,212)",15
ADDED,"file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf","file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf#(16)#pdfloc(c491,226)",16
ADDED,"file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf","file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf#(17)#pdfloc(c491,229)",17
ADDED,"file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf","file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf#(18)#pdfloc(c491,234)",18
ADDED,"file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf","file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf#(19)#pdfloc(c491,236)",19
ADDED,"file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf","file:///mnt/onboard/Digital Editions/Yeah_Yeah_Yeah.pdf#(20)#pdfloc(c491,240)",20

[timlegge]

Originally Posted by PeterT

Tim; I tried an experiment. I saved the SQLlite database; added a single PDF, let the Kobo process it, and then compared the databases.

I found a single row added to the content database.

And like you all I saw was a row with contentType = 17.

I am not that familair with PDF based eBooks. Do they even have a cover image in them?

I figured out the issue. I have been doing the wrong query. I am so used to dealing with databases built by people who don't know the purpose of an index I overlooked a very nice one.

This query is wrong and slow:

select Title, Attribution, DateCreated, ContentID, MimeType, ContentType, ImageID from content where ContentID in (select distinct volumeId from volume_shortcovers)'

This query is correct and fast:

select Title, Attribution, DateCreated, ContentID, MimeType, ContentType, ImageID from content where BookID is Null'

Tim