[The Older version] Calibre2opds V2

[itimpi]

Originally Posted by electronicfur

I did a clean run overnight on my library, and I've done a spot check of some of the problem books. All the ones I checked had valid xml and html now, so it looks like it's fixed.

Good to have additional confirmation

Now if I only knew why the problem surfaced in the first place as it seemed to magically disappear without me doing any explicit fix!

[Xenophon]

2.5 beta1 dies with a FileNotFound exception, while trying to copy the catalog. The messages are:

Spoiler:

250818:43:10,522 [] ERROR com.gmail.dpierron.calibre.gui.Mainframe - catalog.xml (No such file or directory)
java.io.FileInputStream.open(Native Method)
java.io.FileInputStream.<init>(FileInputStream.jav a:120)
com.gmail.dpierron.tools.Helper.copy(Helper.java:8 44)
com.gmail.dpierron.calibre.opds.Catalog.createMain Catalog(Catalog.java:902)
com.gmail.dpierron.calibre.gui.Mainframe$2.run(Mai nframe.java:259)
java.lang.Thread.run(Thread.java:680)

java.io.FileNotFoundException: catalog.xml (No such file or directory)
at java.io.FileInputStream.open(Native Method)
at java.io.FileInputStream.<init>(FileInputStream.jav a:120)
at com.gmail.dpierron.tools.Helper.copy(Helper.java:8 44)
at com.gmail.dpierron.calibre.opds.Catalog.createMain Catalog(Catalog.java:902)
at com.gmail.dpierron.calibre.gui.Mainframe$2.run(Mai nframe.java:259)
at java.lang.Thread.run(Thread.java:680)

It also takes about 6 minutes to process the "by author" catalog:

Spoiler:

250818:35:17,771 [] INFO com.gmail.dpierron.calibre.opds.Catalog - generating authors catalog
250818:41:29,332 [] INFO com.gmail.dpierron.calibre.opds.Catalog - done in 371,559 millisec.

Is that normal?

Xenophon

[whodean]

Both 2.4 and 2.5b1 hang on "generating recent books catalog/past month" on my Mac, with no visible progress.

[RockdaMan]

Nevermind...figured it out.

Great little program.

[itimpi]

Originally Posted by whodean

Both 2.4 and 2.5b1 hang on "generating recent books catalog/past month" on my Mac, with no visible progress.

I have no idea what could be causing this.

To investigate it further a copy of your metadata.db file would be needed. If you are happy to provide a copy then email to calibre2opds at itimpi dot freeserve dot co dot UK. With that we can try to see if we can replicate your problem and thus work out the cause and a fix.

[itimpi]

Originally Posted by Xenophon

2.5 beta1 dies with a FileNotFound exception, while trying to copy the catalog.

can you please confirm what mode you are running and what compatibility setting you are using. The file that is causing the problem is catalog.xml that is no longer generated on default settings so I am guessing it is the effect of one of those not being at the default settings that has triggered the fault. My guess is that we probably need to simply copy the index.xml file to catalog.xml to rectify the problem, but I want to make sure we are doing it under the right conditions. I think from the error message that you must be in Nook/Trook mode but it would be nice to have this confirmed.

It also takes about 6 minutes to process the "by author" catalog:
Is that normal?

It depends on a combination of how big your library is, and the speed of the media the library is stored on. It is during that phase that checks are made on all the book files in the library as well as generating the authors catalogs. The results are cached to speed up the later phases to speed them up. It is the quantity of disk I/O that is the dominating factor during this phase, so other disk intensive processes in parallel can also slow things down.

On my system running on a slow NAS with a large library that phase takes me over an hour, so I would be very happy with 6 minutes .

[whodean]

Originally Posted by itimpi

I have no idea what could be causing this.

To investigate it further a copy of your metadata.db file would be needed. If you are happy to provide a copy then email to calibre2opds at itimpi dot freeserve dot co dot UK. With that we can try to see if we can replicate your problem and thus work out the cause and a fix.

Sure, where can I find that file?

[itimpi]

Originally Posted by whodean

Sure, where can I find that file?

That file is in the root of your calibre library folder. It is the one that contains all the metadata for the calibre library. Calibre2opds generates the catalog from the information held in this file.

[FrozenTrout]

Is there any update on an actual OS X release? I've manually updated from the .zip, but my friend is having issues...

[whodean]

Originally Posted by itimpi

That file is in the root of your calibre library folder. It is the one that contains all the metadata for the calibre library. Calibre2opds generates the catalog from the information held in this file.

File has been sent.

[Xenophon]

Originally Posted by itimpi

can you please confirm what mode you are running and what compatibility setting you are using. The file that is causing the problem is catalog.xml that is no longer generated on default settings so I am guessing it is the effect of one of those not being at the default settings that has triggered the fault. My guess is that we probably need to simply copy the index.xml file to catalog.xml to rectify the problem, but I want to make sure we are doing it under the right conditions. I think from the error message that you must be in Nook/Trook mode but it would be nice to have this confirmed.

I'm running in Nook/Trook mode. Settings are as follows:

Spoiler:

<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!DOCTYPE properties SYSTEM "http://java.sun.com/dtd/properties.dtd">
<properties>
<comment>calibre2opds 2.5 beta 1</comment>
<entry key="tagsToExclude"/>
<entry key="CatalogTitle">Calibre library</entry>
<entry key="GoodreadTitleUrl">http://www.goodreads.com/book/title/{0}</entry>
<entry key="GenerateCrossLinks">true</entry>
<entry key="GenerateOpds">true</entry>
<entry key="BookLanguageTag">Lang:</entry>
<entry key="ThumbnailGenerate">true</entry>
<entry key="IncludeAboutLink">false</entry>
<entry key="SaveBandwith">true</entry>
<entry key="TargetFolder">/Users/dfsuther/Downloads/calibre2opds-2.5-beta1/.</entry>
<entry key="CompatibilityTrick">OPDS</entry>
<entry key="MaxCoverSize">300</entry>
<entry key="LibrarythingIsbnUrl">http://www.librarything.com/isbn/{0}</entry>
<entry key="AmazonAuthorUrl">http://www.amazon.com/gp/search/ref=sr_adv_b/?search-alias=stripbooks&amp;unfiltered=1&amp;sort=relevanceexprank&amp;field-author={0}</entry>
<entry key="GenerateHtmlDownloads_ReadOnly">false</entry>
<entry key="GenerateAllbooks">true</entry>
<entry key="GenerateTags">true</entry>
<entry key="ThumbnailHeight">144</entry>
<entry key="IsfdbAuthorUrl">http://www.isfdb.org/cgi-bin/ea.cgi?{0}</entry>
<entry key="SplitInAuthorBooks">false</entry>
<entry key="GenerateDownloads">true</entry>
<entry key="CurrentConfiguration">default</entry>
<entry key="IncludeBooksWithNoFile">false</entry>
<entry key="maxSummaryLength">30</entry>
<entry key="SaveBandwith_ReadOnly">false</entry>
<entry key="SplitInSeriesBooks">false</entry>
<entry key="ZipTrookCatalog">true</entry>
<entry key="ShowSeriesInAuthorCatalog">true</entry>
<entry key="GenerateExternalLinks">true</entry>
<entry key="GenerateHtml">false</entry>
<entry key="AmazonTitleUrl">http://www.amazon.com/gp/search/ref=sr_adv_b/?search-alias=stripbooks&amp;unfiltered=1&amp;sort=relevanceexprank&amp;field-title={0}&amp;field-author={1}</entry>
<entry key="MaxMobileResolution">960</entry>
<entry key="BooksInRecentAdditions">99999</entry>
<entry key="ZipTrookCatalog_ReadOnly">false</entry>
<entry key="IncludedFormatsList">EPUB,PDB,PDF</entry>
<entry key="SuppressRatingsInTitles">true</entry>
<entry key="CoverResize">true</entry>
<entry key="CopyToDatabaseFolder">false</entry>
<entry key="VERSIONCHIP">02030101</entry>
<entry key="BrowseByCoverWithoutSplit">true</entry>
<entry key="GenerateRatings">false</entry>
<entry key="IncludeOnlyOneFile">false</entry>
<entry key="CryptFilenames_ReadOnly">true</entry>
<entry key="SplitTagsOn"/>
<entry key="ReprocessEpubMetadata_ReadOnly">false</entry>
<entry key="CoverHeight">550</entry>
<entry key="SaveBandwidth">true</entry>
<entry key="IncludeBooksWithNoFile_ReadOnly">false</entry>
<entry key="CryptFilenames">false</entry>
<entry key="GoodreadIsbnUrl">http://www.goodreads.com/book/isbn/{0}</entry>
<entry key="CopyToDatabaseFolder_ReadOnly">false</entry>
<entry key="GenerateHtmlDownloads">false</entry>
<entry key="TagsToGenerate"/>
<entry key="GoodreadReviewIsbnUrl">http://www.goodreads.com/review/isbn/{0}</entry>
<entry key="GenerateOpdsDownloads">true</entry>
<entry key="WikipediaLanguage">en</entry>
<entry key="ExternalIcons">false</entry>
<entry key="Language">en</entry>
<entry key="IncludedFormatsList_ReadOnly">false</entry>
<entry key="OrderAllBooksBySeries">true</entry>
<entry key="TagsToMakeDeep"/>
<entry key="TagsToExclude"/>
<entry key="MaxSummaryLength">30</entry>
<entry key="deviceMode">Nook</entry>
<entry key="AmazonIsbnUrl">http://www.amazon.com/gp/search/ref=sr_adv_b/?search-alias=stripbooks&amp;unfiltered=1&amp;sort=relevanceexprank&amp;field-isbn={0}</entry>
<entry key="ThumbnailHeight_ReadOnly">true</entry>
<entry key="LibrarythingTitleUrl">http://www.librarything.com/title/{0} {1}</entry>
<entry key="DeviceMode">Nook</entry>
<entry key="PublishDateAsYear">false</entry>
<entry key="GenerateHtml_ReadOnly">false</entry>
<entry key="DatabaseFolder">/Users/dfsuther/Dropbox/Public/eBooks/Calibre</entry>
<entry key="GoodreadAuthorUrl">http://www.goodreads.com/book/author/{0}</entry>
<entry key="generateCrossLinks">true</entry>
<entry key="tagsToGenerate"/>
<entry key="generateRatings">false</entry>
<entry key="MaxBeforePaginate">25</entry>
<entry key="SplitByAuthorInitialGoToBooks">false</entry>
<entry key="ReprocessEpubMetadata">false</entry>
<entry key="MaxBeforeSplit">75</entry>
<entry key="WikipediaUrl">http://{0}.wikipedia.org/wiki/{1}</entry>
<entry key="generateAllbooks">true</entry>
<entry key="LibrarythingAuthorUrl">http://www.librarything.com/author/{0}</entry>
<entry key="MinBooksToMakeDeepLevel">50</entry>
<entry key="TargetFolder_ReadOnly">false</entry>
<entry key="CatalogFolderName">Calibre</entry>
<entry key="generateExternalLinks">true</entry>
<entry key="tagsToMakeDeep"/>
<entry key="GenerateDownloads_ReadOnly">true</entry>
<entry key="IncludeAboutLink_ReadOnly">false</entry>
<entry key="CatalogFolderName_ReadOnly">false</entry>
<entry key="BrowseByCover">true</entry>
<entry key="MinimizeChangedFiles">true</entry>
</properties>

Originally Posted by itimpi

It depends on a combination of how big your library is, and the speed of the media the library is stored on. It is during that phase that checks are made on all the book files in the library as well as generating the authors catalogs. The results are cached to speed up the later phases to speed them up. It is the quantity of disk I/O that is the dominating factor during this phase, so other disk intensive processes in parallel can also slow things down.

On my system running on a slow NAS with a large library that phase takes me over an hour, so I would be very happy with 6 minutes .

My library contains ~1400 books, by 439 authors. The 6 minute time comes from running on a 7200RPM laptop drive; I haven't timed the same run on my server yet.

Xenophon

[whodean]

Please make the "recent additions" turn-off-able.

Hangs ever time.

[itimpi]

Originally Posted by whodean

Please make the "recent additions" turn-off-able.

Hangs ever time.

That has already been done for the next release (for other reasons).

Of course the real fix is to determine why it is hanging for you in the first place!

[whodean]

Great, ETA?

[ChristopherTD]

One of the recent updates to Calibre added HTML book descriptions, which now show up in the Calibre2OPDS tool with odd encoding. Is there some option to control this, either in the generated HTML or within Calibre.