Plugin ideas... add yours here - Page 61

petzi · 07-23-2016, 01:03 PM

At the moment metadata of German books are often poor or are missing totally with the available Calibre plugins. The best catch so far is amazon.de, but even there it mostly works with bestsellers – the metadata quality for science books are poor or they are missing completely.

I suggest therefore a metadata source plugin for the German National Library (if that is feasible and allowed).
http://dnb.d-nb.de/ or http://www.dnb.de/EN/Home/home_node.html

I think the German National Library is cataloguing *all* published German books and the quality of ther metadata is excellent.

BetterRed · 07-23-2016, 06:48 PM

Quote:

Originally Posted by petzi

At the moment metadata of German books are often poor or are missing totally with the available Calibre plugins. The best catch so far is amazon.de, but even there it mostly works with bestsellers – the metadata quality for science books are poor or they are missing completely.

I suggest therefore a metadata source plugin for the German National Library (if that is feasible and allowed).
http://dnb.d-nb.de/ or http://www.dnb.de/EN/Home/home_node.html

I think the German National Library is cataloguing *all* published German books and the quality of ther metadata is excellent.

Did you check the list of optional metadata source plugins, IIRC there are one or two for German sites, but I can't attest to their 'quality'.

BR

Divingduck · 07-25-2016, 09:47 AM

Quote:

Originally Posted by ddjohn

DivingDuck, I'm impressed that you are familiar with these files and potential softwares.

I currently have HV Premier+ (just their complimentary package) and SandS Computing SWP. The HV Premier+ provides similar funtionality to the Iconizer, giving meta data regarding dimensions, stitch counts, thread brand and color, even how much thread is required per color. It would be incredible to pull any of that meta data into Calibre. I'll focus on what Better Read has covered, before leaping ahead to the metadata possabilities.

Thank you to all of you for your help.

A little bit. I use calibre for embroidery designs too

petzi · 07-27-2016, 03:42 PM

Thanks for the tip. Yes, I installed also BOL.DE. Afaik this is the only German metadata source plugins except amazon.de.

My problem is: I'm using calibre not also for "normal" books especially in humanities. These books often have a small circulation, no ebook version and are sometimes published by small publishers. They are definitely not bestsellers. It does not make sense to grab these metadata from all the many different publisher websites – therefore my idea to take metadata from the German National Library.

petzi · 07-27-2016, 03:53 PM

LibraryThing would another suggestion for a nice plugin with similar functionality as the GoodReads plugin has. According to Wikipedia has Librarything more than 2,000,000 users and 100 million books catalogued (Dec. 2015). It has a nice interface, is more multilingual as Goodreads and not so narrow linked with amazon.

BetterRed · 07-27-2016, 06:58 PM

Quote:

Originally Posted by petzi

Thanks for the tip. Yes, I installed also BOL.DE. Afaik this is the only German metadata source plugins except amazon.de.

My problem is: I'm using calibre not also for "normal" books especially in humanities. These books often have a small circulation, no ebook version and are sometimes published by small publishers. They are definitely not bestsellers. It does not make sense to grab these metadata from all the many different publisher websites – therefore my idea to take metadata from the German National Library.

Most PI's are developed by the people who want them. I suggest you send a PM to the author of BOL.DE -- Pr.BarnArt. He may be willing to work with you in developing one for the GNL, he's developed a few non-Anglo metadata download PIs.

Given Germany has the 3rd highest number of active calibre users (after US and Spain) it's surprising there's only one metadata download site -- source ==>> Usage Statistics for calibre.

Quote:

Originally Posted by petzi

LibraryThing would another suggestion for a nice plugin with similar functionality as the GoodReads plugin has. According to Wikipedia has Librarything more than 2,000,000 users and 100 million books catalogued (Dec. 2015). It has a nice interface, is more multilingual as Goodreads and not so narrow linked with amazon.

See post 30 in this thread ==>> LibraryThing metadata download plugin

I wonder if they've had a change of heart re automated downloads? Maybe someone knows.

BR

petzi · 07-28-2016, 02:03 AM

Thanks again. Yes, a good idea – I will get in contact with Pr.BarnArt.

And sorry: I haven't seen this thread on LibraryThing (LT). I will get in contact with people from LT and ask them. I used to use LT – I even paid for a lifetime license – but changed recently to Goodreads exactly for the integration with calibre. It seems to me that not allowing automated download is nowadays no good idea if you want to strengthen your business.

ddjohn · 07-29-2016, 05:09 PM

Quote:

Originally Posted by Divingduck

A little bit. I use calibre for embroidery designs too

Divingduck, do you input the stitch data and dimensions manually, or have you found a plug-in to auto-populate that information? I am ecstatic to find we can use Calibre for machine embroidery design files and their related documentation, but it is going to be a major task to catalog all these files and their information.

Divingduck · 07-30-2016, 04:54 PM

No, there is no plugin. Up to now it's a more or less manual job as all programs do not offer an export for all metadata I like to see in calibre (and a lot of file formats do not offer metadata too. Taking this in mind, you need programs like Truesizer to generate the whole bunch of information (and most of them do not offer an export of all data).
Wilcom is the only program I know so fare that use a SQL based library with a combination of embroidery and design workflow software. But that is a expensive solution.

What I am doing with our files and calibre is from that perspective a lot cheaper but need for now (a lot) more manual work. Each embroidery file (in all formats) for a collection have an manually exported image as "cover" and a worksheet with design information. In addition there are project files and sometimes a set of additional files for a collection.

You need to spend a lot of time in generating, collecting, classifying and archiving these information as there are no existing general databases of metadata for commercial embroidery designs you can run a query. And believe me or not, if you talk about embroidery, everyone have a own understanding of "good embroidery metadata" and "classification ideas". Commercial embroidery companies and designer too.

Well, I too and it is a never ending "development" process over the time.

I build up my own small embroidery library within calibre as I hate stupid directory structures for library things.

Thanks to Kovid and all the supporter. calibre is a nice and flexible pice of software

... for the moment only a direct support for embroidery files is missing

petzi · 08-07-2016, 01:11 PM

@BetterRed

Asking in this forum why not to develop for librarything.com a similar plugin as the Goodreads plugin is for goodreads.com, you answered:

Quote:

See post 30 in this thread ==>> LibraryThing metadata download plugin

I wonder if they've had a change of heart re automated downloads? Maybe someone knows.

In the meanwhile I asked the staff at LibraryThing, but did not get an answer. Certainly this is not a good sign!

But I did find a page where some information about APIs and Services of LibraryThing is announced. I am not a programmer and do not understand everything, but it seems to me that there is the possibility for automated downloads. It says at the last line at the page LibraryThing Web Services API:

Quote:

You are limited to a maximum of 1,000 requests per day.

Maybe this is not the right API or maybe 1,000 is not enough?

theducks · 08-07-2016, 03:52 PM

Quote:

Originally Posted by petzi

downloads. It says at the last line at the page LibraryThing Web Services API:

Maybe this is not the right API or maybe 1,000 is not enough?

It is their Server.
That is THEIR restriction (rules).

BetterRed · 08-07-2016, 06:21 PM

Quote:

Originally Posted by petzi

@BetterRed

But I did find a page where some information about APIs and Services of LibraryThing. I am not a programmer and do not understand everything, but it seems to me that there is the possibility for automated downloads. It says at the last line at the page

Quote:

You are limited to a maximum of 1,000 requests per day.

Maybe this is not the right API or maybe 1,000 is not enough?

@petzi - Indeed, that does appear to be a step in the right direction.

Hopefully someone who is au fait with what calibre needs in a metadata download API can have a look at it and voice an opinion on its suitability - and maybe even put their hand up to develop, support and maintain a LibraryThing plugin

I assume 'you are limited to 1,000 requests a day' means -- downloads of metadata is limited to 1,000 books per user per day. That seems a reasonable limit to me - and I can't imagine they'd mean anything else.

IIRC some (all ??) metadata download plugins introduce a delay between successive downloads so as not to swamp the suppliers server.

BR

PeterT · 08-07-2016, 06:51 PM

I expect it means 1000 requests per API key per day.

kovidgoyal · 08-07-2016, 11:34 PM

Yeah that kind of API restriction is designed for other web services, not end user software. It means that if you made a LibraryThing plugin using the API, every single user would have to get thier own API key. At least for me that makes it not worth it.

DaltonST · 08-10-2016, 03:56 PM

ISBNDB.com is a standard Calibre metadata download source that requires a user key. 1000 ISBN lookups per day free.

IIRC, it is in a calibre/src file named isbndb.py.

07-23-2016, 01:03 PM	#901
petzi Connoisseur Posts: 69 Karma: 13884 Join Date: Dec 2009 Location: Austria Device: PW2, KOA, iPad3, iPhone 6+	metadata plugin for German National Library? At the moment metadata of German books are often poor or are missing totally with the available Calibre plugins. The best catch so far is amazon.de, but even there it mostly works with bestsellers – the metadata quality for science books are poor or they are missing completely. I suggest therefore a metadata source plugin for the German National Library (if that is feasible and allowed). http://dnb.d-nb.de/ or http://www.dnb.de/EN/Home/home_node.html I think the German National Library is cataloguing all published German books and the quality of ther metadata is excellent.

08-10-2016, 03:56 PM	#915
DaltonST Deviser Posts: 1,880 Karma: 1804640 Join Date: Aug 2013 Location: Texas Device: 10" Win10 Tablet w/Calibre64, CalibreSpy & Freda+	ISBNDB.com ISBNDB.com is a standard Calibre metadata download source that requires a user key. 1000 ISBN lookups per day free. IIRC, it is in a calibre/src file named isbndb.py. Last edited by DaltonST; 08-11-2016 at 12:16 AM. Reason: typos on my phone...

Thread Tools	Search this Thread
Show Printable Version Email this Page	Search this Thread: Advanced Search

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
PRS-505 Any ideas what this might be?	Neupy	Sony Reader	4	07-03-2012 08:19 AM
New Plugin Type Idea: Library Plugin	cgranade	Plugins	3	09-15-2010 01:11 PM
Ideas?	mike_bike_kite	Which one should I buy?	10	06-13-2010 04:37 PM
Ideas	F1Wild	Amazon Kindle	4	07-10-2009 07:01 AM

07-27-2016, 03:42 PM	#904
petzi Connoisseur Posts: 69 Karma: 13884 Join Date: Dec 2009 Location: Austria Device: PW2, KOA, iPad3, iPhone 6+	Thanks for the tip. Yes, I installed also BOL.DE. Afaik this is the only German metadata source plugins except amazon.de. My problem is: I'm using calibre not also for "normal" books especially in humanities. These books often have a small circulation, no ebook version and are sometimes published by small publishers. They are definitely not bestsellers. It does not make sense to grab these metadata from all the many different publisher websites – therefore my idea to take metadata from the German National Library.

07-27-2016, 03:53 PM	#905
petzi Connoisseur Posts: 69 Karma: 13884 Join Date: Dec 2009 Location: Austria Device: PW2, KOA, iPad3, iPhone 6+	LibraryThing would another suggestion for a nice plugin with similar functionality as the GoodReads plugin has. According to Wikipedia has Librarything more than 2,000,000 users and 100 million books catalogued (Dec. 2015). It has a nice interface, is more multilingual as Goodreads and not so narrow linked with amazon.

07-28-2016, 02:03 AM	#907
petzi Connoisseur Posts: 69 Karma: 13884 Join Date: Dec 2009 Location: Austria Device: PW2, KOA, iPad3, iPhone 6+	Thanks again. Yes, a good idea – I will get in contact with Pr.BarnArt. And sorry: I haven't seen this thread on LibraryThing (LT). I will get in contact with people from LT and ask them. I used to use LT – I even paid for a lifetime license – but changed recently to Goodreads exactly for the integration with calibre. It seems to me that not allowing automated download is nowadays no good idea if you want to strengthen your business.

07-30-2016, 04:54 PM	#909
Divingduck Wizard Posts: 1,150 Karma: 1404167 Join Date: Nov 2010 Location: Germany Device: Sony PRS-650	No, there is no plugin. Up to now it's a more or less manual job as all programs do not offer an export for all metadata I like to see in calibre (and a lot of file formats do not offer metadata too. Taking this in mind, you need programs like Truesizer to generate the whole bunch of information (and most of them do not offer an export of all data). Wilcom is the only program I know so fare that use a SQL based library with a combination of embroidery and design workflow software. But that is a expensive solution. What I am doing with our files and calibre is from that perspective a lot cheaper but need for now (a lot) more manual work. Each embroidery file (in all formats) for a collection have an manually exported image as "cover" and a worksheet with design information. In addition there are project files and sometimes a set of additional files for a collection. You need to spend a lot of time in generating, collecting, classifying and archiving these information as there are no existing general databases of metadata for commercial embroidery designs you can run a query. And believe me or not, if you talk about embroidery, everyone have a own understanding of "good embroidery metadata" and "classification ideas". Commercial embroidery companies and designer too. Well, I too and it is a never ending "development" process over the time. I build up my own small embroidery library within calibre as I hate stupid directory structures for library things. Thanks to Kovid and all the supporter. calibre is a nice and flexible pice of software ... for the moment only a direct support for embroidery files is missing

08-07-2016, 06:51 PM	#913
PeterT Grand Sorcerer Posts: 11,562 Karma: 66923931 Join Date: Nov 2007 Location: Toronto Device: Nexus 7, Clara, Touch, Tolino EPOS	I expect it means 1000 requests per API key per day.

08-07-2016, 11:34 PM	#914
kovidgoyal creator of calibre Posts: 40,169 Karma: 18000000 Join Date: Oct 2006 Location: Mumbai, India Device: Various	Yeah that kind of API restriction is designed for other web services, not end user software. It means that if you made a LibraryThing plugin using the API, every single user would have to get thier own API key. At least for me that makes it not worth it.