Register Guidelines E-Books Search Today's Posts Mark Forums Read

Go Back   MobileRead Forums > E-Book Software > Calibre > Plugins

Notices

Reply
 
Thread Tools Search this Thread
Old 05-03-2015, 09:20 PM   #136
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 3,454
Karma: 589322
Join Date: Dec 2011
Location: Midwest USA
Device: Kindle Voyage
Quote:
Originally Posted by PandathePanda View Post
With fanfiction.net, every no and then when you update the story it duplicates the IDs. you end up with 2 entries: not sure why it's happening.

I'm using 1.48 of calibre with 2.2.4 of the plugin.
I'm not sure how that's happening either. FanFicFare only ever sets the url identifier. (It did used to use uri instead, but that was literally years ago.)

And that's what's happening--you have both uri and url:

uri:https://www.fanfiction.net/s/10851660/
url:https://www.fanfiction.net/s/10851660/1/

And since FanFicFare always stores ffnet URLs with '/1/', I suspect you're getting the uri from somewhere else.
JimmXinu is offline   Reply With Quote
Old 05-04-2015, 02:53 AM   #137
Depletion
Pelican
Depletion began at the beginning.
 
Posts: 19
Karma: 10
Join Date: Sep 2013
Location: Southeast US
Device: Nexus 7 2013
Quote:
Originally Posted by JimmXinu View Post
What you have now will effect the words 'Complete' and 'In Progress' if they appear in other metadata, too. Like the title. And the ^$ are so that if they someday change it to 'Completed' themselves you don't end up with 'Completedd'.
Aha, that might have been some fun questions down the road. I updated it with your suggestions.

Quote:
Originally Posted by JimmXinu View Post
I'm not sure how that's happening either. FanFicFare only ever sets the url identifier. (It did used to use uri instead, but that was literally years ago.)
I've seen this when some of the older stories I track have updated. It's just a thought, but if it's a story that you've had in calibre for some time now, that could be the reason.
Depletion is offline   Reply With Quote
Advert
Old 05-05-2015, 03:53 PM   #138
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 3,454
Karma: 589322
Join Date: Dec 2011
Location: Midwest USA
Device: Kindle Voyage
Quote:
Originally Posted by JimmXinu View Post
Quote:
Originally Posted by eschwartz View Post
What happens if someone uses Embed Metadata or Polish Books? I wouldn't exactly be surprised to find out there are people who do it in bulk on the whole library at regular intervals.

Keeping the metadata in the EPUB is not IMHO a good move. I suggest keeping it in a cache.db in the plugins folder.
That's a good point. I forget some people are particular about that.

However, I'm more likely to abandon the idea entirely than add a whole new database.
Here's another thought: the metadata could be kept in a long-text type custom column.

This offers certain advantages:
  • It's not going to be polished away.
  • It's visible to the user, so they know if a particular book has it.
  • It could be populated/updated with 'Update Calibre Metadata Only' without having to do epub update.
  • It can still be copied to other libraries, assuming they have the same column.
  • Save time by not having to read the epub to get it.
Disadvantages:
  • It's visible to the user, but they can 'not show' the column to hide it.
  • User could poke at it and break it.
JimmXinu is offline   Reply With Quote
Old 05-06-2015, 12:20 PM   #139
BookJunkieLI
Addict
BookJunkieLI ought to be getting tired of karma fortunes by now.BookJunkieLI ought to be getting tired of karma fortunes by now.BookJunkieLI ought to be getting tired of karma fortunes by now.BookJunkieLI ought to be getting tired of karma fortunes by now.BookJunkieLI ought to be getting tired of karma fortunes by now.BookJunkieLI ought to be getting tired of karma fortunes by now.BookJunkieLI ought to be getting tired of karma fortunes by now.BookJunkieLI ought to be getting tired of karma fortunes by now.BookJunkieLI ought to be getting tired of karma fortunes by now.BookJunkieLI ought to be getting tired of karma fortunes by now.BookJunkieLI ought to be getting tired of karma fortunes by now.
 
BookJunkieLI's Avatar
 
Posts: 399
Karma: 572984
Join Date: Jan 2010
Location: Long Island
Device: Nook, REB 1100, Ebookwise 1500, Jb-Lite, PRS-650, PB302, Asus T-90MT
Quote:
Originally Posted by JimmXinu View Post
Here's another thought: the metadata could be kept in a long-text type custom column.

This offers certain advantages:
  • It's not going to be polished away.
  • It's visible to the user, so they know if a particular book has it.
  • It could be populated/updated with 'Update Calibre Metadata Only' without having to do epub update.
  • It can still be copied to other libraries, assuming they have the same column.
  • Save time by not having to read the epub to get it.
Another advantage is that it won't change the order of the metadata at any point unless the user specifically goes in and changes it themselves.

Quote:
Originally Posted by JimmXinu View Post
Disadvantages:
  • It's visible to the user, but they can 'not show' the column to hide it.
  • User could poke at it and break it.
Point 1 - They can 'not show' the column but it will always be visible if they go into single Edit Metadata. It'll always be down the bottom but it'll be there.
Point 2 - It doesn't matter how you set it up. It's never going to be completely idiot proof.

My only concern is that the metadata in the column is properly labelled so that the user will know what they're looking at.

Otherwise I think it's a good alternative to your original idea.
BookJunkieLI is offline   Reply With Quote
Old 05-07-2015, 01:16 PM   #140
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 3,454
Karma: 589322
Join Date: Dec 2011
Location: Midwest USA
Device: Kindle Voyage
Version 2.2.5 - 07 May 2015
  • Fix ficwad.com changing author URLs.
  • Fix for ponyfictionarchive.net stories with neither In-Progress or Complete flag.
  • Fix for grangerenchanted.com bad HTML summary causing crash.
  • Update translations.
JimmXinu is offline   Reply With Quote
Advert
Old 05-08-2015, 03:14 AM   #141
Mandabar
Member
Mandabar ought to be getting tired of karma fortunes by now.Mandabar ought to be getting tired of karma fortunes by now.Mandabar ought to be getting tired of karma fortunes by now.Mandabar ought to be getting tired of karma fortunes by now.Mandabar ought to be getting tired of karma fortunes by now.Mandabar ought to be getting tired of karma fortunes by now.Mandabar ought to be getting tired of karma fortunes by now.Mandabar ought to be getting tired of karma fortunes by now.Mandabar ought to be getting tired of karma fortunes by now.Mandabar ought to be getting tired of karma fortunes by now.Mandabar ought to be getting tired of karma fortunes by now.
 
Posts: 13
Karma: 470534
Join Date: Nov 2012
Device: Android: Moon+ Reader Pro
It's been a long while since since my last post, But I've come back for help

I've noticed this a few times when I went to import a large story, but I wasn't too worried about it at the time. Now I have one that I really want to import but am having the same issue.

https://www.fanfiction.net/s/6953451/1/Soul-Chess
This is the story, 1.8mil+ words. I'm not sure what's going on, but it's taking longer then 20 minutes and then caliber closes the task. Let me know what I should do to help troubleshoot or to fix this.

Thanks!

Picture of the Log http://puu.sh/hFC8a/9d247223f3.png

Edit: Once again I found a workaround, but still it take a large amount of time. Dunno if it's something I'm doing wrong still or not. Setting the Calibre setting under Misc to a high value (I did 60) for Aborting conversion jobs and it finished after about half an hour.

Last edited by Mandabar; 05-08-2015 at 04:08 AM.
Mandabar is offline   Reply With Quote
Old 05-08-2015, 04:47 AM   #142
Firedancer885
Occassional Beta Tester
Firedancer885 can teach chickens to fly.Firedancer885 can teach chickens to fly.Firedancer885 can teach chickens to fly.Firedancer885 can teach chickens to fly.Firedancer885 can teach chickens to fly.Firedancer885 can teach chickens to fly.Firedancer885 can teach chickens to fly.Firedancer885 can teach chickens to fly.Firedancer885 can teach chickens to fly.Firedancer885 can teach chickens to fly.Firedancer885 can teach chickens to fly.
 
Posts: 276
Karma: 3516
Join Date: Nov 2010
Location: Hungary
Device: Samsung Galaxy Tab 4 (wifi only)
Quote:
Originally Posted by Mandabar View Post

Edit: Once again I found a workaround, but still it take a large amount of time. Dunno if it's something I'm doing wrong still or not. Setting the Calibre setting under Misc to a high value (I did 60) for Aborting conversion jobs and it finished after about half an hour.
Nothing is wrong, I think. There were problems with fanfiction.net. If too many stories were downloaded at once, ff.net banned the user for a time. So Jimm put a function into the plugin to slow down downloads from that site.
Firedancer885 is offline   Reply With Quote
Old 05-08-2015, 11:04 AM   #143
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 3,454
Karma: 589322
Join Date: Dec 2011
Location: Midwest USA
Device: Kindle Voyage
Quote:
Originally Posted by Firedancer885 View Post
Nothing is wrong, I think. There were problems with fanfiction.net. If too many stories were downloaded at once, ff.net banned the user for a time. So Jimm put a function into the plugin to slow down downloads from that site.
What they said. It's less the 1.8m words and more the 208 chapters.
JimmXinu is offline   Reply With Quote
Old 05-08-2015, 12:11 PM   #144
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 3,454
Karma: 589322
Join Date: Dec 2011
Location: Midwest USA
Device: Kindle Voyage
Quote:
Originally Posted by Mandabar View Post
Edit: Once again I found a workaround, but still it take a large amount of time. Dunno if it's something I'm doing wrong still or not. Setting the Calibre setting under Misc to a high value (I did 60) for Aborting conversion jobs and it finished after about half an hour.
Long stories just have to take a long time to avoid getting blocked.

BTW, thanks for pointing out the 'Abort' option. I have it set to 'Never', so I never realized it could affect plugin jobs. I've submitted a pull request to Kovid to change the wording to include plugin jobs.

UPDATE - Kovid accepted the change, so the next version of calibre will say Abort jobs that take more than: and Max. simultaneous conversion/news download/plugin jobs.

Last edited by JimmXinu; 05-08-2015 at 07:53 PM. Reason: working -> wording
JimmXinu is offline   Reply With Quote
Old 05-08-2015, 09:36 PM   #145
Mandabar
Member
Mandabar ought to be getting tired of karma fortunes by now.Mandabar ought to be getting tired of karma fortunes by now.Mandabar ought to be getting tired of karma fortunes by now.Mandabar ought to be getting tired of karma fortunes by now.Mandabar ought to be getting tired of karma fortunes by now.Mandabar ought to be getting tired of karma fortunes by now.Mandabar ought to be getting tired of karma fortunes by now.Mandabar ought to be getting tired of karma fortunes by now.Mandabar ought to be getting tired of karma fortunes by now.Mandabar ought to be getting tired of karma fortunes by now.Mandabar ought to be getting tired of karma fortunes by now.
 
Posts: 13
Karma: 470534
Join Date: Nov 2012
Device: Android: Moon+ Reader Pro
My pleasure. Mine was set to 20 before I changed it to 60. I don't know if that is the default or not. It was affecting the plugin job obviously. Glad to help heheh

Yeah I've had other huge stories with no problems. Then again they were years ago, so I dunno if they just had less chapters or was before the change. Meh.
Mandabar is offline   Reply With Quote
Old 05-13-2015, 03:09 PM   #146
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 3,454
Karma: 589322
Join Date: Dec 2011
Location: Midwest USA
Device: Kindle Voyage
New Test Version Posted

New Test Version Posted with two new features:

Save / Reuse Metadata
  • Add feature to optionally save all FanFicFare metadata to a custom column.
  • Add related feature to update Calibre metadata from saved custom column, when configured.
Near the bottom of the Custom Column tab in FanFicFare config, look for Saved Metadata Column. Can only be used with 'Long Text' custom columns.

I figure the primary use case for this is people who are making changes to their Calibre columns and replace_metadata. Rather than hitting the site servers repeatedly as they update and test, they can update from data already in the library. (I had previously proposed putting this data inside the epub, but that metadata could be unintentionally removed by Calibre's Polish Book or other epub editing tools.)

Include Calibre Columns in FanFicFare Data
  • Add feature to include pre-existing calibre column data in FanFicFare metadata on story updates.
On the personal.ini tab in FanFicFare config, look for Show Calibre Column Names. Clicking that will show you a list of the available columns as they are named in FanFicFare that you can copy/paste from. calibre_cust_ and calibre_std_ are prepended to avoid name collision.

For example: I have a custom column #extranotes to store notes that I don't want FanFicFare to ever overwrite. I've added to personal.ini:
Code:
[epub]
add_to_titlepage_entries:,calibre_cust_extranotes
Now, when I update a stories that has something in #extranotes, it also appears on the title page inside the generated epub. You could also use it as part of replace_metadata expressions for further fine control.

This feature was requested in the survey and, I believe, once in the forum. Note that this doesn't work on new books because they don't have any existing calibre metadata to pull in when creating the epub. It only works on updates.

I'm not entirely convinced that either of these features are worth the extra complexity. I'm interested in hearing others' opinions either way.
JimmXinu is offline   Reply With Quote
Old 05-14-2015, 04:01 PM   #147
ILB
Connoisseur
ILB began at the beginning.
 
Posts: 90
Karma: 10
Join Date: Jun 2012
Location: Germany
Device: Kindle Voyage
Thanks for working out these features.

For me "Include Calibre Columns in FanFicFare Data" is useful. I missed having the opportunity to add other metadata to the titlepage.
I included "Serie (calibre_std_series)" in my personal.ini and it works but with a book without series it appears as "Serie: None" on the titlepage. (see attachment, last line)
Is that intentional or is there a possibility to make it that it doesn´t appear at all if the metadata is empty?

As for "Save / Reuse Metadata" - I think it´s also helpful.

Quote:
Originally Posted by JimmXinu View Post
I'm not entirely convinced that either of these features are worth the extra complexity. I'm interested in hearing others' opinions either way.
How do you mean complexity? Is it difficult or complicated to maintain or does it nead a lot of disk space?
Attached Thumbnails
Click image for larger version

Name:	cover.jpg
Views:	158
Size:	48.8 KB
ID:	138311  
ILB is offline   Reply With Quote
Old 05-14-2015, 06:15 PM   #148
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 3,454
Karma: 589322
Join Date: Dec 2011
Location: Midwest USA
Device: Kindle Voyage
Quote:
Originally Posted by ILB View Post
Thanks for working out these features.
...
How do you mean complexity? Is it difficult or complicated to maintain or does it nead a lot of disk space?
I meant exactly the sort of thing you asked about first--figuring out and dealing with all the little quibbles and issues with these features, such as why does Series show up when empty.

And FYI, there's another feature that's been around awhile that will inject series. See attached.
Attached Thumbnails
Click image for larger version

Name:	config.png
Views:	176
Size:	46.8 KB
ID:	138315  
JimmXinu is offline   Reply With Quote
Old 05-15-2015, 04:24 AM   #149
ILB
Connoisseur
ILB began at the beginning.
 
Posts: 90
Karma: 10
Join Date: Jun 2012
Location: Germany
Device: Kindle Voyage
Quote:
Originally Posted by JimmXinu View Post
And FYI, there's another feature that's been around awhile that will inject series. See attached.
It seems I misunderstood what these option causes and have therefore not used it.
Thanks!

As for empty columns showing up - it doesn´t bother me particularly.
It also seems as if not every empty column shows. I have also included ",calibre_cust_characters,calibre_cust_comment,cal ibre_cust_collections_ao3," and with these only the filled show up.

Maybe it´s the "calibre_STD_..." that shows generally. I tried it with "calibre_std_rating" and that shows also with "Bewertung: None".
ILB is offline   Reply With Quote
Old 05-15-2015, 05:52 AM   #150
Tanjamuse
Wizard
Tanjamuse , Klaatu Barada Niktu!Tanjamuse , Klaatu Barada Niktu!Tanjamuse , Klaatu Barada Niktu!Tanjamuse , Klaatu Barada Niktu!Tanjamuse , Klaatu Barada Niktu!Tanjamuse , Klaatu Barada Niktu!Tanjamuse , Klaatu Barada Niktu!Tanjamuse , Klaatu Barada Niktu!Tanjamuse , Klaatu Barada Niktu!Tanjamuse , Klaatu Barada Niktu!Tanjamuse , Klaatu Barada Niktu!
 
Posts: 1,065
Karma: 5306
Join Date: Jan 2014
Device: none
Hi Jimm.

I've tried your newest test-version, while it's a good idea it makes for a very messy book details window (the one you get when you press I on the keyboard). Would it be possible to either hide that column from the book details or just store the information without showing it?
Tanjamuse is offline   Reply With Quote
Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
[GUI Plugin] Open With kiwidude Plugins 332 08-31-2018 09:54 AM
[GUI Plugin] KindleUnpack - The Plugin DiapDealer Plugins 412 04-24-2018 07:07 PM
[GUI Plugin] Marvin XD Philantrop Plugins 126 01-29-2017 01:48 PM
[GUI Plugin] KiNotes -axel- Plugins 0 07-14-2013 07:39 PM
[GUI Plugin] Plugin Updater **Deprecated** kiwidude Plugins 159 06-19-2011 01:27 PM


All times are GMT -4. The time now is 08:28 PM.


MobileRead.com is a privately owned, operated and funded community.