Register Guidelines E-Books Today's Posts Search

Go Back   MobileRead Forums > E-Book Software > Calibre > Plugins

Notices

Reply
 
Thread Tools Search this Thread
Old 04-23-2019, 10:05 PM   #3376
jesscat
Groupie
jesscat has a complete set of Star Wars action figures.jesscat has a complete set of Star Wars action figures.jesscat has a complete set of Star Wars action figures.jesscat has a complete set of Star Wars action figures.
 
Posts: 164
Karma: 354
Join Date: Mar 2009
Location: US
Device: iPad mini
It appears I spoke too soon.

When downloading/updating metadata from a website, only "&" works. The "&" doesn't. So in this case, I get the correct result ("char1 & char2" pairings excluded from my pairings column) when downloading or updating metadata from the webpage by using:

Code:
exclude_metadata_post: 
 onlyromships=~[ ]*&[ ]
But if I later update metadata from the saved metadata column, the "&" doesn't work - so the "char1 & char2" pairings are no longer excluded and will re-appear in the pairing column. In this case, though, "&" does work:

Code:
exclude_metadata_post: 
 onlyromships=~[ ]*&[ ]

So it appears that in order for me to get the result I want and for it to stay that way, even if I update later from the saved metadata column, I need this:

Code:
exclude_metadata_post: 
 onlyromships=~[ ]*&[ ] 
 onlyromships=~[ ]*&[ ]
Am I doing something wrong? Or is this the expected behavior?
jesscat is offline   Reply With Quote
Old 04-23-2019, 11:45 PM   #3377
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 6,991
Karma: 4604635
Join Date: Dec 2011
Location: Midwest USA
Device: Kobo Clara Colour running KOReader
New Test Version Posted

2019-04-23
- Fix for BS halping with string conversions on PI update from Saved Meta Column.
- More improvements for adapter_asianfanficscom, including auto_sub feature, thanks oh45454545

Quote:
Originally Posted by jesscat View Post
When downloading/updating metadata from a website, only "&" works. The "&" doesn't.
...
But if I later update metadata from the saved metadata column, the "&" doesn't work - so the "char1 & char2" pairings are no longer excluded and will re-appear in the pairing column. In this case, though, "&" does work:
...
Am I doing something wrong? Or is this the expected behavior?
I think this is another weird BeautifulSoup 3 vs 4 difference that I didn't notice because it works fine 99% of the time.

FFF uses & internally for historical reasons, and that should be what works in general.

You should be able to use:
Code:
exclude_metadata_post: 
 onlyromships=~&
No need to match the spaces around &, I don't think. But if you do want to, you probably want the trailing * so it's "0 or more spaces" on both sides of the & like so:
Code:
exclude_metadata_post: 
 onlyromships=~[ ]*&[ ]*
You seem to be one of those people who (through no fault of their own) are just naturally gifted at finding bugs in my code.

I used to work with a guy like that--whatever I made would work fine for everybody else. But he just thought and did things differently, in ways I couldn't even think of, then...
JimmXinu is offline   Reply With Quote
Old 04-24-2019, 09:18 PM   #3378
jesscat
Groupie
jesscat has a complete set of Star Wars action figures.jesscat has a complete set of Star Wars action figures.jesscat has a complete set of Star Wars action figures.jesscat has a complete set of Star Wars action figures.
 
Posts: 164
Karma: 354
Join Date: Mar 2009
Location: US
Device: iPad mini
Works perfectly now, and thanks for the help streamlining and improving the regular expression (such as it is, since it's now just a character)! It's very useful to read through your examples whenever you provide them, and I am sure I am not alone in needing all the help I can get. (I'm sure my personal.ini is an ugly mess of redundancy and that if I were more adept with regex I could accomplish in 2 lines what it's currently taking me 25 to achieve, though mostly regarding character names....)

Quote:
You seem to be one of those people who (through no fault of their own) are just naturally gifted at finding bugs in my code.
LOL, and of course from my perspective I don't really feel like I'm doing anything particularly unusual, or different from how anyone else would do it!
jesscat is offline   Reply With Quote
Old 04-28-2019, 05:34 PM   #3379
Loumaria
Member
Loumaria began at the beginning.
 
Posts: 11
Karma: 10
Join Date: Apr 2019
Device: Kindle Fire 7th Gen
I am having trouble with Asianfanfics.com.
Whenever I download or update a story, I only get the chapter titles of all the chapters/new chapters.

Hoping for some help!
Loumaria is offline   Reply With Quote
Old 04-28-2019, 05:42 PM   #3380
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 6,991
Karma: 4604635
Join Date: Dec 2011
Location: Midwest USA
Device: Kobo Clara Colour running KOReader
Quote:
Originally Posted by Loumaria View Post
I am having trouble with Asianfanfics.com.
Whenever I download or update a story, I only get the chapter titles of all the chapters/new chapters.
Should already be fixed in latest test version. See my sig for the link.
JimmXinu is offline   Reply With Quote
Old 04-28-2019, 06:23 PM   #3381
Loumaria
Member
Loumaria began at the beginning.
 
Posts: 11
Karma: 10
Join Date: Apr 2019
Device: Kindle Fire 7th Gen
Quote:
Originally Posted by JimmXinu View Post
Should already be fixed in latest test version. See my sig for the link.
Thank you!
Loumaria is offline   Reply With Quote
Old 04-30-2019, 03:27 PM   #3382
ILB
Groupie
ILB can illuminate an eclipseILB can illuminate an eclipseILB can illuminate an eclipseILB can illuminate an eclipseILB can illuminate an eclipseILB can illuminate an eclipseILB can illuminate an eclipseILB can illuminate an eclipseILB can illuminate an eclipseILB can illuminate an eclipseILB can illuminate an eclipse
 
ILB's Avatar
 
Posts: 173
Karma: 8098
Join Date: Jun 2012
Location: Germany
Device: Kindle Voyage, Kindle Oasis
update only title page inside epub

Is there a possibility to update only the title page inside the epub without using Update Mode “Update EPUB Always?”
I created a few custom columns and I would like to add these on the title page before sending it to my device.

The only way I found is to update the whole epub but as I only want to update the title page I don´t want to causes excessive traffic to the site – especially if it isn´t necessary.
ILB is offline   Reply With Quote
Old 04-30-2019, 08:47 PM   #3383
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 6,991
Karma: 4604635
Join Date: Dec 2011
Location: Midwest USA
Device: Kobo Clara Colour running KOReader
@ILB - No, FFF doesn't have a way to update title page without doing update right now.

I'm not sure off hand how possible it would be to add that. I'm looking at something else right now, but I've written it down.
JimmXinu is offline   Reply With Quote
Old 05-01-2019, 12:51 PM   #3384
ILB
Groupie
ILB can illuminate an eclipseILB can illuminate an eclipseILB can illuminate an eclipseILB can illuminate an eclipseILB can illuminate an eclipseILB can illuminate an eclipseILB can illuminate an eclipseILB can illuminate an eclipseILB can illuminate an eclipseILB can illuminate an eclipseILB can illuminate an eclipse
 
ILB's Avatar
 
Posts: 173
Karma: 8098
Join Date: Jun 2012
Location: Germany
Device: Kindle Voyage, Kindle Oasis
No rush - I just thought I'll ask.
ILB is offline   Reply With Quote
Old 05-01-2019, 04:17 PM   #3385
sun_reads
Member
sun_reads began at the beginning.
 
Posts: 10
Karma: 10
Join Date: Sep 2017
Device: Huawei S8-701w
Quote:
Originally Posted by ILB View Post
Is there a possibility to update only the title page inside the epub without using Update Mode “Update EPUB Always?”
I created a few custom columns and I would like to add these on the title page before sending it to my device.

The only way I found is to update the whole epub but as I only want to update the title page I don´t want to causes excessive traffic to the site – especially if it isn´t necessary.
While not strictly what you want, you can just re-convert the book to embed a new cover (epub to epub).

On on the Edit metadata window there is an option to browse for a new cover or generate a cover, though the second might be a button added by the Generate Cover plugin and not a vanilla Calibre feature. In that case, you'll need to get the plugin.

Here's the link.
sun_reads is offline   Reply With Quote
Old 05-01-2019, 04:37 PM   #3386
sun_reads
Member
sun_reads began at the beginning.
 
Posts: 10
Karma: 10
Join Date: Sep 2017
Device: Huawei S8-701w
I read back a couple (5) of pages and did not see this mentioned; it the problem has already been mentioned, apologies.

When I try to update the epubs I downloaded from AO3 and then added into Calibre, I get a "No story URL found" error.

Here's an example story: https://archiveofourown.org/works/18404165 though I randomly picked it from the Recent stories page; all my pre-downloaded epubs have the same problem.

My reason for doing this is that it's just convenient to download a story to one of my devices and read it there when I'm on the go, then later add it to Calibre and tidy up the metadata with updating the books via FFF.
sun_reads is offline   Reply With Quote
Old 05-01-2019, 05:16 PM   #3387
ilovejedd
hopeless n00b
ilovejedd ought to be getting tired of karma fortunes by now.ilovejedd ought to be getting tired of karma fortunes by now.ilovejedd ought to be getting tired of karma fortunes by now.ilovejedd ought to be getting tired of karma fortunes by now.ilovejedd ought to be getting tired of karma fortunes by now.ilovejedd ought to be getting tired of karma fortunes by now.ilovejedd ought to be getting tired of karma fortunes by now.ilovejedd ought to be getting tired of karma fortunes by now.ilovejedd ought to be getting tired of karma fortunes by now.ilovejedd ought to be getting tired of karma fortunes by now.ilovejedd ought to be getting tired of karma fortunes by now.
 
ilovejedd's Avatar
 
Posts: 5,110
Karma: 19597086
Join Date: Jan 2009
Location: in the middle of nowhere
Device: PW4, PW3, Libra H2O, iPad 10.5, iPad 11, iPad 12.9
Quote:
Originally Posted by sun_reads View Post
I read back a couple (5) of pages and did not see this mentioned; it the problem has already been mentioned, apologies.

When I try to update the epubs I downloaded from AO3 and then added into Calibre, I get a "No story URL found" error.

Here's an example story: https://archiveofourown.org/works/18404165 though I randomly picked it from the Recent stories page; all my pre-downloaded epubs have the same problem.

My reason for doing this is that it's just convenient to download a story to one of my devices and read it there when I'm on the go, then later add it to Calibre and tidy up the metadata with updating the books via FFF.
After AO3 switched to using Calibre for generating epub, the epub files now use UUID instead of story url as identifier.

I believe FFF has a feature to search for story url within the ebook text. You'll need to enable that option to be able to update the epubs downloaded directly from AO3 website using FFF.
ilovejedd is offline   Reply With Quote
Old 05-01-2019, 06:14 PM   #3388
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 6,991
Karma: 4604635
Join Date: Dec 2011
Location: Midwest USA
Device: Kobo Clara Colour running KOReader
(multi-reply)

Quote:
Originally Posted by sun_reads View Post
While not strictly what you want, you can just re-convert the book to embed a new cover (epub to epub).
The cover and the title page are actually two different things.

And there are at least two ways (Calibre's built-in Polish feature and plugin Modify ePub) to update a cover without doing a full conversion.

Quote:
Originally Posted by sun_reads View Post
When I try to update the epubs I downloaded from AO3 and then added into Calibre, I get a "No story URL found" error.
As ilovejedd said, FFF can find the story URL inside the epub if you check on the 'Search inside ebooks for Story URL?' option in FFF settings.

However...

Quote:
Originally Posted by sun_reads View Post
My reason for doing this is that it's just convenient to download a story to one of my devices and read it there when I'm on the go, then later add it to Calibre and tidy up the metadata with updating the books via FFF.
AO3's epubs are not compatible with FanFicFare's epubs. If you use FFF to 'update' a downloaded AO3 epub, it will 'work', but the existing AO3 epub will be discarded and a new FFF epub created.

Because FFF fetches the entire story (using the 'Entire Work' link) this isn't hugely disruptive, but you should be aware that it's happening.
JimmXinu is offline   Reply With Quote
Old 05-01-2019, 07:39 PM   #3389
sun_reads
Member
sun_reads began at the beginning.
 
Posts: 10
Karma: 10
Join Date: Sep 2017
Device: Huawei S8-701w
Quote:
Originally Posted by ilovejedd View Post
(multi-reply)
You'll need to enable that option to be able to update the epubs downloaded directly from AO3 website using FFF.
Thanks!

Quote:
Originally Posted by JimmXinu View Post
(multi-reply)
AO3's epubs are not compatible with FanFicFare's epubs. If you use FFF to 'update' a downloaded AO3 epub, it will 'work', but the existing AO3 epub will be discarded and a new FFF epub created.
Yeah, that's no problem. I figured it'd be not quire the same; the ones that I downloaded from URL list still looked the same as the old FFF ones and the ones from AO3 did not.

File replacement completely works for me, though I mostly need the metadata updated - the AO3 tagging is completely bonkers. Because I can regex the hell out of the tags with FFF and sort them into multiple columns (plus there is some automatic tidying of ships and whatnot), I can create a neat tagging system for my tablet.

Most e-readers will just say "Sort by tags" and I'll look at five million different tags (from AO3) and despair. At least mine does this and I'm too used to Moon+ to switch to a new one.

But with FFF, when a story is complete and I got the metadata through AO3 sorted into several columns, I use Calibre's bulk metadata search and replace to send the tags into a backup column, then add the Category (fandom) and the ships into the tags.

Thanks again for the help.
sun_reads is offline   Reply With Quote
Old 05-03-2019, 11:27 PM   #3390
baggins41
Enthusiast
baggins41 has learned how to buy an e-book online
 
Posts: 26
Karma: 96
Join Date: Dec 2013
Device: Kindle Paperwhite (2nd Gen.)
Quote:
Originally Posted by JimmXinu View Post
@ILB - No, FFF doesn't have a way to update title page without doing update right now.

I'm not sure off hand how possible it would be to add that. I'm looking at something else right now, but I've written it down.
I'd just like to chime in and say how much I would appreciate it if you were able to add this.

There have been many times I've adjusted metadata in my Calibre library (especially adding series information) and had to either re-download the story or edit the epub by hand to update the title page. (And sometimes re-downloading isn't an option if e.g. the story has been deleted off the site it originally came from.)
baggins41 is offline   Reply With Quote
Reply

Tags
fanfiction


Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
[GUI Plugin] KindleUnpack - The Plugin DiapDealer Plugins 523 07-15-2025 06:45 PM
[GUI Plugin] Open With kiwidude Plugins 404 02-21-2025 05:42 AM
[GUI Plugin] Marvin XD Philantrop Plugins 126 01-29-2017 12:48 PM
[GUI Plugin] KiNotes -axel- Plugins 0 07-14-2013 06:39 PM
[GUI Plugin] Plugin Updater **Deprecated** kiwidude Plugins 159 06-19-2011 12:27 PM


All times are GMT -4. The time now is 04:32 PM.


MobileRead.com is a privately owned, operated and funded community.