Register Guidelines E-Books Today's Posts Search

Go Back   MobileRead Forums > E-Book Software > Calibre > Plugins

Notices

Reply
 
Thread Tools Search this Thread
Old 05-09-2021, 09:47 AM   #5911
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 6,974
Karma: 4604635
Join Date: Dec 2011
Location: Midwest USA
Device: Kobo Clara Colour running KOReader
Quote:
Originally Posted by ownedbycats View Post
Question:

I run from source and noticed this in console:

Code:
FFF: DEBUG: 2021-05-09 03:15:16,091: calibre_plugins.fanficfare_plugin.fff_plugin(2324): No metadata value for "N", setting custom column(#read) literally to N.
Is that expected?

Also, aside from watching the console, is there any way to see what chapter a job is currently on?
Yes. Debug output is sporadic and generally whatever I wanted at the time. --and sometimes it hangs around for a long time if it never bothers me again.

No.

Quote:
Originally Posted by Xyla View Post
No, I'm using the latest test version.
Then I will need to see a debug log (restart Calibre under debug, Calibre Preferences drop down) to error to get any farther with it.
JimmXinu is offline   Reply With Quote
Old 05-09-2021, 03:36 PM   #5912
Zerubel
Customization Addict
Zerubel began at the beginning.
 
Zerubel's Avatar
 
Posts: 8
Karma: 10
Join Date: Mar 2018
Device: Android Tablet
Okay, I'm back with a new question (and despite my claims to learn regex escape terms, I haven't really touched that yet oops)
I found that there's an option... somewhere... to ignore author's notes. Didn't see it in personal.ini but I might have to add it in. The question starts from the point where i don't really mind MOST author's notes, but would like to exclude author's notes from a specific work(s)... but I'm using the Anthology feature with epubmerge to download the entire series as a single work from the ao3 series url.

https://archiveofourown.org/series/1002138

what exactly would i need to add in to personal.ini to achieve this?

(I love her writing but she includes a chapter's worth of observations and rationalizations for what she does at the end of each chapter, and i'd rather just have an uninterrupted reading experience with my own takeaways. other authors notes are fine)
Zerubel is offline   Reply With Quote
Advert
Old 05-09-2021, 03:44 PM   #5913
ownedbycats
Custom User Title
ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.
 
ownedbycats's Avatar
 
Posts: 10,993
Karma: 75337983
Join Date: Oct 2018
Location: Canada
Device: Kobo Libra H2O, formerly Aura HD
Here's the usual code.

Code:
## AO3 chapters can include several different types of notes.  We've
## traditionally included them all in the chapter text, but this allows
## you to customize which you include.  Copy this parameter to your
## personal.ini and list the ones you don't want.
exclude_notes:authorheadnotes,chaptersummary,chapterheadnotes,chapterfootnotes,authorfootnotes,inspiredlinks
This should work, but would be very annoying:

Code:
[https://archiveofourown.org/works/14381811]
exclude_notes:chapterheadnotes,chapterfootnotes

[https://archiveofourown.org/works/14406543]
exclude_notes:chapterheadnotes,chapterfootnotes

[https://archiveofourown.org/works/15646287]
exclude_notes:chapterheadnotes,chapterfootnotes
and so forth...

You can try putting it under a section for the series, but I am unsure if it works for that or only story URLs:

Code:
[https://archiveofourown.org/series/1002138]
exclude_notes:chapterheadnotes,chapterfootnotes
Personally, I'd just do this:

Code:
[defaults]
## Uncomment the next line when updating that specific anthology. Re-comment it afterwards.
##exclude_notes:chapterheadnotes,chapterfootnotes

Last edited by ownedbycats; 05-09-2021 at 03:55 PM.
ownedbycats is online now   Reply With Quote
Old 05-09-2021, 04:30 PM   #5914
ackomb
Zealot
ackomb has a spectacular aura aboutackomb has a spectacular aura aboutackomb has a spectacular aura aboutackomb has a spectacular aura aboutackomb has a spectacular aura aboutackomb has a spectacular aura aboutackomb has a spectacular aura aboutackomb has a spectacular aura aboutackomb has a spectacular aura aboutackomb has a spectacular aura aboutackomb has a spectacular aura about
 
Posts: 106
Karma: 4486
Join Date: Mar 2020
Location: Netherlands
Device: i-pad
Quote:
Originally Posted by JimmXinu View Post
You have Browser_cache_path instead of browser_cache_path. Unrelated to current problem.

I don't know exactly what was going wrong, but this works for me:
Hi Jimm

First of all thank you for catching that browser thingy, that was another problem on my to do list if FanFiction.net was on the fritz again.

As for the other issue, I think I figured out what happened and thought I would share just in case. In my previous message I stripped some of my replace metadata that I thought would not be of any influence. However I figured I'm wrong. See there is this tag, where I replace the metadata creating these separate tags. One for the Crossover and one that just says Romance. Calibre separates these 2 on the comma so I won't see anything. But I think in FFF the line remains unseparated until the end, which is why they both show up in my custom column since both are in the same line while running FanFicfare. If that makes any sense.

For example:
Code:
genre=>Romantic Crossover Grey's Anatomy$=>Crossover.Grey's Anatomy Universe, Romance
genre=>Action based story$=>Action
Using the first line, both the Crossover and Romance show up however the second line doesn't.

It's probably an illusion thinking I can get this to work the way I want, but if anyone has any ideas. I'm up for trying.
ackomb is offline   Reply With Quote
Old 05-09-2021, 06:14 PM   #5915
Zerubel
Customization Addict
Zerubel began at the beginning.
 
Zerubel's Avatar
 
Posts: 8
Karma: 10
Join Date: Mar 2018
Device: Android Tablet
Quote:
Originally Posted by ownedbycats View Post
Here's the usual code.

Code:
## AO3 chapters can include several different types of notes.  We've
## traditionally included them all in the chapter text, but this allows
## you to customize which you include.  Copy this parameter to your
## personal.ini and list the ones you don't want.
exclude_notes:authorheadnotes,chaptersummary,chapterheadnotes,chapterfootnotes,authorfootnotes,inspiredlinks
This should work, but would be very annoying:

Code:
[https://archiveofourown.org/works/14381811]
exclude_notes:chapterheadnotes,chapterfootnotes

[https://archiveofourown.org/works/14406543]
exclude_notes:chapterheadnotes,chapterfootnotes

[https://archiveofourown.org/works/15646287]
exclude_notes:chapterheadnotes,chapterfootnotes
and so forth...

You can try putting it under a section for the series, but I am unsure if it works for that or only story URLs:

Code:
[https://archiveofourown.org/series/1002138]
exclude_notes:chapterheadnotes,chapterfootnotes
Personally, I'd just do this:

Code:
[defaults]
## Uncomment the next line when updating that specific anthology. Re-comment it afterwards.
##exclude_notes:chapterheadnotes,chapterfootnotes
oh thank you! I think i might still be doing something wrong, though - neither series or individual url seems to work - the code turns 'purple' and also turned some of my other tag replacement code purple. When i took it back out, they went back to blue/green.
Zerubel is offline   Reply With Quote
Advert
Old 05-09-2021, 09:06 PM   #5916
ownedbycats
Custom User Title
ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.
 
ownedbycats's Avatar
 
Posts: 10,993
Karma: 75337983
Join Date: Oct 2018
Location: Canada
Device: Kobo Libra H2O, formerly Aura HD
Turning purple is normal. Put them at the bottom of your personal.ini.
ownedbycats is online now   Reply With Quote
Old 05-10-2021, 07:41 AM   #5917
Xyla
Junior Member
Xyla began at the beginning.
 
Posts: 4
Karma: 10
Join Date: May 2021
Device: none
Quote:
Originally Posted by JimmXinu View Post
Then I will need to see a debug log (restart Calibre under debug, Calibre Preferences drop down) to error to get any farther with it.
Spoiler:


FFF: DEBUG: 2021-05-10 12:35:31,855: calibre_plugins.fanficfare_plugin.fff_plugin(221): Plugin FanFicFare macmenuhack file_path:/Users/username/Library/Preferences/calibre/plugins/fanficfare_macmenuhack.txt
QLayout::addChildLayout: layout "" already has a parent
calibre Debug log
calibre 2.85.1 embedded-python: True is64bit: True
Darwin-17.7.0-x86_64-i386-64bit Darwin ('64bit', '')
('Darwin', '17.7.0', 'Darwin Kernel Version 17.7.0: Fri Oct 30 13:34:27 PDT 2020; root:xnu-4570.71.82.8~1/RELEASE_X86_64')
Python 2.7.11
OSX: ('10.13.6', ('', '', ''), 'x86_64')
Successfully initialized third party plugins: FanFicFare (3, 29, 0)
devicePixelRatio: 2.0
logicalDpi: 72.0 x 72.0
physicalDpi: 129.000001937 x 129.000001937
Starting up...
DEPRECATION: The OpenSSL being used by this python install (OpenSSL 1.0.2f 28 Jan 2016) does not meet the minimum supported version (>= OpenSSL 1.1.1) in order to support TLS 1.3 required by Cloudflare, You may encounter an unexpected Captcha or cloudflare 1020 blocks.
Loaded cached store plugin for: Virtualo at version: 10
Loaded cached store plugin for: Project Gutenberg at version: 6
Loaded cached store plugin for: eBooks.com at version: 3
Loaded cached store plugin for: Amazon UK Kindle at version: 15
Loaded cached store plugin for: XinXii at version: 2
Loaded cached store plugin for: Google Books at version: 6
Loaded cached store plugin for: ebook.de at version: 5
Loaded cached store plugin for: Publio at version: 9
Loaded cached store plugin for: Amazon FR Kindle at version: 15
Loaded cached store plugin for: Amazon IN Kindle at version: 5
Loaded cached store plugin for: Smashwords at version: 5
Loaded cached store plugin for: Amazon IT Kindle at version: 15
Loaded cached store plugin for: Mills and Boon UK at version: 4
Loaded cached store plugin for: Woblink at version: 15
Loaded cached store plugin for: eBook.nl at version: 2
Loaded cached store plugin for: Amazon AU Kindle at version: 5
Loaded cached store plugin for: LitRes at version: 2
Loaded cached store plugin for: Amazon Kindle at version: 17
Loaded cached store plugin for: Kobo at version: 7
Loaded cached store plugin for: Amazon ES Kindle at version: 15
Loaded cached store plugin for: Empik at version: 9
Loaded cached store plugin for: ManyBooks at version: 2
Loaded cached store plugin for: Amazon DE Kindle at version: 15
Loaded cached store plugin for: Amazon CA Kindle at version: 7
Loaded cached store plugin for: Beam EBooks DE at version: 4
Loaded cached store plugin for: Legimi at version: 10
Started up in 4.15 seconds with 1244 books
FFF: DEBUG: 2021-05-10 12:35:54,016: calibre_plugins.fanficfare_plugin.fff_plugin(1099) : FanFicFare v3.29.0
2021-05-10 12:35:54.162 Calibre[772:9350] deliverNotificationWithTitle()
* Notification delivered.
FFF: DEBUG: 2021-05-10 12:35:54,346: calibre_plugins.fanficfare_plugin.fff_plugin(1220) : prep_download_loop url:http://spikeluver.com/SpuffyRealm/vi...y.php?sid=1424
FFF: DEBUG: 2021-05-10 12:35:54,388: calibre_plugins.fanficfare_plugin.fanficfare.confi gurable(1209): #####################################
pagecache(GET) MISS: http://spikeluver.com/SpuffyRealm/vi...d=1424&index=1
FFF: DEBUG: 2021-05-10 12:35:55,106: calibre_plugins.fanficfare_plugin.fanficfare.confi gurable(1031): Encoding:utf8
FFF: ERROR: 2021-05-10 12:35:55,201: calibre_plugins.fanficfare_plugin.dialogs(723): Exception: {u'author': [u'Unknown'], u'good': False, u'status': u'Error', u'uniqueurl': u'http://spikeluver.com/SpuffyRealm/viewstory.php?sid=1424[None-None]', u'end': None, u'publisher': None, u'series': u'', u'collision': u'Overwrite if Newer', u'comments': u'', u'author_sort': [u'Unknown'], u'listorder': 0, u'site': 'spikeluver.com', u'title': u'Unknown', u'pubdate': None, u'comment': u"'NoneType' object has no attribute 'a'", u'begin': None, u'showerror': True, u'added': False, u'url': 'http://spikeluver.com/SpuffyRealm/viewstory.php?sid=1424', u'calibre_id': None}:'NoneType' object has no attribute 'a'
Traceback (most recent call last):
File "calibre_plugins.fanficfare_plugin.dialogs", line 710, in do_loop
File "calibre_plugins.fanficfare_plugin.fff_plugin" , line 1305, in prep_download_loop
File "calibre_plugins.fanficfare_plugin.fff_plugin" , line 1185, in get_story_metadata_only
File "calibre_plugins.fanficfare_plugin.fanficfare.adap ters.base_adapter", line 298, in getStoryMetadataOnly
File "calibre_plugins.fanficfare_plugin.fanficfare.adap ters.base_adapter", line 394, in doExtractChapterUrlsAndMetadata
File "calibre_plugins.fanficfare_plugin.fanficfare.adap ters.adapter_spikeluvercom", line 89, in extractChapterUrlsAndMetadata
AttributeError: 'NoneType' object has no attribute 'a'

Last edited by theducks; 05-10-2021 at 10:06 AM. Reason: spoilered
Xyla is offline   Reply With Quote
Old 05-10-2021, 03:00 PM   #5918
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 6,974
Karma: 4604635
Join Date: Dec 2011
Location: Midwest USA
Device: Kobo Clara Colour running KOReader
Quote:
Originally Posted by Zerubel View Post
I found that there's an option... somewhere... to ignore author's notes. Didn't see it in personal.ini but I might have to add it in. The question starts from the point where i don't really mind MOST author's notes, but would like to exclude author's notes from a specific work(s)...
Quote:
Originally Posted by ownedbycats View Post
This should work, but would be very annoying:
...
You will have to either do a section per story URL or turn it on and off manually as ownedbycats showed. FFF doesn't currently implement sections by series URL or author URL. I've thought of it a couple times, but I'm not sure how difficult that would be, nor how useful.

Individual story URL sections do appear as purple. They're not red because they aren't definitely mistakes, but they are purple because the context highlighter isn't complex enough to cover all possible story URLs and to warn you to be careful.

Quote:
Originally Posted by Xyla View Post
FFF: DEBUG: 2021-05-10 12:35:54,016: calibre_plugins.fanficfare_plugin.fff_plugin(1099) : FanFicFare v3.29.0
The version you are using is before that was fixed. Update to the latest released or test version of FFF.
JimmXinu is offline   Reply With Quote
Old 05-10-2021, 04:08 PM   #5919
Xyla
Junior Member
Xyla began at the beginning.
 
Posts: 4
Karma: 10
Join Date: May 2021
Device: none
Quote:
Originally Posted by JimmXinu View Post
The version you are using is before that was fixed. Update to the latest released or test version of FFF.
Thank you so much!! I always assumed I was updating by downloading the latest file from the front page lol
Xyla is offline   Reply With Quote
Old 05-11-2021, 03:20 PM   #5920
ownedbycats
Custom User Title
ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.
 
ownedbycats's Avatar
 
Posts: 10,993
Karma: 75337983
Join Date: Oct 2018
Location: Canada
Device: Kobo Libra H2O, formerly Aura HD
Quote:
Originally Posted by JimmXinu View Post
I do not believe setting certain category values as "not-crossovers" is as simple as you think it is. You would have to define each set of category values anyway--doing it in regular expression is basically the same thing.
For what it matters, I fixed that little issue with Action Chains. I make a template that checks the items are exactly Crossover, Mass Effect Trilogy, Mass Effect: Andromeda or Crossover, Half-Life, Portal then removes "Crossover." (I have a similar one that handles the tagcategories.)

I still have to fix the title page manually but I can do that when the fanfic's finished.

Last edited by ownedbycats; 05-11-2021 at 04:19 PM.
ownedbycats is online now   Reply With Quote
Old 05-13-2021, 10:28 AM   #5921
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 6,974
Karma: 4604635
Join Date: Dec 2011
Location: Midwest USA
Device: Kobo Clara Colour running KOReader
New Test Version Posted

2021-05-13
- adapter_bdsmlibrarycom: Set author Anonymous when author not found instead of sys.exit(). Closes #696
JimmXinu is offline   Reply With Quote
Old 05-14-2021, 12:02 AM   #5922
Science Friction
Junior Member
Science Friction began at the beginning.
 
Posts: 8
Karma: 10
Join Date: May 2021
Device: none
I'm having much better luck with the cloudflare captcha now. I'm able to download from addresses that were blocked before. I downloaded Basilisk Born (72 chapters, 700+K words) and it looks great, but I don't dare sink into reading it because of other stuff I have to do this week.

Regarding skipping authors' notes: I've sometimes wished for the opposite, namely getting all the reader comments along with the story.

Is there a good place to discuss this kind of fanfic tech stuff, not specific to the FFF plugin or even to FFF itself? I.e. general issues of archiving, metadata collection, etc. Preferably not on one of the big platforms like reddit. Thanks.
Science Friction is offline   Reply With Quote
Old 05-15-2021, 09:19 PM   #5923
midnightmane
Member
midnightmane began at the beginning.
 
Posts: 22
Karma: 12
Join Date: Feb 2016
Device: Kindle/Calibre
So I got a question I have a massive library that I'm currently updating at a rate of three stories an hour I was wondering if there was any way I could automate it?
midnightmane is offline   Reply With Quote
Old 05-16-2021, 05:02 AM   #5924
aleyx
Addict
aleyx can self-interpret dreams as they happen.aleyx can self-interpret dreams as they happen.aleyx can self-interpret dreams as they happen.aleyx can self-interpret dreams as they happen.aleyx can self-interpret dreams as they happen.aleyx can self-interpret dreams as they happen.aleyx can self-interpret dreams as they happen.aleyx can self-interpret dreams as they happen.aleyx can self-interpret dreams as they happen.aleyx can self-interpret dreams as they happen.aleyx can self-interpret dreams as they happen.
 
Posts: 250
Karma: 20386
Join Date: Sep 2010
Location: France
Device: Bookeen Diva, Kobo Clara BW
Quote:
Originally Posted by midnightmane View Post
So I got a question I have a massive library that I'm currently updating at a rate of three stories an hour I was wondering if there was any way I could automate it?
If the question is "How do I automate the update of my entire massive library", the answer is please don't do that.

Doing that is akin to a Denial of Service attack, and is why sites like FFNet at best impose huge delays between downloads for everyone, or at worse blocks bots completely.

Instead, enable mail notifications for the stories you're following, and then you may choose the "Get story URLs from Email" menu in FFF.

It's much easier for everyone involved: you, the sites, and the plugin author who won't have to find yet another trick around the newest bot deterrent.

N.
aleyx is offline   Reply With Quote
Old 05-16-2021, 05:50 AM   #5925
midnightmane
Member
midnightmane began at the beginning.
 
Posts: 22
Karma: 12
Join Date: Feb 2016
Device: Kindle/Calibre
Quote:
Originally Posted by aleyx View Post
If the question is "How do I automate the update of my entire massive library", the answer is please don't do that.

Doing that is akin to a Denial of Service attack, and is why sites like FFNet at best impose huge delays between downloads for everyone, or at worse blocks bots completely.

Instead, enable mail notifications for the stories you're following, and then you may choose the "Get story URLs from Email" menu in FFF.

It's much easier for everyone involved: you, the sites, and the plugin author who won't have to find yet another trick around the newest bot deterrent.

N.
Okay let me put some context I'm not massively updating, over the span of a week i have only updated 60 stories. but I was wondering is if there was a way I could set it up on the schedule So that I can spread out my update over the course of days To go easy on the web servers I already know this is strongly discouraged but that's why I'm looking for options on how to update my library without putting strain or hassle on the servers.

Last edited by midnightmane; 05-16-2021 at 06:23 AM.
midnightmane is offline   Reply With Quote
Reply

Tags
fanfiction


Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
[GUI Plugin] KindleUnpack - The Plugin DiapDealer Plugins 523 07-15-2025 06:45 PM
[GUI Plugin] Open With kiwidude Plugins 404 02-21-2025 05:42 AM
[GUI Plugin] Marvin XD Philantrop Plugins 126 01-29-2017 12:48 PM
[GUI Plugin] KiNotes -axel- Plugins 0 07-14-2013 06:39 PM
[GUI Plugin] Plugin Updater **Deprecated** kiwidude Plugins 159 06-19-2011 12:27 PM


All times are GMT -4. The time now is 09:49 AM.


MobileRead.com is a privately owned, operated and funded community.