[GUI Plugin] FanFicFare

[JimmXinu]

Originally Posted by belton180

Hi, I was wondering if its possible to include options when downloading from xenforoforum sites. I noticed that if both threadmarks and an index are present in a thread, fanficfare seems to default to threadmarks. I would like the option to choose since some indexes are more updated and/or include other posts not threadmarked (omakes, etc.).

Use the post URL instead of the thread URL. IE, this or this instead of this or this.

If you look in defaults.ini (see the personal.ini tab) and look in the [base_xenforoforum] section, there are some other settings you might be interested in. And you can change settings for individual stories by putting sections in personal.ini with the story URL(short form), for example, I have:

[https://forums.sufficientvelocity.com/threads/27655]
always_include_first_post:true
first_post_title:A Bit of Background

Originally Posted by belton180

Also, would it be possible to include downloading the entire thread? I've seen archive threads on both sufficientvelocity and spacebattles that only contain story posts. A prompt could be given as warning that the whole thread is being downloaded.

I've looked at that a couple times and thrown my hands up each time. The forum paradigm (without threadmarks or an index post) is significantly different from the story & chapters paradigm FanFicFare uses. Should posts be chapters? Or pages?

And then there's the issue of over-use; because inevitably someone(s) would decide to use it to archive the entirety of all their favorite long discussion threads. If enough people start doing that, it's likely to use significant server resources, drawing attention from the admins and possibly prompting them to block the tool.

[FicReader81]

Originally Posted by JimmXinu

I'm seeing this intermittently, too. Sometimes it's working with that story, sometimes it's not.

The two most likely causes are:

1) The AO3 site is changing their site and the changes haven't been rolled out to all their servers yet. If true, FFF will need to change to accommodate the changes. But it's very difficult to tell until the changes are appearing consistently.

2) The AO3 site may be having problems. That happens sometimes.

We'll just have to wait and see if the problem gets worse or better before we'll know.

Thanks to you and everyone else for their replies. It does seem the issue was on AOOO's end and I am able to download and update all stories without any issue thus far. Thanks so much for the prompt replies and all the help. Truly appreciate it.

I have got another query though I am not sure if this is the right forum topic for it. I am looking to do a clean install of another OS on my laptop. I will have to reinstall calibre once the new OS has been installed. I will do a backup of calibre library and settings as described on the Calibre page. I wanted to know if the entries under various columns such as series, ratings, Reading Status etc (Which have been manually entered by me as notes/numbers) will be backed up as well and would show up when I reinstall calibre and import the backed up library into it. If this isn't the right topic for this, can you please direct me to the relevant one? Thanks once again.

[JimmXinu]

Originally Posted by FicReader81

I have got another query though I am not sure if this is the right forum topic for it. I am looking to do a clean install of another OS on my laptop. ...

It sounds like you've already read the relevant docs. All of the books, columns metadata, etc in a library are in the library directory, so backing that up and restoring will contain all that. Some plugins, including FanFicFare, also store your settings for those plugins in the library database, so they're also carried over by copying the library dir.

However, some other calibre and plugins' settings are stored in the calibre configuration dir (Calibre Preferences -> Misc -> Open calibre configuration dir button).

For any further or more specific questions, I suggest the Library Management forum.

[fflover]

Hi Jim,

I am currently having a problem downloading from FictionPad with FFF. The error message I am receiving is as follows:

<urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:590)>

I have contacted the admin of that site, however I have not received a response. I was wondering if there is a work-around you might be aware of. I have looked through the preferences, but didn't see any that would allow me to bypass the certificate issue.

Thank you for your time.

[JimmXinu]

Originally Posted by fflover

I am currently having a problem downloading from FictionPad with FFF. The error message I am receiving is as follows:

<urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:590)>

fictionpad.com's SSL cert has expired. In fact, it expired a week ago (see attached).

Obviously, the correct solution is for the site to renew their certificate.

By-passing cert verification is theoretically possible, but I don't know how off hand; nor do I particularly want to. If they still haven't fixed it in a couple weeks, ask again.

[Vallora]

A Question. I can't download a specific story from Fanfiction.net. the URL is https://www.fanfiction.net/s/8934930...r-Time-s-Angel. This is the only one of this person's stories that I can't download with FanFicFare. I've updated to the latest Calibre and FanFicFare plugin and still nothing. I think there are sporadic other's that also have the issue if not being able to download but this is the most current that I came across. Is it something on the site that is interfering or could it be a setting I have that I don't even realize is messing with it. Any help would be welcomed in just understanding why this particular one will not download. Thank you for any help in understanding.

And I'm using Mac 10.10.5

[JimmXinu]

Originally Posted by Vallora

A Question. I can't download a specific story from Fanfiction.net. the URL is https://www.fanfiction.net/s/8934930...r-Time-s-Angel. This is the only one of this person's stories that I can't download with FanFicFare. ...

The problem is with the way ffnet presents it's metadata (and how FFF parses it) vs the character name "Jenny - Doctor's Daughter".

For reference:

Rated: Fiction T - English - Adventure/Suspense - [Jenny - Doctor's Daughter, Rose T.] Weeping Angels, Bad Wolf - Chapters: 94 - Words: 341,098 - Reviews: 202 - Favs: 24 - Follows: 21 - Updated: Jun 16 - Published: Jan 22, 2013 - id: 8934930

FFF splits that line by ' - ' strings to find genre, rating, chapters, etc. And usually that works. But because "Jenny - Doctor's Daughter" also contains ' - ', it breaks down.

I'll need to think about that for a bit to come up with a reasonable solution. It may be a few days.

[JimmXinu]

New test version posted (direct link)

2016-06-26

- Change ffnet metadata colletion to allow for chars with (' - ') in them.

This changes the way some metadata is parsed for ffnet, specifically, reviews, favs, follows, words, characters and ships. So keep an eye on those as you use it.

This change addresses Vallora's issue:

The problem is with the way ffnet presents it's metadata (and how FFF parses it) vs the character name "Jenny - Doctor's Daughter".

Originally Posted by Vallora

A Question. I can't download a specific story from Fanfiction.net. the URL is https://www.fanfiction.net/s/8934930...r-Time-s-Angel. This is the only one of this person's stories that I can't download with FanFicFare. ...

[Vallora]

Originally Posted by JimmXinu

New test version posted (direct link)

2016-06-26

- Change ffnet metadata colletion to allow for chars with (' - ') in them.

This changes the way some metadata is parsed for ffnet, specifically, reviews, favs, follows, words, characters and ships. So keep an eye on those as you use it.

This change addresses Vallora's issue:

Thank you Very Much. It works.

[JimmXinu]

New test version posted (direct link)

2016-06-30

- Fix for SIYE when author puts story URL in bio.

[readerboy7]

I'm having a problem involving downloading stories from Fanfiction.net that contain underlines (well actually only one specific story I read contains underlines*, but I assume that the problem exists for all). The story is downloaded fine, along with bold and italics, but for some reason the underlines aren't downloaded. I tested this on chapter 2 in the story linked in the footnote*, downloading html, epub and mobi versions.
I assume this is due to FFnet using <em> for italics and <strong> for bold, but <span style="text-decoration: underline;"> for underline, but I'm not sure.

* https://www.fanfiction.net/s/7262793...es-of-the-Past (for testing, the section in chapter 2 "there are still" is underlined)

[JimmXinu]

Originally Posted by readerboy7

I'm having a problem involving downloading stories from Fanfiction.net that contain underlines ...
I assume this is due to FFnet using <em> for italics and <strong> for bold, but <span style="text-decoration: underline;"> for underline, but I'm not sure.

* https://www.fanfiction.net/s/7262793...es-of-the-Past (for testing, the section in chapter 2 "there are still" is underlined)

You are basically correct. By default FanFicFare strips most tag attributes, including style, to standardize output and reduce wasted bytes.

You can change that by putting one of these in your personal.ini:

# keep style for all stories
[defaults]
add_to_keep_html_attrs:,style

# keep style for all ffnet stories
[fanfiction.net]
add_to_keep_html_attrs:,style

# keep style for story 7262793 only.
[https://www.fanfiction.net/s/7262793/1/]
add_to_keep_html_attrs:,style

[belton180]

Originally Posted by JimmXinu

Use the post URL instead of the thread URL. IE, this or this instead of this or this.

If you look in defaults.ini (see the personal.ini tab) and look in the [base_xenforoforum] section, there are some other settings you might be interested in. And you can change settings for individual stories by putting sections in personal.ini with the story URL(short form), for example, I have:

[https://forums.sufficientvelocity.com/threads/27655]
always_include_first_post:true
first_post_title:A Bit of Background

Thank you for the tips. I just tried it out and it works wonders. One thread though seems to have problems

https://forums.spacebattles.com/thre...#post-14855427

After checking the index, the downloaded epub was missing several indexed posts (Interlude: Maria Remembers, Zandri Raid Pt. 2-9). After checking the urls posted in the index, I noticed that they used a different url syntax: forums.spacebattles.com/goto/post?idpostnumber#post-postnumber.

Originally Posted by JimmXinu

I've looked at that a couple times and thrown my hands up each time. The forum paradigm (without threadmarks or an index post) is significantly different from the story & chapters paradigm FanFicFare uses. Should posts be chapters? Or pages?

And then there's the issue of over-use; because inevitably someone(s) would decide to use it to archive the entirety of all their favorite long discussion threads. If enough people start doing that, it's likely to use significant server resources, drawing attention from the admins and possibly prompting them to block the tool.

Yeah, after thinking about it, the ability to download an entire thread would be subject to abuse. Thanks for thinking about it anyway.

[JimmXinu]

Originally Posted by belton180

Thank you for the tips. I just tried it out and it works wonders. One thread though seems to have problems

https://forums.spacebattles.com/thre...#post-14855427

After checking the index, the downloaded epub was missing several indexed posts (Interlude: Maria Remembers, Zandri Raid Pt. 2-9). After checking the urls posted in the index, I noticed that they used a different url syntax: forums.spacebattles.com/goto/post?idpostnumber#post-postnumber.

New test version posted (direct link)

2016-07-05

- Allow old goto/post chapter URLs in base_xenforoforum.

[Tanjamuse]

Does anyone know what the minimum "slow-down"/delay you can have on FF.net is?

I have slow_down_sleep_time:4 and I'm now wondering if it's changed from 4 seconds to 4 minutes, because it takes me a very long time to download 25 stories.

Does anyone else have this problem?

It went fine on monday but yesterday and today has been very very slow, and I haven't changed any settings on the computer and it was rebooted yesterday.