[GUI Plugin] FanFicFare

[JimmXinu]

New Test Version Posted

2020-01-17
- Use storyUrl from metadata for checking library, for those sites that make canonical storyUrl difficult, like adapter_literotica. Closes #461. Plugin only.

[unicornzvi]

An issue I noted with some threads on Spacebattles.com is that when selecting "download from URLs" it will appear to download the metadata and start downloading the story normally, but then stall at 1% and not do anything. An example of a thread with this problem is https://forums.spacebattles.com/thre...amurai.653374/

Does anyone know why this happens? Or ideally how to get the thread to ePub despite the issue?

[JimmXinu]

unicornzvi - The percent meter only advances by whole downloads--not how far along an individual download is. So when downloading one book, it's going to stay at 1% until it jumps to done.

How long are you waiting for it?

That thread has some 600+ threadmarks spread across several categories, it's going to take time to download. It took ~10 minutes for me.

[unicornzvi]

Originally Posted by JimmXinu

How long are you waiting for it?

20+ minutes. I'll give it another try, maybe I didn't give it enough time.

[JimmXinu]

Originally Posted by unicornzvi

20+ minutes. I'll give it another try, maybe I didn't give it enough time.

60 minutes wouldn't surprise me.

There are lots of factors--slow_down_sleep_time setting, site traffic, time of day, network latency, possible throttling on the site, if you turner off use_reader_mode, it will be ~10x longer, if you are using always_login and have change posts per reader page, etc etc.

Also, run Calibre in debug mode (Preferences drop down) to get more output.

[Mymy]

Hi Jimm!

I've been meaning to ask - there seems to be an ongoing problem getting stories from wattpad.com. Whenever I enter a URL (e.g: https://www.wattpad/XXXXXX) I get an error message which says "No valid story URLs entered", even though the link is in the correct format.

I have the latest Calibre and FanFicFare versions.

Thank you kindly!

[JimmXinu]

Originally Posted by Mymy

I've been meaning to ask - there seems to be an ongoing problem getting stories from wattpad.com. Whenever I enter a URL (e.g: https://www.wattpad/XXXXXX) I get an error message which says "No valid story URLs entered", even though the link is in the correct format.

I'm not seeing that happen with a story from my 'test all sites' library and a randomly selected story:

https://www.wattpad.com/story/91590087
https://www.wattpad.com/story/193424...ce-paul-lahote

Please include at least one story URL that exhibits the problem whenever reporting any issue.

[greenskye]

What would be the chances of getting patreon as a supported site? Just taking the contents of each post as a chapter. I'm supporting several authors who post all chapters early on patreon. I want to keep supporting them, but the reading experience isn't great.

[JimmXinu]

Re: Patreon

Unlikely. I am very hesitant to do anything with pay sites.

Generally, I figure that anyone writing fanfiction doesn't have a lot of moral ground to complain about somebody scraping a copy of their writing to save.

Original works, especially ones you are paying for, are another matter.

I don't even want to talk about the can of worms that is people taking payment for writing fanfic. Is there enough disconnect between Patreon donations and making money off other people's IP? I don't know, but I fear that will end in tears lawsuits some day.

Plus, my experience is that fanfic writers supported by Patreon donations still post to open sites.

[jemimahj]

I'm having an issue with the "no valid story urls" as well, only on ao3. It's happening with any links that are www.ao3.org but www.archiveofourown.org links work without any issues. An example of a fit that doesn't work for me is https://www.ao3.org/works/22396777 Both Calibre and the plugin are updated to latest version. Thanks!

[JimmXinu]

New Test Version Posted

2020-01-24
- Add more domains for AO3.

Originally Posted by jemimahj

I'm having an issue with the "no valid story urls" as well, only on ao3. It's happening with any links that are www.ao3.org but www.archiveofourown.org links work without any issues. ...

Probably because I've never seen ao3.org before and therefore FFF doesn't support it. When did that become a thing?

NSLookup shows ao3.org is indeed owned by archiveofourown.org.

And from their SSL cert (and past experience), it looks like we should accept:

• archiveofourown.org
• archiveofourown.com
• archiveofourown.net
• download.archiveofourown.org
• ao3.org

Plus www. versions. archiveofourown.net is also new.

Interestingly, ao3.org immediately redirects to archiveofourown.org. But it seems to be the only one--not even www.ao3.org does it. Which means your cookies and login, etc don't carry over between domain names.

[jemimahj]

Probably because I've never seen ao3.org before and therefore FFF doesn't support it. When did that become a thing?

Not sure when it started, this is the first time I've seen it, seems like it's hit or miss? I tried doing a find/replace with ao3/archiveofourown before I posted and it didn't work, but I had the www. in there. I just tried without the www and was able to download from Calibre with no issues. Thanks!

[MarjaE]

Hi,

This looks incredibly useful. There are a couple things I'm trying to figure out:

1. Can I keep fanficfare from adding the sites' tags (and burying my existing tag system)?

According to the FAQ, "What metadata (category, genre, status, characters, ships, etc) gets included in the Calibre tags is controlled by the personal.ini option include_subject_tags. (The name is historical because EPUB 'tags' are placed in <dc:subject> tags.)"

... but there is no such line to delete to keep it from adding these tags. I can limit it to new books, but that's all.

2. Can I use FanFicFare on other sites, which are not listed as compatible? I've had trouble using other download tools for some sites for research.

[sunshineangel]

Thank you for the great plugin.
My English is not good so I use google translate, I hope it does not make you uncomfortable.
I get an error like this:
When I right click on FFF -> Download from Urls it will show a popup for me to enter the url.
But now when I click on it, nothing appears.
Can you help me!

[JimmXinu]

Multi-reply

Originally Posted by MarjaE

1. Can I keep fanficfare from adding the sites' tags (and burying my existing tag system)?

There's more than one way to do it. The most basic is to set to include_subject_tags empty:

[defaults]
include_subject_tags:

There are also mechanisms for modifying metadata entries (replace_metadata) and filtering metadata entries (the include/exclude_metadata_pre/post settings).

Originally Posted by MarjaE

2. Can I use FanFicFare on other sites, which are not listed as compatible? I've had trouble using other download tools for some sites for research.

No.

Well, mostly no. You can use the 'Get Story URLs from Web Page' feature on any web page, but only supported story URLs will be recognized and can be downloaded.

Originally Posted by sunshineangel

Thank you for the great plugin.
My English is not good so I use google translate, I hope it does not make you uncomfortable.
I get an error like this:
When I right click on FFF -> Download from Urls it will show a popup for me to enter the url.
But now when I click on it, nothing appears.
Can you help me!

For most people, the primary mouse button is the left one. Right clicking on Download from Urls doesn't work, but left clicking does. Unless you have set your primary mouse button to right.