[GUI Plugin] FanFicFare

[Grimbart]

[QUOTE=JimmXinu;4012672]Network errors like usually indicate that you are being blocked or throttled somewhere.

.../QUOTE]

Looks like you are right. If i change my ISP from Cable to Mobile Hotspot than it works like a charm.
The old standalone FanFictionDownloader works with my cable provider, I think i´ll use this tool for new ebooks than.

[ownedbycats]

Originally Posted by Grimbart

Looks like you are right. If i change my ISP from Cable to Mobile Hotspot than it works like a charm.

Depending on your ISP, if you're able to reboot your modem it might switch your IP address and let FFF work again.

Question: For a story with a URL-specific section, I just noticed that my main set of replace_metadatas (site and tagcategory) aren't working on it after an update. I tried copying the relevant ones down to that URL section like so:

[https://archiveofourown.org/works/21814324]
never_make_cover:true
replace_metadata: 
 site=>archiveofourown.org=>Archive of Our Own
 tagscategory=>^(.*)$=>Fanfiction.\1
 tagscategory=>(Mass Effect: Andromeda|Mass Effect Trilogy)=>Mass Effect
## This fic has non-breaking spaces which look weird in description, this removes them
add_to_replace_metadata_filelist:file:///D:/Documents/Miscellany/ReplaceNBSP.txt

That didn't work neither did putting them in the file. It's only one fic so it's not an issue to manually fix it (it's just fixing the publisher and removing one extra tag) but I was wondering if i made a mistake. Thank you.

[AndersW]

I'm trying out the new site scribblehub.com and have run into a few minor problems.

First, I can't seem to get story URLs from web page. I get an error.
The error code for https://www.scribblehub.com/genre/action/ below.

Spoiler:

calibre, version 3.47.1
ERROR: Unhandled exception: <b>HTTPError</b>:HTTP Error 503: Service Temporarily Unavailable

calibre 3.47.1 [64bit] embedded-python: True is64bit: True
Windows-7-6.1.7601-SP1 Windows ('64bit', 'WindowsPE')
('Windows', '7', '6.1.7601')
Python 2.7.15+
Windows: ('7', '6.1.7601', 'SP1', u'Multiprocessor Free')
Interface language: None
Successfully initialized third party plugins: Count Pages (1, 10, 0) && Kindle Collections (1, 7, 26) && FanFicFare (3, 21, 3) && Generate Cover (1, 5, 25)
Traceback (most recent call last):
File "calibre_plugins.fanficfare_plugin.fff_plugin" , line 568, in get_urls_from_page_menu
File "calibre_plugins.fanficfare_plugin.fff_plugin" , line 587, in get_urls_from_page
File "calibre_plugins.fanficfare_plugin.fanficfare.getu rls", line 81, in get_urls_from_page
File "calibre_plugins.fanficfare_plugin.fanficfare.conf igurable", line 1346, in _fetchUrl
File "calibre_plugins.fanficfare_plugin.fanficfare.conf igurable", line 1335, in _fetchUrlOpened
File "calibre_plugins.fanficfare_plugin.fanficfare.conf igurable", line 1236, in _fetchUrlOpened
HTTPError: HTTP Error 503: Service Temporarily Unavailable

Second is that it is inconstant about getting the cover image from the story.

These stories don't have cover images picked up.
https://www.scribblehub.com/series/5...emists-potion/
https://www.scribblehub.com/series/43804/pellan-rise/
https://www.scribblehub.com/series/43812/kammi-kettu/
https://www.scribblehub.com/series/40636/falling-over/
https://www.scribblehub.com/series/51069/deviled-egg/

While these stories have the cover image picked up just fine.
https://www.scribblehub.com/series/7...tch-of-chains/
https://www.scribblehub.com/series/8...n-of-avonside/
https://www.scribblehub.com/series/5...le-with-horns/

[JimmXinu]

Originally Posted by ownedbycats

[https://archiveofourown.org/works/21814324]
never_make_cover:true
replace_metadata: 
 site=>archiveofourown.org=>Archive of Our Own
 tagscategory=>^(.*)$=>Fanfiction.\1
 tagscategory=>(Mass Effect: Andromeda|Mass Effect Trilogy)=>Mass Effect
## This fic has non-breaking spaces which look weird in description, this removes them
add_to_replace_metadata_filelist:file:///D:/Documents/Miscellany/ReplaceNBSP.txt

That didn't work neither did putting them in the file. It's only one fic so it's not an issue to manually fix it (it's just fixing the publisher and removing one extra tag) but I was wondering if i made a mistake. Thank you.

Settings in more specific sections replace the same setting in a less specific section. You probably want add_to_ somewhere.

See https://github.com/JimmXinu/FanFicFare/wiki/INI-File

Or, possibly, you've bumped into another bug or limitation in your apparent quest to venture into every corner case in the system.

[JimmXinu]

Originally Posted by AndersW

I'm trying out the new site scribblehub.com and have run into a few minor problems.

First, I can't seem to get story URLs from web page. I get an error.
The error code for https://www.scribblehub.com/genre/action/ below.

The server is declining to give us that page. Changing user_agent doesn't appear to help. I honestly find it more surprising that story download works when other pages are blocked like that.

I've alerted mavi0 to the cover issue.

[ownedbycats]

Originally Posted by JimmXinu

Settings in more specific sections replace the same setting in a less specific section. You probably want add_to_ somewhere.

See https://github.com/JimmXinu/FanFicFare/wiki/INI-File

That makes sense. I'll mess around with it a bit more. Thank you again.

Originally Posted by JimmXinu

Or, possibly, you've bumped into another bug or limitation in your apparent quest to venture into every corner case in the system.

I'm just very good at breaking things. Finding ways to get out-of-bounds in video game levels is always a fun pastime.

[AndersW]

Originally Posted by JimmXinu

The server is declining to give us that page. Changing user_agent doesn't appear to help. I honestly find it more surprising that story download works when other pages are blocked like that.

I've alerted mavi0 to the cover issue.

Thank You.

I also noticed that there is no rating like Teen, Mature, Adult. Apparently Mature is listed as one of the Genres and isn't being picked up. So their 2 ratings are Mature and Not Mature, and Not Mature is indicated by the lack of the Mature tag.

I don't know if anything can be done about that one. Just thought I would bring it up in case mavi0 can work a miracle.

[JimmXinu]

New Test Version Posted

2020-07-17
- Fixes for scribblehub.com - cover, datePublished, rating - Thanks, mavi0!

[Atherton25]

Originally Posted by JimmXinu

- New Site: www.scribblehub.com - Thanks, mavi0! (ADDED)

YES! Thank you, thank you, thank you! I've been wanting this one for a while, but others had previously asked and I didn't want to put it out there again. mavi0 you are awesome! Not at JimmXinu's level on my list, but that got you on the list! (I'll probably forget the name in a month though, so don't rely on me remembering )

[AndersW]

Originally Posted by JimmXinu

New Test Version Posted

2020-07-17
- Fixes for scribblehub.com - cover, datePublished, rating - Thanks, mavi0!

I ran into a problem downloading https://www.scribblehub.com/series/6...laws-of-magic/
The error was "'NoneType' object has no attribute 'find'"
It is the only one so far that has that problem, and it didn't do that in the previous version.

[mavi0]

Originally Posted by AndersW

I ran into a problem downloading https://www.scribblehub.com/series/6...laws-of-magic/
The error was "'NoneType' object has no attribute 'find'"
It is the only one so far that has that problem, and it didn't do that in the previous version.

Oops, this is part of the 'datePublished' fix, looks like that specific story the chapter indexes start from 2... not 1. I guess chapter 1 was deleted and reuploaded and that's how scribblehub deals with it? I'll submit a pull request with a fix in a mo

[AndersW]

Originally Posted by mavi0

Oops, this is part of the 'datePublished' fix, looks like that specific story the chapter indexes start from 2... not 1. I guess chapter 1 was deleted and reuploaded and that's how scribblehub deals with it? I'll submit a pull request with a fix in a mo

Looks like it was just an edge case. And thank you very much for adding this site.

[JimmXinu]

New Test Version Posted

2020-07-17
- (More) Fixes for scribblehub.com - cover, datePublished, rating - Thanks, mavi0!

[AndersW]

Originally Posted by mavi0

Oops, this is part of the 'datePublished' fix, looks like that specific story the chapter indexes start from 2... not 1. I guess chapter 1 was deleted and reuploaded and that's how scribblehub deals with it? I'll submit a pull request with a fix in a mo

I can now download the story, but it doesn't have a published date. I also found another story that has this same problem.

https://www.scribblehub.com/series/6...laws-of-magic/
https://www.scribblehub.com/series/5...ters-are-yuri/

[JimmXinu]

New Test Version Posted

2020-07-18
- Fixes for scribblehub.com metadata - datePublished, numWords, averageWords, views - Thanks, mavi0!