[GUI Plugin] FanFicFare

[JimmXinu]

New Version Released

Version 4.12.0 - 2022-04-27
- Update translations.
- Py2 vs py3 fix #828
- adapter_phoenixsongnet: Remove login code and changes for static author links.
- adapter_webnovelcom: Fixes for site changes. #828
- adapter_fictionhuntcom: Fixes for site changes.
- Xenforo2 status Ongoing==In-Progress
- Apply connect_timeout setting to network requests.
- adapter_webnovelcom: Unescape & too. See #825
- Detect and error on adjusted chapter list < 1. Closes #826
- adapter_webnovelcom: Read chapter text from json in <script> tag.
- Add --mozilla-cookies CLI option.
- use large cover images on royalroad (#823) Thanks sidney!
- PI: Check for existing anthology ebook on new anthology from series URL.
- ffnet: Add meta_from_last_chapter option.
- adapter_literotica: add ...$ to story URL search for when /xyz-pt1 and /xyz are different stories.
- fix wuxiaworldco: www => m (#818, thanks Rikkitp)
- Adding fandom/category parsing to adapter_fictionhuntcom--more than just HP now.

[SMNonMR]

Originally Posted by ownedbycats

I noticed the coloured pins with reading list and FFF too. I wondered if it might be possible to somehow set, e.g. reading_list_to_be_read_\d{4} to all be the same colour.

I don't fully understand what's going on with the marking flags but I would love to see them go back to just one color as well. The new system looks terrible.

Also, I was getting that error code too with the less than symbol so I'm glad you guys are aware of it. Thank you for everything you do!

[ownedbycats]

Originally Posted by SMNonMR

I don't fully understand what's going on with the marking flags but I would love to see them go back to just one color as well. The new system looks terrible.

Also, I was getting that error code too with the less than symbol so I'm glad you guys are aware of it. Thank you for everything you do!

Basically, each pin generated by the plugin has text something like pin_0000, pin_0001. The new system has different colours for when there's different text.

Unfortunately without changes in Calibre's code there likely isn't much to be done on the plugin author's side except maybe removing the numbers -- this wouldn't work so well for Reading List due to the sorting but I can see a case to be made for FFF success/fails unless there's some underlying reason for it.

[JimmXinu]

As I recall, when the marking feature was added to FFF, somebody requested that they appear in order.

So the marks are numbered by FFF for the same reason Reading List does--to show order.

[ownedbycats]

perhaps the option from Reading List to toggle the sorting off and on? But it looks like the RL option still has pin numbers regardless so maybe not.

[darth1]

Is there someway to preserve different fonts from SB/SV when using FFD to get a threads worth of chapters.

I've had a look around and can't find one.

[ownedbycats]

add_to_output_css I'd think would help; here's a case of using it to copy custom formatting in an AO3 work skin.

[darth1]

okay Spacebattles just updated to a new version and now FFd isn't working for it not the latest update or an older one [3.29.1]

Error
Harry and the Shipgirls: Goblet of Feels Pt. 2
Harry Leferts
'NoneType' object has no attribute 'find_all'

[fanfictioneer]

Can confirm. Logfile:

Traceback (most recent call last):
  File "calibre_plugins.fanficfare_plugin.dialogs", line 701, in do_loop
  File "calibre_plugins.fanficfare_plugin.fff_plugin", line 1343, in prep_download_loop
  File "calibre_plugins.fanficfare_plugin.fff_plugin", line 1215, in get_story_metadata_only
  File "E:\Calibre Portable\Calibre Settings\plugins\FanFicFare.zip\fanficfare\adapters\base_adapter.py", line 308, in getStoryMetadataOnly
  File "E:\Calibre Portable\Calibre Settings\plugins\FanFicFare.zip\fanficfare\adapters\base_adapter.py", line 412, in doExtractChapterUrlsAndMetadata
  File "E:\Calibre Portable\Calibre Settings\plugins\FanFicFare.zip\fanficfare\adapters\base_xenforoforum_adapter.py", line 477, in extractChapterUrlsAndMetadata
  File "E:\Calibre Portable\Calibre Settings\plugins\FanFicFare.zip\fanficfare\adapters\base_xenforo2forum_adapter.py", line 93, in parse_title
AttributeError: 'NoneType' object has no attribute 'find_all'

[JimmXinu]

SB updated their site. I'm looking into it.

First impression is that they changed something such that BeautifulSoup parsing is discarding all the actual page content. Fun.

[JimmXinu]

New Test Version Posted

2022-04-29
- Fix for SB using an attr on noscript tags now.

This was rather subtle. html5lib handles <noscript> oddly and rather than switching html libraries, FFF worked around it. But I made a bad assumption that <noscript> tags would never have attributes to save a (very) little bit of time. Details.

This may well be worth a point release, but let's see if there are other issues first.

[darth1]

seems to be working right now

i'd wait and see if they update SV too

[JimmXinu]

New Test Version Posted

2022-04-30
- Address Storiesonline.net "Click to Load text..." (#829 #756 thanks mvlcek)

I also added slow_down_sleep_time:1 to [storiesonline.net] in defaults.ini.

[zarohk]

When trying to download stories from Spacebattles forums today, I encountered the following error:
'NoneType' object has no attribute 'find_all'

Oddly, I am not having that issue with Sufficient Velocity, which also runs on Xenforo.

Any thoughts or suggestion about what might be going on?
I'm not sure if this is the helpful information, and it didn't seem to produce a job that I could click on to provide more information.

Here is my current INI configuration

Spoiler:

## This is an example of what your personal configuration might look
## like. Uncomment options by removing the '#' in front of them.

[defaults]
## [defaults] section applies to all formats and sites but may be
## overridden at several levels. Example:

## [defaults]
## titlepage_entries: category,genre, status
## [www.whofic.com]
## # overrides defaults.
## titlepage_entries: category,genre, status,dateUpdated,rating
## [epub]
## # overrides defaults & site section
## titlepage_entries: category,genre, status,datePublished,dateUpdated,dateCreated
## [www.whofic.com:epub]
## # overrides defaults, site section & format section
## titlepage_entries: category,genre, status,datePublished
## [overrides]
## # overrides all other sections
## titlepage_entries: category

## Some sites also require the user to confirm they are adult for
## adult content. Uncomment by removing '#' in front of is_adult.
is_adult:true


#[www.fanfiction.net]
use_browser_cache:true
## mac:
### Chrome:
#browser_cache_path:/Users/your.user/Library/Caches/Google/Chrome/Default/Cache/Cache_Data
#browser_cache_path:/Users/your.user/Library/Caches/Google/Chrome/Profile 2/Cache/Cache_Data
### Firefox
browser_cache_path:/Users/[my username]/Library/Caches/Firefox/Profiles/y9fc1oyt.default-release/cache2
## Don't like the numbers at the start of chapter titles on some
## sites? You can use strip_chapter_numbers to strip them off. Just
## want to make them all look the same? Strip them off, then add them
## back on with add_chapter_numbers. Don't like the way it strips
## numbers or adds them back? See chapter_title_strip_pattern and
## chapter_title_add_pattern.
#strip_chapter_numbers:true
#add_chapter_numbers:true

## Add this to genre if there's more than one category.
#add_genre_when_multi_category: Crossover

[epub]
## include images from img tags in the body and summary of stories.
## Images will be converted to jpg for size if possible. Images work
## in epub format only. To get mobi or other format with images,
## download as epub and use Calibre to convert.
#include_images:true

## If not set, the summary will have all html stripped for safety.
## Both this and include_images must be true to get images in the
## summary.
#keep_summary_html:true

## If set, the first image found will be made the cover image. If
## keep_summary_html is true, any images in summary will be before any
## in chapters.
#make_firstimage_cover:true

## Resize images down to width, height, preserving aspect ratio.
## Nook size, with margin.
#image_max_size: 580, 725

## Change image to grayscale, if graphics library allows, to save
## space.
#grayscale_images: false


## Most common, I expect will be using this to save username/passwords
## for different sites. Here are a few examples. See defaults.ini
## for the full list.

[www.archiveofourown.org]
username:XXXXXXXX
password:XXXXXXXX
is_adult:true

[forums.spacebattles.com]
username:XXXXXXXX
password:XXXXXXXX
always_login:true

[forums.sufficientvelocity.com]
username:XXXXXXXX
password:XXXXXXXX
always_login:true

[forum.questionablequesting.com]
username:XXXXXXXX
password:XXXXXXXX
always_login:true

[www.twilighted.net]
#username:XXXXXXXX
#password:XXXXXXXX
## default is false
#collect_series: true

[ficwad.com]
#username:XXXXXXXX
#password:XXXXXXXX

[www.adastrafanfic.com]
## Some sites do not require a login, but do require the user to
## confirm they are adult for adult content.
#is_adult:true

[www.twcslibrary.net]
#username:XXXXXXXX
#password:XXXXXXXX
#is_adult:true
## default is false
#collect_series: true

[www.fimfiction.net]
#is_adult:true
#fail_on_password:XXXXXXXX

[www.tthfanfic.org]
#is_adult:true
## tth is a little unusual--it doesn't require user/pass, but the site
## keeps track of which chapters you've read and won't send another
## update until it thinks you're up to date. This way, on download,
## it thinks you're up to date.
#username:XXXXXXXX
#password:XXXXXXXX

[base_xenforoforum]
#use_reader_mode:true
#replace_failed_smilies_with_alt_text:true
#use_threadmark_wordcounts:true
tocpage_entry:
<a href="#section${index}">${chapter}</a> TMP1--TMP2 <br />
#skip_threadmarks_categories:Apocrypha,Information al,Media,Sidestory,Staff Post
username:XXXXXXXX
password:XXXXXXXX
always_login:true

## This section will override anything in the system defaults or other
## sections here.
[overrides]

## This is to fix the Fanfiction.net Problem. If that problem is resolved, remove this:
user_agent:Mozilla/5.0

## default varies by site. Set true here to force all sites to
## collect series.
#collect_series: true
## Skip All:
#skip_threadmarks_categories:Apocrypha,Information al,Media,Sidestory,Staff Post,Voting
## Include Informational & Apocrypha
## Include Informational, Sidestory and Apocrypha:
#skip_threadmarks_categories:Media,Staff Post,Voting
#skip_threadmarks_categories:Media,Sidestory,Staff Post,Voting
## Include Apocrypha:
#skip_threadmarks_categories:Informational,Media,S idestory,Staff Post,Voting
## Include Sidestory:
skip_threadmarks_categories:Apocrypha,Informationa l,Media,Staff Post,Voting
## Include Sidestory and Apocrypha:
#skip_threadmarks_categories:Informational,Media,S taff Post,Voting
## Include Sidestory and Informational
#skip_threadmarks_categories:Apocrypha,Media,Staff Post,Voting
# Include Everything:
#skip_threadmarks_categories:Staff Post,Voting

[JimmXinu]

@zarohk - Please read the previous page of this thread.