[GUI Plugin] FanFicFare

[JimmXinu]

New Test Version Posted

2024-05-16
- Skip invalid images, detect img types (#1068) Thanks dbhmw
- datetime.utcnow() deprecated in more recent py3 versions
- base_xenforo2forum: Prefix tag collecting too much.

[ownedbycats]

Is there anything on the AO3 status twitter? Unfortunately, I can't check myself; nitter died a while back and who knows what Musk is doing with that site now.

[ownedbycats]

Originally Posted by ownedbycats

Probably not feasible (and a bit niche), but thought it worth asking anyways: A menu option that automatically inserts [storyUrl] sections for the selected stories to the end of personal.ini.

The one problem I can see with it is accidentally ending up with conflicts from duplicate sections.

I was able to handle this with an Action Chain:

https://www.mobileread.com/forums/sh...4&postcount=63

[DisturbedDragon]

With the QuestionableQuesting XenForo2 update and forced relog, any attempt to download a QQ story is met with "HTTP Error in FFF '400 Client Error: Bad Request for url: https://forum.questionablequesting.com/login/login'(400)
https://forum.questionablequesting.com/threads/what-we-do-to-survive-original-fantasy.17030/"
I've double checked the saved username/password in personal.ini, made sure I'm up-to-date, and tried downloading a multitude of threads from around the site, no dice.

Just read back, noticed the qq test update, will try that.

Yep, works. Turns out the only problem was my lack of reading comprehension. Thanks!

[kamille3]

Certain literotica series don't seem to have their average rating included even though the individual chapters have their ratings.

Like /series/se/493716575 and /series/se/493666502 don't have the ratings even though other series from the same author (like /series/se/493846968 and /series/se/493832181) have their ratings included. Fix possible?

[JimmXinu]

Originally Posted by kamille3

Certain literotica series don't seem to have their average rating included even though the individual chapters have their ratings.

The hidden data FFF is reading from is reporting 'null' for the rating for some chapters. Despite showing a rating for those chapters on the author page.

I'm not going to parse the author page. So the options are:

1. As now--no averrating set when any chapter rating is 'null'.
2. Treat 'null' as zero: 0.0 + 4.61 + 4.6 / 3 = 3.07
3. Skip 'null' chapter ratings: 4.61 + 4.6 / 2 = 4.61
4. Remove averrating metadata collection entirely.

[kamille3]

Originally Posted by JimmXinu

The hidden data FFF is reading from is reporting 'null' for the rating for some chapters. Despite showing a rating for those chapters on the author page.

I'm not going to parse the author page. So the options are:

1. As now--no averrating set when any chapter rating is 'null'.
2. Treat 'null' as zero: 0.0 + 4.61 + 4.6 / 3 = 3.07
3. Skip 'null' chapter ratings: 4.61 + 4.6 / 2 = 4.61
4. Remove averrating metadata collection entirely.

In that case current implementation makes sense. Just don't remove averrating.

[JimmXinu]

New Test Version Posted

2024-05-21
- adapter_deviantartcom: Streamline login vs watchers vs mature See #1070

[w4tchdoge]

I've got one fiction on SV (https://forums.sufficientvelocity.com/threads/124754/) that's been moved to the unlisted fiction section at some point and I can no longer update it via FFF. The error log says HTTP Error in FFF '403 Client Error: Forbidden for url: https://forums.sufficientvelocity.com/login'(403) but I've set my login details in my INI file.

INI file sections relevant to SV:

Spoiler:

[defaults]
is_adult:true

no_image_processing:true
remove_transparency: false

dateCreated_format:%%Y-%%m-%%d %%H:%%M:%%S
datePublished_format:%%Y-%%m-%%d
dateUpdated_format:%%Y-%%m-%%d

extratags:

browser_cache_path:C:\Users\User\AppData\Local\Google\Chrome\User Data\Default\Cache\Cache_Data
browser_cache_age_limit:0.2


[epub]
include_images:true

keep_summary_html:true

make_firstimage_cover:false

add_to_extra_valid_entries:,GC_status_wipe,OneShot_bool,force_Status_Completed,manualDate
include_in_GC_status_wipe:"No"
include_in_OneShot_bool:"No"
include_in_force_Status_Completed:"Completed"

output_css:
 body { text-align:justify; margin:2%%; adobe-hyphenate:none }
 pre { font-size:x-small }
 h1 { text-align:center }
 h2 { text-align:center }
 h3 { text-align:center }
 h4 { text-align:center }
 h5 { text-align:center }
 h6 { text-align:center }
 .CI { text-align:center; margin-top:0; margin-bottom:0; padding:0 }
 .center { text-align:center }
 .cover { text-align:center }
 .full { width:100%% }
 .quarter { width:25%% }
 .smcap { font-variant:small-caps }
 .u { text-decoration:underline }
 .bold { font-weight:700 }
 .big { font-size:larger }
 .small { font-size:smaller }
 .fff_titlepage hr { border-top: 1px; border-style: solid none none none; }
 .fff_titlepage [id="underTitle-horRule"] { border-top: medium; border-style: solid none none none; }

titlepage_start:<?xml version="1.0" encoding="UTF-8"?>
 <html xmlns="http://www.w3.org/1999/xhtml">
 <head>
 <title>${title} by ${author}</title>
 <link href="stylesheet.css" type="text/css" charset="UTF-8" rel="stylesheet"/>
 </head>
 <body class="fff_titlepage">
 <div class="title">
 <h2><a href="${storyUrl}">${title}</a> by ${authorHTML}</h2>
 </div>
 <hr id="underTitle-horRule"/>
 <div>

titlepage_entry:
 <b>${label}:</b> ${value}<br/>

titlepage_wide_entry:
 <b>${label}:</b> ${value}<br/>

titlepage_no_title_entry:

titlepage_end:
 </div>
 </body>
 </html>


[base_xenforoforum]
add_to_exclude_metadata_pre:
 prefix_tags=~Commission

legend_spoilers:true

user_agent:Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/124.0.0.0 Safari/537.36

add_to_extratags:,From CrW Forums

# Getting rid of any titlepage shennanigans that might interfere with the one in [base_xenforoforum:epub]
titlepage_entries:
add_to_titlepage_entries:,
wide_titlepage_entries:
extra_titlepage_entries:,
add_to_extra_titlepage_entries:,

add_to_custom_columns_settings:
 dateUpdated=>#fff_dateupdated
 numChapters=>#fff_chapter_count
 status=>#fff_status
 numWords=>#fff_words
 cover_image=>#cover_type

[base_xenforoforum:epub]
add_to_extra_valid_entries:,normalized_storyUrl
include_in_normalized_storyUrl:storyUrl

add_to_replace_metadata:
 normalized_storyUrl=>(https?:\/\/forums?\..*?\.com\/(threads|posts)\/)(.*\.)?(\d+\/)(\?post.\d+.*\D(\d+))?=>\1\4\5

titlepage_entries:seriesHTML,category,genre,language,characters,ships,status,datePublished,dateUpdated,dateCreated,rating,warnings,numChapters,numWords,publisher,description

titlepage_start:<?xml version="1.0" encoding="UTF-8"?>
 <!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd">
 <html xmlns="http://www.w3.org/1999/xhtml">
 <head>
 <title>${title} by ${author}</title>
 <link href="stylesheet.css" type="text/css" charset="UTF-8" rel="stylesheet"/>
 </head>
 <body class="fff_titlepage">
 <div class="title">
 <h2><a href="${normalized_storyUrl}">${title}</a> by ${authorHTML}</h2>
 </div>
 <hr id="underTitle-horRule"/>
 <div>

titlepage_entry:
 <b>${label}:</b> ${value}<br/>

titlepage_end:
 </div>
 </body>
 </html>


[forums.sufficientvelocity.com]
username:XXXXXXXX
password:XXXXXXXX
always_login:true

add_to_extratags:,From SV

add_to_extra_valid_entries:,fin_forumtags,user_added_forumtags,prefix_tags
add_to_extra_titlepage_entries:,tagsfromtitle,fin_forumtags

fin_forumtags_label:Tags from Forum

include_in_fin_forumtags:forumtags
include_in_prefix_tags:fin_forumtags,tagsfromtitle
#include_in_prefix_tags:forumtags,tagsfromtitle

generate_cover_settings:
 ${publisher}=>sufficientvelocity.com=>SufficientVelocity
# ${cover_image} => ((specific)|(first)|(default)|(^$)) => SufficientVelocity

add_to_replace_metadata:
 prefix_tags=>^(.*)=>[SV] [t] \1

include_subject_tags:prefix_tags,extratags

If anyone can let me know whether there's something in my config that's messing this up it'd be greatly appreciated.

[JimmXinu]

New Test Version Posted

2024-05-22
- base_xenforo2 better detect whether logged in.

Originally Posted by w4tchdoge

I've got one fiction on SV (https://forums.sufficientvelocity.com/threads/124754/) that's been moved to the unlisted fiction section at some point and I can no longer update it via FFF. The error log says HTTP Error in FFF '403 Client Error: Forbidden for url: https://forums.sufficientvelocity.com/login'(403)
...

There was, in fact, a code flaw. If you are supremely lucky, this might help you if your network is less 'blocked'. But I rather doubt it--it doesn't for me.

SB & SV have started using Cloudflare during login. FFF gets 403'ed requesting the login page--not while trying to login, just trying to get the page to login from.

The easy 'fix' (setting user_agent) doesn't work for me. And the Browser Cache feature doesn't work with these forum sites--the pages aren't cached by the browser

I haven't tried flaresolverr with them.

[w4tchdoge]

Just installed the newest test version (v4.34.7) and I still get the HTTP Error in FFF '403 Client Error: Forbidden for url: https://forums.sufficientvelocity.com/login'(403) when trying to update the fiction I mentioned in the previous message using "Update EPUB if New Chapters" without any changes to the INI file or any other settings.

I then tried to use flaresolverr (v3.3.18, the latest version at the time I'm writing this) along with use_flaresolverr_proxy:directimages in the SV section of my INI file and while it did detect the challenge, it failed to solve it.

Relevant section of the flaresolverr log:

Spoiler:

2024-05-23 13:13:50 INFO     Challenge detected. Title found: Just a moment...
2024-05-23 13:14:50 ERROR    Error: Error solving the challenge. Timeout after 59.0 seconds.
2024-05-23 13:14:50 INFO     Response in 62.626 s
2024-05-23 13:14:50 INFO     127.0.0.1 POST http://localhost:8191/v1 500 Internal Server Error

EDIT:
I'm now getting the same HTTP Error in FFF '403 Client Error: Forbidden for url: https://forums.sufficientvelocity.com/login'(403) on all of my SV threads I've downloaded via FFF.

EDIT 2 (2024-05-24 1651 UTC):
I just tried updating my SV fictions again and I'm not sure what changed, but I'm no longer getting any 403 errors and the fiction in the Unlisted Fiction section of SV also updates now. So I'm guessing it's fixed now, thanks JimmXinu!

[ownedbycats]

Is there any way to compare the TOC of the current ePub with the one downloaded from the website?

One of my ffnet fics the author keeps screwing around with the chapter structure and I have to re-cache all the chapters to overwrite. I suspect I'm going to end up DNFing this thing.

[JimmXinu]

For ffnet, FFF has no way of knowing when the contents of a particular chapters have changed.

If the author is changing them, Override Always is really the only option.

On some sites, each chapter has a unique URL that will be reused even when chapters are reordeed.

[JimmXinu]

Someone over on github #1073 has asked:

Hello,
it would be really great, if you could add an option to start the calibre plugin "Action Chains" for the downloaded or updated books.
This would automate task I perform after downloading

Some basic research found this and this post.

I've proven that I can add a pyqtSignal() to FFF, emit() it after the "proceed with updating your library" dialog and get an Action Chains custom ChainEvent module to fire a chain.

The questions I have are:

1. What events in FFF should have signals that Action Chains can monitor?
2. What information, if any, can or should be passed via the signal(s)?

[JimmXinu]

New Test Version Posted

2024-05-28
- New Site: touchfluffytail.org (#1071) thanks dbhmw