[GUI Plugin] FanFicFare

[davidfor]

Originally Posted by J3L

Any idea why for the last several weeks I am unable to download from SOL?
For instance
https://storiesonline.net/s/75558/once-upon-an-alien
gives this error message

Originally Posted by JimmXinu

That's a 404 page not found error. I'm able to download that story fine.

So either the site is flakey, or that's how they are choosing to implement throttling if you are downloading too fast.

I'd try setting a sleep time since that site doesn't have one in defaults:

[storiesonline.net]
slow_down_sleep_time:2

I think this is a case of using the wrong theme on the site.

The adapter is searching the author pages for the story link. It just goes increases the page number until either the story is found, or the page cannot be retrieved. And that means the story wasn't found on the authors page. I am running with the classic theme here and it worked.

Looking at the code in the adapter, it has a catch for HTTPError and handles error code 404. This is in the method "findStoryRow". That raises a "FailedToDownload" exception with a message about the theme. This worked at some point. Or at least I assume it did as I have no idea when I last tested it. Has there been changes to how this should work?

[J3L]

Originally Posted by davidfor

I think this is a case of using the wrong theme on the site.

I still cannot download.
I never changed anything and everything is default. Where do I find the "theme" and how do I change it?

[JimmXinu]

A while back storiesonline.net (and their WLPC companion sites) changed their login system, changed everybody's theme/skin and broke their theme/skin setting around the same time. See #610

Since then, FFF changed to use the new login and they fixed the setting, although it was still changed for users, who need to go into their site account settings and change Listings Theme to 'Classic' for FFF to work.

However, it does look like I mistakenly removed the special case 404 handling that reported "Story not found in Author's list--Set Access Level to Full Access and change Listings Theme back to Classic" to the user. I'll add that check back in.

[JimmXinu]

New Test Version Posted

2021-03-02
- Put 'Change theme to Classic' back in adapter_storiesonlinenet

[J3L]

Your latest test version (2021-03-02) did nothing for me, however changing SOL theme to 'Classic' did the trick.
Thank you, thank you, thank you!

[JimmXinu]

Originally Posted by J3L

Your latest test version (2021-03-02) did nothing for me, however changing SOL theme to 'Classic' did the trick.
Thank you, thank you, thank you!

Did the test version at least give you the "change Listings Theme back to Classic" error?

[J3L]

Originally Posted by JimmXinu

Did the test version at least give you the "change Listings Theme back to Classic" error?

No error as such. Just download as usual

FFF log was;

Add | Once Upon an Alien - MisguidedChild | Download epub completed, 21 chapters. | https://storiesonline.net/s/75558

Calibre log in debug mode
see: Calibre log1.txt

I tried on another computer. Downloaded fine.
Calibre 5.12.0; FFF v.3.29.0
same FFF log

Calibre log
see: Calibre log2.txt

I did not compare the two Calibre logs, but they appear to be different as in one case my email appears once and in log 2 three times

BTW personally I would prefer a portable standalone GUI FFF version. I use Calibre only for the FFF plug-in and the occasional epub-merge. 100 MB overhead seems excessive for that.

[ownedbycats]

I've been using Power Search to look for fanfics with wrong/messy metadata (e.g. "Fanfiction.Fandom") on the titlepages and then updating them in small batches.

question: Is there any way to see what changes will be made to the Calibre metadata before confirming update?

Also, is the "mark updated books" meant to clear existing marks?

[JimmXinu]

Originally Posted by ownedbycats

question: Is there any way to see what changes will be made to the Calibre metadata before confirming update?

Nothing in FFF. Use a separate staging library maybe?

Originally Posted by ownedbycats

Also, is the "mark updated books" meant to clear existing marks?

That's the way Calibre implements them. You hand it a dict() of book IDs to db.set_marked_ids() and they are applied, clearing any prior marks.

I probably could retain the existing marks by looking them up and including them in the set, but each book can only have one mark value and FFF uses mark values ('fff_success', 'fff_failed' & 'fff_chapter_error' each with appended numbers to match original order) to indicate different end states.

I fear mixing FFF marks and Reading List marks, for example, would cause more confusion than help.

Marks are designed to be ephemeral and are reset by many operations. There are several more durable options already available such as tags, custom columns, & Reading Lists.

[ownedbycats]

Yeah the confusion would not be good. I can just use a @cleanup tag.

[ownedbycats]

New question: Photobucket is very annoying and puts watermarks on images when hotlinked (example). However, if you copy and paste the image url into browser, the watermark goes away.

I've been manually swapping out the images in ebook-edit, but s there any way to work around this with FFF?

[JimmXinu]

How often do you see this in stories? And with how many authors? Anybody else?

If it's a common thing, I think I may have a solution. But it's rather kludgey and will need to be optional. And with only one test case, I've no idea if it works in general.

[ownedbycats]

It's not very common; I usually fix them right away so I'm not sure how many I have were affected by them and most of the few that I checked actually had the images go 404/410 from accounts being deleted.

Here is another test case with a working image though.

[icecold]

Is it possible to add when a chapter was last edited using custom output for SB/SV/QQ and/or Royalroad? I'm not sure if the metadata's there to do that like you can with when the threadmark was posted.

Also is it possible to add the author of the threadmark via custom output? It feels possible put I'm not sure. This question comes from omakes in quests usually not being the author of the quest itself.

[JimmXinu]

Originally Posted by icecold

Is it possible to add when a chapter was last edited using custom output for SB/SV/QQ and/or Royalroad? I'm not sure if the metadata's there to do that like you can with when the threadmark was posted.

Also is it possible to add the author of the threadmark via custom output? It feels possible put I'm not sure. This question comes from omakes in quests usually not being the author of the quest itself.

Yes and no.

You can include date and kwords from threadmarks. We used to have author available too, but XenForo stopped including author in threadmarks.

From defaults.ini, remember to uncomment lines you want to use:

## base_xenforoforum stories with threadmarks have a few additional
## pieces of metadata available that most adapters don't. 'date';
## 'words'--word count as number only: "12104"; and kwords--the
## threadmark human-readable string for word count with parens:
## "(12.1k)" These can be used with custom output (see
## https://github.com/JimmXinu/FanFicFare/wiki/CustomOutput ) or with
## chapter_title_*_pattern settings.
## Examples for html & epub:
#[base_xenforoforum:html]
#tocpage_entry:
# <a href="#section${index04}">${chapter}</a> ${date} ${kwords}<br />
#[base_xenforoforum:epub]
#tocpage_entry:
# <a href="file${index04}.xhtml">${chapter}</a> ${date} ${kwords}<br /><br />

## The 'date' value for chapters mentioned above can be formated with
## datethreadmark_format.  Otherwise it will default to
## dateCreated_format
#datethreadmark_format:%%Y-%%m-%%d %%H:%%M

## The basic pattern used when not using add_chapter_numbers or
## mark_new_chapters
#chapter_title_def_pattern:${title} ${date}

## Pattern used with add_chapter_numbers, but not mark_new_chapters
#chapter_title_add_pattern:${number}. ${title} ${date}

## Pattern used with mark_new_chapters, but not add_chapter_numbers
## (new) is just text and can be changed.
#chapter_title_new_pattern:(new) ${title} ${date}

## Pattern used with add_chapter_numbers and mark_new_chapters
## (new) is just text and can be changed.
#chapter_title_addnew_pattern:${number}. (new) ${title} ${date}