[GUI Plugin] FanFicFare

[applegaa]

I have one story that is behaving oddly with FanFicFare: https://www.royalroad.com/fiction/64223

I'm using the viewer built in Calibre. If I open and close the epub without adding a new chapter, it remembers where I was when I closed it every time. However, if I leave it on the last page of the last chapter when I close it and then use FanFicFare to add a new chapter, it will open at the beginning of the last chapter I read instead of the end of it. If I go back a page or more before closing it, I can add a new chapter and it will still open to the page I left it on. This is the only story that I have noticed this behavior on.

Any ideas what is causing this and/or how I can stop it?

- Andrew

[JimmXinu]

FFF updates the title page and log page at the beginning of the epub. When they grow, it changes where later text falls and (I believe) that's what confuses Calibre's saved position.

Log page has an option to be put at the end instead of the beginning that should help:

logpage_at_end:true

[applegaa]

Originally Posted by JimmXinu

FFF updates the title page and log page at the beginning of the epub. When they grow, it changes where later text falls and (I believe) that's what confuses Calibre's saved position.

Log page has an option to be put at the end instead of the beginning that should help:

logpage_at_end:true

Thanks, but I don't think that is the issue.

While the dates and word count change on the title page, the actual length of the page, which is less than 1 full page, does not.

As to the log page, I hadn't even heard of it until recently and haven't done anything with it yet. I double-checked and the "include_logpage: false" from defaults is not being overridden.

- Andrew

[JimmXinu]

Then I don't know.

FFF has to change the epub for its basic function. You could try removing the title page so as little as possible changes if saving place is more important to you.

[powerd]

Hi, I'm having these two error :

- HTTPSConnectionPool(host='archiveofourown.org', port=443): Max retries exceeded with url: /works//navigate?view_adult=true (Caused by SSLError(SSLEOFError(8, 'EOF occurred in violation of protocol (_ssl.c:997)')))


- HTTPSConnectionPool(host='archiveofourown.org', port=443): Read timed out.

How do i fix this?

[JimmXinu]

I'm not seeing that error.

If you are using a proxy (or proxy-like firewall), we've sometimes seen those cause SSL errors. The only solution in those cases has been to not use the proxy or firewall.

Otherwise, make sure you are using the official Calibre and FFF releases. Sometimes linux vendored versions of Calibre cause problems.

[JimmXinu]

New Test Version Posted

2023-10-10
- Add base_adapter.img_url_trans() for adapter_fictionlive image URLs #1004

[ownedbycats]

Question:

Kobo devices get the publication date from <dc:date opf:event="publication"> in content.opf. Is there a personal.ini to change this to use last-updated instead of the original publication date?

[JimmXinu]

No, that's in "modification":

    <dc:date opf:event="publication">2021-01-09</dc:date>
    <dc:date opf:event="creation">2023-10-10</dc:date>
    <dc:date opf:event="modification">2021-03-08</dc:date>

[mimicxz]

Originally Posted by JimmXinu

Story URL?

I've send story url by message. Please check it.
Thanks & Best Regards

[JimmXinu]

Originally Posted by mimicxz

I've send story url by message. Please check it.
Thanks & Best Regards

I don't have any issue downloading a story from that author's page on Literotica.

Unfortunately, your reported error ( "HTTP Error in FFF '403 Client Error: Forbidden for url " ) can have many causes. It could be from a proxy or firewall that doesn't work correctly with that site, or the site blocking you because your IP is in a block list somewhere, or that you've downloaded/viewed 'too many' stories recently.

I can't think of any I could do to help you with it.

FYI, please use Private Message for NSFW URLs on this site--you posted the URL in a Visitor Message, which is still public. You probably have PM available if you didn't before. I believe 10 public posts is the threshold and you appear to have that many now.

[mimicxz]

Originally Posted by JimmXinu

I don't have any issue downloading a story from that author's page on Literotica.

Unfortunately, your reported error ( "HTTP Error in FFF '403 Client Error: Forbidden for url " ) can have many causes. It could be from a proxy or firewall that doesn't work correctly with that site, or the site blocking you because your IP is in a block list somewhere, or that you've downloaded/viewed 'too many' stories recently.

I can't think of any I could do to help you with it.

FYI, please use Private Message for NSFW URLs on this site--you posted the URL in a Visitor Message, which is still public. You probably have PM available if you didn't before. I believe 10 public posts is the threshold and you appear to have that many now.

There seems to be a misunderstanding
The URL I sent you, the story has 25 chapters, but FFF will only capture 19 chapters, not the rest.
How do I manually modify the number and order of captured chapters?
Thanks & Best Regards,

[JimmXinu]

Originally Posted by mimicxz

There seems to be a misunderstanding
The URL I sent you, the story has 25 chapters, but FFF will only capture 19 chapters, not the rest.
How do I manually modify the number and order of captured chapters?
Thanks & Best Regards,

Duplicate Stories

The URL you posted was a literotica memberpage.php page; an author's page listing 4 stories. That author has posted the same story with the same chapter URLs twice, once stopping at 19 parts and then 24 parts(last named ch25).

FFF assumes that stories have unique URLs. And for literotica, FFF uses the first chapter URL for the story URL.

Personally, I would call this a site bug. I'm not planning to 'fix' it in FanFicFare.

Work Arounds

However, due to how the literotica adapter is coded, there are a couple work arounds you could try:

1. Download the story with FFF CLI, either installed with pip or using Calibre's debug CLI to run it from the plugin (no need to install anything else) using the last chapter URL in the longer version as the story URL.
   

   calibre-debug.exe --run-plugin FanFicFare -- [options] <storyurl>

   This will download the story to disk and you will need to manually add it to Calibre.
2. Change the story URL in Calibre's Ids url field to the last chapter URL in the longer version and update the story with Background Metadata? checked (check 'Show Download Options' on the 'Update Existing' dialog.

In both cases, FFF will still record the first chapter URL as the story URL. If the story is ever updated, you'd have to do this again.

How this works

The literotica adapter is coded to search for the URL as given, then collect the chapter list it is found in.

In normal operation, the plugin version gets the metadata from the site first, finding the first chapter URL to use as story URL. Then the background download process gets the metadata again, now using the first chapter/story URL and finds the first version of the story. FFF caches the HTML pages rather than the parsed metadata.

When using CLI or BG metadata, the metadata is only collected once, so the story list from the given URL is used.

This is a peculiarity of the literotica adapter, not something common.

[ronnie0602]

Hi JimmXinu!

If possible and if time allows, would you mind testing download of the following specific story from FFnet? I keep getting an Error 403 each time I try.

https://www.fanfiction.net/s/14274364/1/Dead-Ringer

FanFicFare Log:

Status: Error
Title: Unknown
Author: Unknown
Comment: HTTP Error in FFF '403 Client Error: Forbidden for url: https://www.fanfiction.net/s/1427436...inger'(403)
URL: https://www.fanfiction.net/s/14274364/1/Dead-Ringer


I cleared my cache, I did not go overboard with multiple or repeated downloads, and I'm not having any issues downloading other FFnet new stories or updating stories already existing in my Calibre.

Debug temp file attached.
Thank you very much,
Ronnie

[JimmXinu]

Originally Posted by ronnie0602

If possible and if time allows, would you mind testing download of the following specific story from FFnet? I keep getting an Error 403 each time I try.
...
I cleared my cache, I did not go overboard with multiple or repeated downloads, and I'm not having any issues downloading other FFnet new stories or updating stories already existing in my Calibre.

Works fine with Browser Cache for me.

Your log suggests that your browser didn't cache the page recently:

FFF: DEBUG: 2023-10-11 23:19:43,118: base_browsercache.py(100): age:2023-09-03 21:17:10
FFF: DEBUG: 2023-10-11 23:19:43,118: base_browsercache.py(101): now:2023-10-11 23:19:43.119000
FFF: DEBUG: 2023-10-11 23:19:43,118: base_browsercache.py(103): Cache entry found, rejected, past age limit

Is your FFF configured for the same browser you are using? Because a cache entry from last month doesn't look like a cleared cache...

Perhaps you didn't get the URL exactly right? We've also seen in-browser proxy/firewalls screw up caching.

I would suggest referring to the BrowserCacheFeature wiki page. Turning on open_pages_in_browser:true can help with getting the URLs cached correctly.

Personally, I use:

[www.fanfiction.net]
use_browser_cache:true
use_browser_cache_only:true
open_pages_in_browser:true