[GUI Plugin] FanFicFare

[ownedbycats]

Originally Posted by JimmXinu

Without seeing the email, I can only speculate. We've seen other sites use special URLs for tracking purposes instead of normal story URLs.

There was also an issue with certain unicode characters causing drag-and-drop from Thunderbird to not work as expected. I would not be surprised if that carried over to fetching from email.

[Atherton25]

Originally Posted by fanfictioneer

Not entirely sure this is just me, but for some reason FanFicFare has stopped reading the email notifications from royalroad. Not sure whether it is the format of royalroad notifications that has changed or something else.

Had the same issue last week... for about 3 days. I updated FFF to the latest version and it still was doing it... then it just stopped about a day later. No update or anything. I'd cleared out my email directory in the meantime, so I don't know if it was the specific messages or if it was just some gremlin sneaking up and latching onto my computer on a temporary basis.

Edit: I did note that it started when I got a 70+ chapter update for a RR fic, and I did clear that out immediately and try again (no luck) so I did the manual update thing for a couple days and then it just started working.

[Snomad]

Hello, I've just started using Fanficfare and absolutely loving it so far. I've just run into a problem that I haven't been able to find a solution to. When I create an Anthology using Fanficfare and Epubmerge, It duplicates all the values in the category column, so when downloading from AO3 it has the one fandom entered multiple times. I've tried tweaking the options in epubmerge (setting it to only draw from the first entry), but this doesn't fix the problem at all. Does anyone know how to fix this?

[fanfictioneer]

Originally Posted by JimmXinu

Without seeing the email, I can only speculate. We've seen other sites use special URLs for tracking purposes instead of normal story URLs.

No idea about FFD chapters mismatching. If you can reproduce it and save a copy of the cache directory for me look at (or even, you know, report the story URL) I might discover a clue. As it is,

Royalroad-email that doesn't get picked up:
https://pastebin.com/6uXxtEDH

Example of fanfiction.net story that got the last 2 chapters corrupted without fail previously, but now works?
https://www.fanfiction.net/s/12560378/1/To-The-Next

Regarding my previous example, maybe it is something with the cache or something local to me; that story failed (in the same way) 3 times a few days ago, and now it works fine. Anyway, since I can't reproduce it at the moment I'll just have to wait until it does!

Thanks for the help!

[JimmXinu]

Originally Posted by fanfictioneer

Royalroad-email that doesn't get picked up:
https://pastebin.com/6uXxtEDH

As I suspected, they are using different URLs in the email so they can track when you click an email link:

RinoZ has just posted a new chapter of Chrysalis titled Chapter 845 - Too Many New Toys.

You can read it at https://email-click.royalroad.com/a9chxm/YwB6V7Oj

This isn't actually new, we already have code for that for royalroad.

What is new, is that one of the URLs in the email fails with 404 and the 'get from email' fails at that point. I'll post a test version with a workaround for that shortly.

Originally Posted by fanfictioneer

Example of fanfiction.net story that got the last 2 chapters corrupted without fail previously, but now works?
https://www.fanfiction.net/s/12560378/1/To-The-Next

Regarding my previous example, maybe it is something with the cache or something local to me; that story failed (in the same way) 3 times a few days ago, and now it works fine. Anyway, since I can't reproduce it at the moment I'll just have to wait until it does!

For thoroughness, I did download that story using FFD cache and checked the last 6 chapters; all fine.

Honestly, the most likely cause I can think of is author error.

If there were problems with matching up URLs to cached pages, I would expect it to fail outright, not magically shuffle around a few chapters in the same story.

If you see it again, please check the site and ideally save a copy of the cache dir for me to look at.

[JimmXinu]

Originally Posted by Snomad

Hello, I've just started using Fanficfare and absolutely loving it so far. I've just run into a problem that I haven't been able to find a solution to. When I create an Anthology using Fanficfare and Epubmerge, It duplicates all the values in the category column, so when downloading from AO3 it has the one fandom entered multiple times. I've tried tweaking the options in epubmerge (setting it to only draw from the first entry), but this doesn't fix the problem at all. Does anyone know how to fix this?

You are manually using Epubmerge to create anthologies? Or you are using FFF's built-in anthology feature (that uses EpubMerge under the covers)?

Either way, two things come to mind:

1. Did you you define your category column as 'Text' or 'Comma separated text, like tags, shown in the Tag browser'. The latter will automatically remove duplicates while the former will not.
2. Are the duplicate category values showing up identical or just similar? AO3 lets authors enter basically anything they like for metadata--it's a common problem for stories to have slightly different tags.

[JimmXinu]

New Test Version Posted

2021-10-07
- Handle errors in royalroad email links better.

[ownedbycats]

Possible minor oversight:

Under basic, I have the "mark added/updated books" set (success only) and "show marked books" checked. When downloading an anthology, it marked it but didn't show it afterwards.

Thank you.

[fanficfan1981]

First...Thank you so much for all the work that has gone into this project year after year.
Ok no I have a quick question...I am trying to download from my list of "favorite stories" from fff.net and now that there is this cloudflare issue that means I need to open every chapter from all the books in my favorites list to "cashe" them before it will download them...right?
I have tested the cashing process on one book and it seems to work alright. Since it is 161 books I wanted to make sure before I spend hours trying this just incase.

[JimmXinu]

Originally Posted by ownedbycats

Under basic, I have the "mark added/updated books" set (success only) and "show marked books" checked. When downloading an anthology, it marked it but didn't show it afterwards.

Marking deliberately isn't done on Anthologies. It has to do with the way the normal multi-story update process is re-used to do anthologies.

[Snomad]

Originally Posted by JimmXinu

You are manually using Epubmerge to create anthologies? Or you are using FFF's built-in anthology feature (that uses EpubMerge under the covers)?

Either way, two things come to mind:

1. Did you you define your category column as 'Text' or 'Comma separated text, like tags, shown in the Tag browser'. The latter will automatically remove duplicates while the former will not.
2. Are the duplicate category values showing up identical or just similar? AO3 lets authors enter basically anything they like for metadata--it's a common problem for stories to have slightly different tags.

I am using FFF's built-in anthology feature. Great thanks for explaining that, it looks like it was because I had the column set up as "Text" rather than "Comma-separated text". I've created a new column with the correct value and it now appears to be working perfectly. Thank for your help!

[fanficfan1981]

Hello yesterday I was working on doing some downloading from fff.net using FFD then using FFF. I have it all setup to us the cache from FFD instead of chrome and all was going great but this morning no matter what story I try to download I get this error

PHP Code:

Status
Error

Title
Unknown

Author
Unknown

Comment
cloudscraper reports: (Detected a Cloudflare version 2 Captcha challenge, This feature is not available....) 
See https://github.com/JimmXinu/FanFicFare/wiki/BrowserCacheFeature for a possible workaround.

URL
https://www.fanfiction.net/s/13397143/1/Universal-Truths 


The odd part is I checked my personal.ini file and everything is exactly the same

PHP Code:

[defaults]
browser_cache_path:C:\Users\*MyNameHere*\AppData\Local\fanficdownloader\cache\QtWebEngine\Default\Cache

[www.fanfiction.net]
username:*MyUsernameHere*
password:*MyPasswordHere*
is_adult:true
use_browser_cache:true 


I checked my FFD downloads folder and that still seems to be downloading just fine...Since everything is just like it was last night before I went to bed I am not even really sure where to start in trying to fix this issue so that FFF can download from FFDs cache again.

My only idea is...maybe the cache for FFD is "full" and so it is not keeping the cache of new stories anymore but I do no want to make things worse so I thought I would ask here before trying anything...lol.

[ownedbycats]

What error do you get when you add use_browser_cache_only:true to your ffnet section?

[JimmXinu]

Originally Posted by fanficfan1981

Hello yesterday I was working on doing some downloading from fff.net using FFD then using FFF. I have it all setup to us the cache from FFD instead of chrome and all was going great but this morning no matter what story I try to download I get this error
...
I checked my FFD downloads folder and that still seems to be downloading just fine...Since everything is just like it was last night before I went to bed I am not even really sure where to start in trying to fix this issue so that FFF can download from FFDs cache again.

My only idea is...maybe the cache for FFD is "full" and so it is not keeping the cache of new stories anymore but I do no want to make things worse so I thought I would ask here before trying anything...lol.

The cache being 'full' is technically possible, I suppose. But given the size of hard drives theses days, I wouldn't expect that to happen. I haven't used the FFD cache solution with any large number of downloads.

Setting use_browser_cache_only:true will prevent FFF from attempting to go to ffnet directly, speeding the time to fail. But running in FFF/Calibre debug mode will probably tell you more.

When did you download the pages in FFD? By default, FFF has browser_cache_age_limit:4.0 (4 hours), so if you downloaded the stories in FFD last night, the cache pages will be considered 'expired' when they are more than 4 hours old. You can set browser_cache_age_limit higher, or even to -1 for no age limit.

Does FFF still fail to find the pages if you download the story (or missing chapters) in FFD again? That would suggest FFF is failing to read the cache correctly for some reason. Again, debug log might help.

[motherat]

Here's a dilemma:

Stripping style attributes from stories dowloaded from fanfiction.net removes some relevant formatting done by the author, for example style="text-align:center;".

However, not stripping style attributes results in preserving some weird and unnecessary padding that the site apparently puts into its div tags by default. (It looks like this: <div class="storytextp" id="storytextp" style="padding:0 0.5em 0 0.5em;">)

Does anyone have a solution? It's not possible to strip style attributes from div tags while preserving them for p tags, is it?