[GUI Plugin] FanFicFare - Page 427

Ser4nb2LUY6e · 09-01-2021, 10:42 AM

Quote:

Originally Posted by JimmXinu

New Test Version Posted

2021-08-29
- Add POST request for wuxiaworld.site site changers. Closes #729.

Thanks! That fixed it for me.

milford833 · 09-01-2021, 01:10 PM

I was wondering, I have problems with using the Cache and webtoepub when going to fanfiction.net to download, so I have been downloading the files through FanFiction Downloader, and getting the complete file each time I download. Is there a way to set up FanFicFare to open those html files that it downloads to a specific directory, find the chapters that were not updated, and update the epub files that way? If the last chapter in Calibre was 8 and it is currently on 20, it would update the Calibre epubs to all 20 Chapters? If it is a new story it would just add it as a new story. Pretty much just like it works now, but it does not read a website just a directory with HTML files? I am probably missing something in the explanations on how to do something, but I thought I would ask. Sorry if I am being a pain.

JimmXinu · 09-01-2021, 08:30 PM

milford833 -

FFF can't currently do that.

It is something I considered when ffnet starting blocking everybody back in January, but it's a bit complicated and doesn't fit well into FFF's architecture.

One issue is mapping the story URL(s) to the downloaded HTML file(s). It's either read everything in a dir tree, or some manual process, or both. The FFF plugin is designed for background batch processing of stories from multiple different sites. Stopping to tell it 'read this story from this file instead' is difficult.

I might consider it again if there's interest from enough users.

Book_fury · 09-01-2021, 10:58 PM

I don’t think this is the right place to ask this but if I use EpubSplit can I split a book that I’ve merged together So I had two books now I have one can I split it so I have those two books back

JimmXinu · 09-01-2021, 11:26 PM

Quote:

Originally Posted by Book_fury

I don’t think this is the right place to ask this but if I use EpubSplit can I split a book that I’ve merged together So I had two books now I have one can I split it so I have those two books back

Assuming you used EpubMerge to do the merging, there's a config option in EpubMerge to save all the original metadata files to use the EpubMerge 'Unmerge' option. That should give you basically the original epubs back again.

And even if you didn't, EpubSplit should still work to give effectively similar books again.

I suggest making a copy and try it. (The easiest way I know in Calibre to copy a book is to copy to a different library).

You're right--this isn't the right place for that question. If you have further questions, there are threads for both EpubSplit and EpubMerge that are linked in my sig.

JimmXinu · 09-02-2021, 01:38 PM

FanFictionDownloader, for those who don't know, is a standalone tool for downloading fanfics that does better with the ffnet blocking issue due to incorporating a QtWebEngine browser engine that it uses for doing downloads.

Which, on Windows10 at least, has a browser cache that FFF can read. For me it's at:

C:\Users\USER\AppData\Local\fanficdownloader\cache \QtWebEngine\Default\Cache

...and setting FFF's browser_cache_path to use it works fine.

Basically, you're replacing WebToEpub and your browser with FFDL.

You still need to have downloaded the stories/chapters desired with FFDL before FFF can find them in cache.
You can limit FFDL's download to certain chapters, but you have to do it as a two step process ('Check' to get metadata, then download.)

I'm going to be doing some testing to see if this also works on Mac and Linux.
EDIT1: Worked on Mac, cache path: /Users/USER/Library/Caches/fanficdownloader/QtWebEngine/Default/Cache

Not sure why I never thought of this before...

FYI, FanFicFare used to also be named FanFictionDownLoader or fanficdownloader before being renamed. FanFictionDownloader had that name first. There's never been any relation but similarity of purpose between the two.

riothamus · 09-02-2021, 02:31 PM

Quote:

Originally Posted by JimmXinu

FanFictionDownloader, for those who don't know, is a standalone tool for downloading fanfics that does better with the ffnet blocking issue due to incorporating a QtWebEngine browser engine that it uses for doing downloads.

Which, on Windows10 at least, has a browser cache that FFF can read.

Well, to quote Dr. Selvig/Loki: "I guess that's worth a look."

ownedbycats · 09-02-2021, 02:37 PM

Quote:

Originally Posted by JimmXinu

FanFictionDownloader, for those who don't know, is a standalone tool for downloading fanfics that does better with the ffnet blocking issue due to incorporating a QtWebEngine browser engine that it uses for doing downloads.

Which, on Windows10 at least, has a browser cache that FFF can read. For me it's at:

C:\Users\USER\AppData\Local\fanficdownloader\cache \QtWebEngine\Default\Cache

...and setting FFF's browser_cache_path to use it works fine.

Basically, you're replacing WebToEpub and your browser with FFDL.

You still need to have downloaded the stories/chapters desired with FFDL before FFF can find them in cache.
You can limit FFDL's download to certain chapters, but you have to do it as a two step process ('Check' to get metadata, then download.)

I'm going to be doing some testing to see if this also works on Mac and Linux.
EDIT1: Worked on Mac, cache path: /Users/USER/Library/Caches/fanficdownloader/QtWebEngine/Default/Cache

Not sure why I never thought of this before...

FYI, FanFicFare used to also be named FanFictionDownLoader or fanficdownloader before being renamed. FanFictionDownloader had that name first. There's never been any relation but similarity of purpose between the two.

If not already, I would add this to the browser cache wiki page.

JimmXinu · 09-02-2021, 04:47 PM

Update: FFDL 0.9.4 on Windows 10 and on MacOS worked for me with BrowserCache.

I used:

Code:

[defaults]
#windows
browser_cache_path:C:\Users\USER\AppData\Local\fanficdownloader\cache \QtWebEngine\Default\Cache
#macos
browser_cache_path:/Users/USER/Library/Caches/fanficdownloader/QtWebEngine/Default/Cache

I was not able to use FFDL 0.9.4 on Linux at all.

I tried Ubuntu 21.04 and 20.04. In both cases it wanted a shared library for QtWebEngine that wasn't installed. FFDL doesn't appear to have an installer or instructions for installing necessary dependencies and I don't elect to figure it out right now.

Quote:

Originally Posted by ownedbycats

If not already, I would add this to the browser cache wiki page.

I will put it there eventually, yes. If it turns out to work for more people than not and is useful. Right now, I don't know if it works for anyone else or if anyone finds it all useful.

JimmXinu · 09-03-2021, 12:28 PM

New Test Version Posted

2021-09-03
- Fixes for site changes in adapter_webnovelcom. #731

sandmanwake · 09-04-2021, 02:13 PM

I'm getting errors downloading from royalroad.com with comment of "argument of type 'None Type' is not iterable" after updating to the 2021-09-03 test version of FFF.

Here's the debug log:

Spoiler:

Edit:
It doesn't seem like it's every story on RR that causes an error in download in the 9/3/2021 version of FFF. Downgrading FFF back to version 4.5 seems to allow downloading the stories that did cause an error though.

JimmXinu · 09-04-2021, 02:27 PM

Quote:

Originally Posted by sandmanwake

I'm getting errors downloading from royalroad.com with comment of "argument of type 'None Type' is not iterable" after updating to the 2021-09-03 test version of FFF.

I'm not seeing this error.

What are some story URLs you see it with? And your debug log was truncated--nothing of the error was included.

sandmanwake · 09-04-2021, 03:24 PM

Quote:

Originally Posted by JimmXinu

I'm not seeing this error.

What are some story URLs you see it with? And your debug log was truncated--nothing of the error was included.

Sorry, not sure how the log got truncated.

Here's the log for https://www.royalroad.com/fiction/33...cannon-fodder:

Spoiler:

Same thing happens with:
https://www.royalroad.com/fiction/44...-another-world
https://www.royalroad.com/fiction/42...-of-the-system
https://www.royalroad.com/fiction/41...ession-fantasy

Tried to download a random fic from the front page of RR and it downloaded fine: https://www.royalroad.com/fiction/45...nsional-wizard

JimmXinu · 09-04-2021, 04:16 PM

New Test Version Posted

2021-09-04
- Fix for dateutils change(#731) breaking royalroad

Quote:

Originally Posted by sandmanwake

Sorry, not sure how the log got truncated.

Here's the log for https://www.royalroad.com/fiction/33...cannon-fodder:

Should fix your issue.

sandmanwake · 09-04-2021, 07:00 PM

Quote:

Originally Posted by JimmXinu

Should fix your issue.

That fixed it. Thanks!

09-01-2021, 01:10 PM	#6392
milford833 Member Posts: 15 Karma: 10 Join Date: Oct 2009 Device: Kindle Fire	May be a crazy question I was wondering, I have problems with using the Cache and webtoepub when going to fanfiction.net to download, so I have been downloading the files through FanFiction Downloader, and getting the complete file each time I download. Is there a way to set up FanFicFare to open those html files that it downloads to a specific directory, find the chapters that were not updated, and update the epub files that way? If the last chapter in Calibre was 8 and it is currently on 20, it would update the Calibre epubs to all 20 Chapters? If it is a new story it would just add it as a new story. Pretty much just like it works now, but it does not read a website just a directory with HTML files? I am probably missing something in the explanations on how to do something, but I thought I would ask. Sorry if I am being a pain.

09-01-2021, 10:58 PM	#6394
Book_fury Member Posts: 20 Karma: 10 Join Date: Aug 2021 Device: None	EpubSplit Sorry if this isn’t the right place to ask I don’t think this is the right place to ask this but if I use EpubSplit can I split a book that I’ve merged together So I had two books now I have one can I split it so I have those two books back

09-02-2021, 01:38 PM	#6396
JimmXinu Plugin Developer Posts: 6,992 Karma: 4604635 Join Date: Dec 2011 Location: Midwest USA Device: Kobo Clara Colour running KOReader	FFF BrowserCache and FanFictionDownloader FanFictionDownloader, for those who don't know, is a standalone tool for downloading fanfics that does better with the ffnet blocking issue due to incorporating a QtWebEngine browser engine that it uses for doing downloads. Which, on Windows10 at least, has a browser cache that FFF can read. For me it's at: C:\Users\USER\AppData\Local\fanficdownloader\cache \QtWebEngine\Default\Cache ...and setting FFF's browser_cache_path to use it works fine. Basically, you're replacing WebToEpub and your browser with FFDL. You still need to have downloaded the stories/chapters desired with FFDL before FFF can find them in cache. You can limit FFDL's download to certain chapters, but you have to do it as a two step process ('Check' to get metadata, then download.) I'm going to be doing some testing to see if this also works on Mac and Linux. EDIT1: Worked on Mac, cache path: /Users/USER/Library/Caches/fanficdownloader/QtWebEngine/Default/Cache Not sure why I never thought of this before... FYI, FanFicFare used to also be named FanFictionDownLoader or fanficdownloader before being renamed. FanFictionDownloader had that name first. There's never been any relation but similarity of purpose between the two. Last edited by JimmXinu; 09-02-2021 at 02:01 PM.

09-04-2021, 02:13 PM	#6401
sandmanwake Enthusiast Posts: 26 Karma: 82 Join Date: Aug 2018 Device: none	I'm getting errors downloading from royalroad.com with comment of "argument of type 'None Type' is not iterable" after updating to the 2021-09-03 test version of FFF. Here's the debug log: Spoiler: EpubMerge: DEBUG: 2021-09-04 14:08:34,722: calibre_plugins.epubmerge.epubmerge_plugin(158): macmenuhack file_path:C:\Users\username\AppData\Roaming\calibr e\plugins\fanficfare_macmenuhack.txt FFF: DEBUG: 2021-09-04 14:08:34,733: calibre_plugins.fanficfare_plugin.fff_plugin(221): Plugin FanFicFare macmenuhack file_path:C:\Users\username\AppData\Roaming\calibr e\plugins\fanficfare_macmenuhack.txt calibre Debug log calibre 5.22.1 embedded-python: True is64bit: False Windows-10-10.0.19041 Windows ('32bit', 'WindowsPE') 32bit process running on 64bit windows ('Windows', '10', '10.0.19041') Python 3.8.5 Windows: ('10', '10.0.19041', '', 'Multiprocessor Free') Interface language: None Successfully initialized third party plugins: EpubMerge (2, 11, 0) && EpubSplit (3, 1, 0) && FanFicFare (4, 5, 2) calibre 5.22.1 embedded-python: True is64bit: False Windows-10-10.0.19041 Windows ('32bit', 'WindowsPE') 32bit process running on 64bit windows ('Windows', '10', '10.0.19041') Python 3.8.5 Windows: ('10', '10.0.19041', '', 'Multiprocessor Free') Interface language: None Successfully initialized third party plugins: EpubMerge (2, 11, 0) && EpubSplit (3, 1, 0) && FanFicFare (4, 5, 2) Turning on automatic hidpi scaling devicePixelRatio: 1.0 logicalDpi: 96.0 x 96.0 physicalDpi: 94.14671814671814 x 94.07407407407408 Using calibre Qt style: True [0.00] Starting up... [0.00] Showing splash screen... [0.47] splash screen shown [0.47] Initializing db... [1.03] db initialized [1.03] Constructing main UI... [2.89] main UI initialized... [2.89] Hiding splash screen Starting QuickView [5.03] splash screen hidden [5.03] Started up in 5.03 seconds with 9012 books Edit: It doesn't seem like it's every story on RR that causes an error in download in the 9/3/2021 version of FFF. Downgrading FFF back to version 4.5 seems to allow downloading the stories that did cause an error though. Last edited by sandmanwake; 09-04-2021 at 02:27 PM.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
[GUI Plugin] KindleUnpack - The Plugin	DiapDealer	Plugins	523	07-15-2025 06:45 PM
[GUI Plugin] Open With	kiwidude	Plugins	404	02-21-2025 05:42 AM
[GUI Plugin] Marvin XD	Philantrop	Plugins	126	01-29-2017 12:48 PM
[GUI Plugin] KiNotes	-axel-	Plugins	0	07-14-2013 06:39 PM
[GUI Plugin] Plugin Updater Deprecated	kiwidude	Plugins	159	06-19-2011 12:27 PM

09-01-2021, 08:30 PM	#6393
JimmXinu Plugin Developer Posts: 6,992 Karma: 4604635 Join Date: Dec 2011 Location: Midwest USA Device: Kobo Clara Colour running KOReader	milford833 - FFF can't currently do that. It is something I considered when ffnet starting blocking everybody back in January, but it's a bit complicated and doesn't fit well into FFF's architecture. One issue is mapping the story URL(s) to the downloaded HTML file(s). It's either read everything in a dir tree, or some manual process, or both. The FFF plugin is designed for background batch processing of stories from multiple different sites. Stopping to tell it 'read this story from this file instead' is difficult. I might consider it again if there's interest from enough users.

09-03-2021, 12:28 PM	#6400
JimmXinu Plugin Developer Posts: 6,992 Karma: 4604635 Join Date: Dec 2011 Location: Midwest USA Device: Kobo Clara Colour running KOReader	New Test Version Posted 2021-09-03 - Fixes for site changes in adapter_webnovelcom. #731