[GUI Plugin] FanFicFare

[tricklem]

I can't seem to get the browser cache to work. Can someone tell me if I still have this wrong?

brower cache under defaults is:

browser_cache_path:C:\Users\NAME\AppData\Local\Moz illa\Firefox\Profiles\466fs7zq.default-release\cache2


This is what is under fanfiction.net
[www.fanfiction.net]
use_browser_cache:true
browser_cache_age_limit:4.0
use_browser_cache_only:true

[JimmXinu]

@tricklem - We just walked someone else through all the steps. Have you:
- Read and followed those posts?
- Updated to the latest test version?
- Observed what is written in your debug logs?

[ownedbycats]

Originally Posted by ownedbycats

One thing to note is that if you're using "Update Existing Fanfic" instead of the Add URLs for the chapters directly, you need to also open the first chapter in the browser or FFF won't find it in cache and try to fallback to the site. I made this mistake.

Also, I think it might be a good idea to mention it on this page, though it's probably already implied by step 3.

[JimmXinu]

Originally Posted by ownedbycats

Also, I think it might be a good idea to mention it on this page, though it's probably already implied by step 3.

"3. Navigate in your browser to the first chapter of the the story you want to download."

I thought it was pretty clear, but I suppose it could be taken ambiguously as 'first chapter you want' when 'first chapter of the story' is meant.

Changed to:

"3. Navigate in your browser to chapter 1 of the the story you want to download."

[booster-t]

You know, I can't imagine how frustrating this must be for you, and I cannot express my gratitude in a way that you can "get" it ... I know I and many others are dependent on your efforts.

I installed the latest test version 3.99.32 and tried to update a story. I paged through each chapter so I know Safari has it. Yet when I go to update, this is what I get:

Update Reaper's Choice
Angeltsuki
Update epub completed, added 2 chapters, 2 failed chapters, for 5 total.

https://www.fanfiction.net/s/13818403/1/Reaper-s-Choice

I have the following settings in the personal.ini file:

Browser_cache_path:~/Library/Application Support/Google/Chrome/Default/Application Cache/Cache

and under
[www.fanfiction.net]
use_browser_cache_only:true

Not sure if it matters but Browser_cache_path shows in red

I tried with these settings, but the update fails if either are enabled

use_browser_cache:true
Browser_cache_age_limit: 4.0

Thanks again for your efforts.

[booster-t]

Originally Posted by booster-t

I installed the latest test version 3.99.32 and tried to update a story. I paged through each chapter so I know Safari has it. Yet when I go to update, this is what I get:

Update Reaper's Choice
Angeltsuki
Update epub completed, added 2 chapters, 2 failed chapters, for 5 total.

https://www.fanfiction.net/s/13818403/1/Reaper-s-Choice

I have the following settings in the personal.ini file:

Browser_cache_path:~/Library/Application Support/Google/Chrome/Default/Application Cache/Cache

and under
[www.fanfiction.net]
use_browser_cache_only:true

Not sure if it matters but Browser_cache_path shows in red

I tried with these settings, but the update fails if either are enabled

use_browser_cache:true
Browser_cache_age_limit: 4.0

Thanks again for your efforts.

A follow-up... I changed the setting for the cache location and I got the same issue. I then enabled use_browser_cache:true and still no help.

BUT, after reading a different post, I paged through every chapter posted on FFN. Then I tried the update. Bingo! That worked. It's a pain the butt, it seems to be a workaround for now.

[tricklem]

Originally Posted by JimmXinu

@tricklem - We just walked someone else through all the steps. Have you:
- Read and followed those posts?
- Updated to the latest test version?
- Observed what is written in your debug logs?

I did see that someone else was having the same problem and tried to go through the pages of comments and follow advice given, but browser cache isn't working for me. I also checked out the instruction page that you did up.

After I updated to the newest test version (I was out by one version) I was able to see the debug file. It looks like it is still using cloudfare to get the chapters and not my brower cache.

I wasn't sure if we are supposed to have the # symobl infront of the new directions under personal.ini, but I have tried it with and without & with and without a space afterward.

I am usually pretty good with computers and this is just frustrating me to the point that I am about ready to just give up.

[minorthman]

Failed to setup BrowserCache(Directory does not contain a known browser cache type: 'C:\Users\Toshiba C55-A5100\AppData\Local\Mozilla\Firefox\Profiles\h1yno njd.default-1611513187773\cache2

ver 85 of firefox windows 8.1

Traceback (most recent call last):
File "calibre\customize\ui.py", line 703, in initialize_plugins
File "calibre\customize\ui.py", line 61, in load_plugin
File "calibre\customize\zipplugin.py", line 293, in load
File "importlib\__init__.py", line 127, in import_module
File "<frozen importlib._bootstrap>", line 1014, in _gcd_import
File "<frozen importlib._bootstrap>", line 991, in _find_and_load
File "<frozen importlib._bootstrap>", line 975, in _find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 671, in _load_unlocked
File "calibre\customize\zipplugin.py", line 192, in exec_module
File "calibre_plugins.fantastic_fiction.__init__", line 10, in <module>
ModuleNotFoundError: No module named 'HTMLParser'
FFF: DEBUG: 2021-02-16 20:34:40,030: calibre_plugins.fanficfare_plugin.fff_plugin(222): Plugin FanFicFare macmenuhack file_path:C:\Users\Toshiba C55-A5100\AppData\Roaming\calibre\plugins\fanficfare_m acmenuhack.txt
calibre Debug log
calibre 5.10.1 [64bit] embedded-python: True is64bit: True
Windows-8.1-6.3.9600 Windows ('64bit', 'WindowsPE')
('Windows', '8.1', '6.3.9600')
Python 3.8.5
Windows: ('8.1', '6.3.9600', '', 'Multiprocessor Free')
Interface language: None
Failed to initialize plugin: 'C:\\Users\\Toshiba C55-A5100\\AppData\\Roaming\\calibre\\plugins\\Fantast ic Fiction.zip'
Successfully initialized third party plugins: FanFicFare (3, 99, 29) && Find Duplicates (1, 8, 5) && Quality Check (1, 11, 0)
calibre 5.10.1 [64bit] embedded-python: True is64bit: True
Windows-8.1-6.3.9600 Windows ('64bit', 'WindowsPE')
('Windows', '8.1', '6.3.9600')
Python 3.8.5
Windows: ('8.1', '6.3.9600', '', 'Multiprocessor Free')
Interface language: None
Successfully initialized third party plugins: FanFicFare (3, 99, 29) && Find Duplicates (1, 8, 5) && Quality Check (1, 11, 0)
Turning on automatic hidpi scaling
devicePixelRatio: 1.0
logicalDpi: 96.0 x 96.0
physicalDpi: 100.86162790697674 x 101.07357512953367
Using calibre Qt style: True
[0.00] Starting up...
[0.00] Showing splash screen...
[0.33] splash screen shown
[0.33] Initializing db...
[0.41] db initialized
[0.41] Constructing main UI...
[3.39] main UI initialized...
[3.39] Hiding splash screen
Starting QuickView
FFF: DEBUG: 2021-02-16 20:34:53,378: calibre_plugins.fanficfare_plugin.fff_plugin(1110) : FanFicFare v3.99.29
FFF: DEBUG: 2021-02-16 20:34:53,393: calibre_plugins.fanficfare_plugin.fff_plugin(1231) : prep_download_loop url:https://www.fanfiction.net/s/13821225/1/I-Dream-Of-You
FFF: INFO: 2021-02-16 20:34:53,393: calibre_plugins.fanficfare_plugin.prefs(217): Attempting to read settings from predecessor--FFDL
FFF: INFO: 2021-02-16 20:34:53,393: calibre_plugins.fanficfare_plugin.prefs(222): Using default settings
FFF: DEBUG: 2021-02-16 20:34:53,409: calibre_plugins.fanficfare_plugin.fanficfare.confi gurable(1043): 1configuration.get_browser_cache:None
FFF: DEBUG: 2021-02-16 20:34:53,409: calibre_plugins.fanficfare_plugin.fanficfare.confi gurable(977): use_cloudscraper:true
FFF: DEBUG: 2021-02-16 20:34:53,409: calibre_plugins.fanficfare_plugin.fanficfare.confi gurable(996): use_browser_cache:true
FFF: DEBUG: 2021-02-16 20:34:53,409: calibre_plugins.fanficfare_plugin.fanficfare.confi gurable(998): browser_cache_path:C:\Users\Toshiba C55-A5100\AppData\Local\Mozilla\Firefox\Profiles\h1yno njd.default-1611513187773\cache2
FFF: WARNING: 2021-02-16 20:34:53,409: calibre_plugins.fanficfare_plugin.fanficfare.confi gurable(1007): Failed to setup BrowserCache(Directory does not contain a known browser cache type: 'C:\Users\Toshiba C55-A5100\AppData\Local\Mozilla\Firefox\Profiles\h1yno njd.default-1611513187773\cache2')
FFF: ERROR: 2021-02-16 20:34:53,409: calibre_plugins.fanficfare_plugin.dialogs(721): Exception: {'title': 'Unknown', 'author_sort': ['Unknown'], 'author': ['Unknown'], 'comments': '', 'good': False, 'status': 'Error', 'showerror': True, 'calibre_id': None, 'begin': None, 'end': None, 'comment': "Directory does not contain a known browser cache type: 'C:\\Users\\Toshiba C55-A5100\\AppData\\Local\\Mozilla\\Firefox\\Profiles\ \h1ynonjd.default-1611513187773\\cache2'", 'url': 'https://www.fanfiction.net/s/13821225/1/I-Dream-Of-You', 'site': 'www.fanfiction.net', 'series': '', 'added': False, 'pubdate': None, 'publisher': None, 'uniqueurl': 'https://www.fanfiction.net/s/13821225/1/I-Dream-Of-You[None-None]', 'listorder': 0, 'collision': 'Add New Book'}irectory does not contain a known browser cache type: 'C:\Users\Toshiba C55-A5100\AppData\Local\Mozilla\Firefox\Profiles\h1yno njd.default-1611513187773\cache2'
Traceback (most recent call last):
File "calibre_plugins.fanficfare_plugin.dialogs", line 708, in do_loop
File "calibre_plugins.fanficfare_plugin.fff_plugin" , line 1271, in prep_download_loop
File "calibre_plugins.fanficfare_plugin.fanficfare.conf igurable", line 1046, in get_browser_cache
File "calibre_plugins.fanficfare_plugin.fanficfare.conf igurable", line 1003, in get_fetcher
File "calibre_plugins.fanficfare_plugin.fanficfare.brow sercache.__init__", line 24, in __init__
calibre_plugins.fanficfare_plugin.fanficfare.brows ercache.basebrowsercache.BrowserCacheException: Directory does not contain a known browser cache type: 'C:\Users\Toshiba C55-A5100\AppData\Local\Mozilla\Firefox\Profiles\h1yno njd.default-1611513187773\cache2'
FFF: DEBUG: 2021-02-16 20:35:04,653: calibre_plugins.fanficfare_plugin.fff_plugin(1845) : Finished Adding/Updating 0 books.
FFF: DEBUG: 2021-02-16 20:35:04,653: calibre_plugins.fanficfare_plugin.fff_plugin(1848) : removed tdir

NOTE......
same machine same software ver works with EDGE

##browser_cache_path:C:\Users\Toshiba C55-A5100\AppData\Local\Mozilla\Firefox\Profiles\h1yno njd.default-1611513187773\cache2

browser_cache_path:C:\Users\Toshiba C55-A5100\AppData\Local\Microsoft\Edge\User Data\Default\Cache

just switched the comment lines to switch from one to the other

MZCacheView for firefox shows files in firefox cache directory

maybe this will help

[ownedbycats]

Originally Posted by tricklem

I wasn't sure if we are supposed to have the # symobl infront of the new directions under personal.ini, but I have tried it with and without & with and without a space afterward.

## If there's pound signs in front of the line, it's commented out and FFF ignores it. See how the commented lines change colour.



## Note that I have Waterfox's cache commented out, so FFF will ignore that.

[booster-t]

Originally Posted by ownedbycats

## If there's pound signs in front of the line, it's commented out and FFF ignores it. See how the commented lines change colour.

Attachment 185422

## Note that I have Waterfox's cache commented out, so FFF will ignore that.

Umm .. how do you attach a file ... I wanted to include one but the site asks for an url but the file is local ... thanks

[ownedbycats]

Click this. It may not be available if you're a very new user though.

[Tanjamuse]

Originally Posted by JimmXinu

New Test Version Posted

2021-02-16
- Fix for browser_cache with bgmeta.

Turns out with "Background Metadata" checked the 'on demand' cache loading was skipped because the BG job thought it had already been run.

I've installed the latest Test version and it looks to be working just fine. I've run through at least 30 stories without a single error.

[minorthman]

Firefox cache2 directory

C:\Users\Toshiba C55-A5100\AppData\Local\Mozilla\Firefox\Profiles\h1yno njd.default-1611513187773\cache2

contains two subfolders

doomed (empty)
entries (35 items)

names are 40 chars long and look like random letters and numbers
files are a mix of binary and text combined in them
some of them you can see (cloudflare.com/cdn-cgi/beacon/expect-ct)

MZCacheView for firefox lists the following URLs

http://ocsp.digicert.com
http://ocsp.digicert.com
http://ocsp.digicert.com
http://ocsp.digicert.com
http://ocsp.pki.goog/gts1o1core
http://ocsp.pki.goog/gts1o1core
http://ocsp.sectigo.com
https://ajax.googleapis.com/ajax/lib...t/1/webfont.js
https://content-signature-2.cdn.mozi...17-58-04.chain
https://ff74.b-cdn.net/static/script..._01_09_2012.js
https://firefox.settings.services.mo...s/cfr-v1-en-US
https://snippets.cdn.mozilla.net/us-...s/default.json
https://www.fanfiction.net/book/Harr...t=1&lan=1&r=10
https://www.fanfiction.net/cors/font....woff?57225533
https://www.fanfiction.net/favicon.ico
https://www.fanfiction.net/image/6315276/75
https://www.fanfiction.net/image/6336468/75
https://www.fanfiction.net/image/6372455/75
https://www.fanfiction.net/image/6543394/75
https://www.fanfiction.net/image/6547494/75
https://www.fanfiction.net/image/6553822/75
https://www.fanfiction.net/image/6555343/75
https://www.fanfiction.net/image/6555394/75
https://www.fanfiction.net/image/6555405/75
https://www.fanfiction.net/s/13819449/1/The-Raven-Four
https://www.fanfiction.net/s/13819449/2/The-Raven-Four
https://www.fanfiction.net/static/ficons/comments.png
https://www.fanfiction.net/static/ficons/group.png
https://www.fanfiction.net/static/ficons/script.png
https://www.fanfiction.net/static/images/d_60_90.jpg
https://www.fanfiction.net/static/im...010_iphone.png
https://www.fanfiction.net/static/im..._2010_site.ico
https://www.fanfiction.net/static/sc...bo5.js?v=1.0.0
https://www.fanfiction.net/static/st...26.css?v=1.0.0

EDGE cache

C:\Users\Toshiba C55-A5100\AppData\Local\Microsoft\Edge\User Data\Default\Cache
same update request has 9 files

"C:\Users\Toshiba C55-A5100\AppData\Local\Microsoft\Edge\User Data\Default\Cache\data_0"
"C:\Users\Toshiba C55-A5100\AppData\Local\Microsoft\Edge\User Data\Default\Cache\data_1"
"C:\Users\Toshiba C55-A5100\AppData\Local\Microsoft\Edge\User Data\Default\Cache\data_2"
"C:\Users\Toshiba C55-A5100\AppData\Local\Microsoft\Edge\User Data\Default\Cache\data_3"
"C:\Users\Toshiba C55-A5100\AppData\Local\Microsoft\Edge\User Data\Default\Cache\f_000001"
"C:\Users\Toshiba C55-A5100\AppData\Local\Microsoft\Edge\User Data\Default\Cache\f_000002"
"C:\Users\Toshiba C55-A5100\AppData\Local\Microsoft\Edge\User Data\Default\Cache\f_000003"
"C:\Users\Toshiba C55-A5100\AppData\Local\Microsoft\Edge\User Data\Default\Cache\f_000004"
"C:\Users\Toshiba C55-A5100\AppData\Local\Microsoft\Edge\User Data\Default\Cache\index"

so it looks like firefox has alot different layout
could not see a index file

[steltek]

Originally Posted by minorthman

Firefox cache2 directory

C:\Users\Toshiba C55-A5100\AppData\Local\Mozilla\Firefox\Profiles\h1yno njd.default-1611513187773\cache2

contains two subfolders

doomed (empty)
entries (35 items)

names are 40 chars long and look like random letters and numbers
files are a mix of binary and text combined in them
some of them you can see (cloudflare.com/cdn-cgi/beacon/expect-ct)

MZCacheView for firefox lists the following URLs

http://ocsp.digicert.com
http://ocsp.digicert.com
http://ocsp.digicert.com
http://ocsp.digicert.com
http://ocsp.pki.goog/gts1o1core
http://ocsp.pki.goog/gts1o1core
http://ocsp.sectigo.com
https://ajax.googleapis.com/ajax/lib...t/1/webfont.js
https://content-signature-2.cdn.mozi...17-58-04.chain
https://ff74.b-cdn.net/static/script..._01_09_2012.js
https://firefox.settings.services.mo...s/cfr-v1-en-US
https://snippets.cdn.mozilla.net/us-...s/default.json
https://www.fanfiction.net/book/Harr...t=1&lan=1&r=10
https://www.fanfiction.net/cors/font....woff?57225533
https://www.fanfiction.net/favicon.ico
https://www.fanfiction.net/image/6315276/75
https://www.fanfiction.net/image/6336468/75
https://www.fanfiction.net/image/6372455/75
https://www.fanfiction.net/image/6543394/75
https://www.fanfiction.net/image/6547494/75
https://www.fanfiction.net/image/6553822/75
https://www.fanfiction.net/image/6555343/75
https://www.fanfiction.net/image/6555394/75
https://www.fanfiction.net/image/6555405/75
https://www.fanfiction.net/s/13819449/1/The-Raven-Four
https://www.fanfiction.net/s/13819449/2/The-Raven-Four
https://www.fanfiction.net/static/ficons/comments.png
https://www.fanfiction.net/static/ficons/group.png
https://www.fanfiction.net/static/ficons/script.png
https://www.fanfiction.net/static/images/d_60_90.jpg
https://www.fanfiction.net/static/im...010_iphone.png
https://www.fanfiction.net/static/im..._2010_site.ico
https://www.fanfiction.net/static/sc...bo5.js?v=1.0.0
https://www.fanfiction.net/static/st...26.css?v=1.0.0

EDGE cache

C:\Users\Toshiba C55-A5100\AppData\Local\Microsoft\Edge\User Data\Default\Cache
same update request has 9 files

"C:\Users\Toshiba C55-A5100\AppData\Local\Microsoft\Edge\User Data\Default\Cache\data_0"
"C:\Users\Toshiba C55-A5100\AppData\Local\Microsoft\Edge\User Data\Default\Cache\data_1"
"C:\Users\Toshiba C55-A5100\AppData\Local\Microsoft\Edge\User Data\Default\Cache\data_2"
"C:\Users\Toshiba C55-A5100\AppData\Local\Microsoft\Edge\User Data\Default\Cache\data_3"
"C:\Users\Toshiba C55-A5100\AppData\Local\Microsoft\Edge\User Data\Default\Cache\f_000001"
"C:\Users\Toshiba C55-A5100\AppData\Local\Microsoft\Edge\User Data\Default\Cache\f_000002"
"C:\Users\Toshiba C55-A5100\AppData\Local\Microsoft\Edge\User Data\Default\Cache\f_000003"
"C:\Users\Toshiba C55-A5100\AppData\Local\Microsoft\Edge\User Data\Default\Cache\f_000004"
"C:\Users\Toshiba C55-A5100\AppData\Local\Microsoft\Edge\User Data\Default\Cache\index"

so it looks like firefox has alot different layout
could not see a index file

It works with the Firefox cache structure, as well as in two Waterfox variants (Waterfox 3rd Gen and Waterfox Classic, both Firefox-based browsers) I've tried.

Are you absolutely, positively sure you have the correct Firefox cache path? The reason I ask is that cache path you posted looks a little off from how Firefox would normally name it when creating a profile (unless you manually renamed it during creation). Also, if your Firefox installation has multiple user profiles installed (even if you don't use them), each profile will have a separate cache path so you want to make sure you have the correct one selected for the user profile you are actually using.

To make sure you have the correct one, open a separate browser tab and type the following in the URL bar and hit enter:

about:cache

The entry you want for the Firefox profile you are using is under the 'disk' section - just select and copy/paste it into the [defaults] section of your FFF personal.ini file right after the colon (with no intervening spaces) in the browser_cache_path: statement

[tricklem]

Originally Posted by ownedbycats

## If there's pound signs in front of the line, it's commented out and FFF ignores it. See how the commented lines change colour.

Attachment 185422

## Note that I have Waterfox's cache commented out, so FFF will ignore that.

I will try that.