[GUI Plugin] FanFicFare

[Tanjamuse]

browser_cache_path:C:\Users\Name\AppData\Local\Goo gle\Chrome\User Data\Default\Cache

Edit: I've now tried editing it 6-7 times but the space in Google still shows. It only shows up when I save the reply.

[JimmXinu]

Yes, I still see a space.

It's possible that the space is being added when you copy-paste here to the forum.

It's also possible that Browser Cache is still not working for you, but ffnet isn't blocking you right now.

The debug log (or BG job log) will tell you if a page came from the cache or from the site.

[Tanjamuse]

I now got the error again.

Here's the debug-log:

calibre Debug log
calibre 4.23 [64bit]  embedded-python: True is64bit: True
Windows-10-10.0.18362-SP0 Windows ('64bit', 'WindowsPE')
('Windows', '10', '10.0.18362')
Python 2.7.16+
Windows: ('10', '10.0.18362', 'SP0', u'Multiprocessor Free')
Interface language: None
Successfully initialized third party plugins: Save Composite Custom Columns (1, 1, 0) && User Category (1, 5, 4) && Tanja's Tools (0, 0, 9) && Count Pages (1, 9, 0) && Reading List (1, 6, 7) && Find Duplicates (1, 6, 3) && FanFicFare (3, 99, 30) && MultiColumnSearch (1, 0, 77) && Generate Cover (1, 5, 22) && Favourites Menu (1, 0, 5) && Job Spy (1, 0, 178) && Import List (1, 4, 0) && View Manager (1, 5, 5)
calibre 4.23 [64bit]  embedded-python: True is64bit: True
Windows-10-10.0.18362-SP0 Windows ('64bit', 'WindowsPE')
('Windows', '10', '10.0.18362')
Python 2.7.16+
Windows: ('10', '10.0.18362', 'SP0', u'Multiprocessor Free')
Interface language: None
Successfully initialized third party plugins: Save Composite Custom Columns (1, 1, 0) && User Category (1, 5, 4) && Tanja's Tools (0, 0, 9) && Count Pages (1, 9, 0) && Reading List (1, 6, 7) && Find Duplicates (1, 6, 3) && FanFicFare (3, 99, 30) && MultiColumnSearch (1, 0, 77) && Generate Cover (1, 5, 22) && Favourites Menu (1, 0, 5) && Job Spy (1, 0, 178) && Import List (1, 4, 0) && View Manager (1, 5, 5)
Turning on automatic hidpi scaling
devicePixelRatio: 1.0
logicalDpi: 120.0 x 120.0
physicalDpi: 141.76744186 x 142.134715026
Using calibre Qt style: True
[0.00] Starting up...
[0.00] Showing splash screen...
[0.70] splash screen shown
[0.70] Initializing db...
[0.72] db initialized
[0.72] Constructing main UI...
DEPRECATION: The OpenSSL being used by this python install (OpenSSL 1.0.2s  28 May 2019) does not meet the minimum supported version (>= OpenSSL 1.1.1) in order to support TLS 1.3 required by Cloudflare, You may encounter an unexpected Captcha or cloudflare 1020 blocks.
FFF: DEBUG: 2021-02-16 17:40:31,542: calibre_plugins.fanficfare_plugin.fff_plugin(222): Plugin FanFicFare macmenuhack file_path:C:\Users\Gudin\AppData\Roaming\calibre\plugins\fanficfare_macmenuhack.txt
MCS has finished initialization...
Job Spy has begun initialization...
apply_save_to_directory_by_library:   libname is NOT tweaked; default directory used for:    @ Arkiv FFN Select Intake    is:  D:/Calibre/! SavedFromCalibre
Prior value used for 'save to disk dialog' in dynamic.pickle was:   D:\Calibre\! SavedFromCalibre
New Save-To Directory for Library:   D:\Calibre\! SavedFromCalibre
--->>>default template is:  {publisher}/{#fandoms:'re(re($,":"," "),"ยง","&")'}/{#story_id}/{#story_id}
--->>>apply_save_to_template_by_library:   libname is NOT tweaked; default template used for:    @ Arkiv FFN Select Intake    is:  {publisher}/{#fandoms:'re(re($,":"," "),"ยง","&")'}/{#story_id}/{#story_id}
--->>> job_spy_save_to_template was used to set this library's template to:  {publisher}/{#fandoms:'re(re($,":"," "),"ยง","&")'}/{#story_id}/{#story_id}
--->>>job_spy_save_cover_separately default value is:  True
--->>>apply_save_cover_separately_by_library:   libname is NOT tweaked; default value used for:    @ Arkiv FFN Select Intake    is:  True
--->>> job_spy_save_cover_separately was used to set this library's value to:  True
Calibre, and hence Job Spy, was gracefully shut down last time?  True
Last time daemon started:  never
Last time daemon failed:  never
Total daemon starts inception_to_date:  0
Total daemon failures inception-to-date:  0
Job Spy has finished initialization...
[4.44] main UI initialized...
[4.44] Hiding splash screen
[20.23] splash screen hidden
[20.23] Started up in 20.23 seconds with 4 books
FFF: DEBUG: 2021-02-16 17:40:53,907: calibre_plugins.fanficfare_plugin.fff_plugin(1110): FanFicFare v3.99.30
FFF: DEBUG: 2021-02-16 17:40:53,940: calibre_plugins.fanficfare_plugin.fff_plugin(1231): prep_download_loop url:https://www.fanfiction.net/s/6410273/1/
FFF: INFO: 2021-02-16 17:40:53,941: calibre_plugins.fanficfare_plugin.prefs(217): Attempting to read settings from predecessor--FFDL
FFF: INFO: 2021-02-16 17:40:53,941: calibre_plugins.fanficfare_plugin.prefs(222): Using default settings
FFF: DEBUG: 2021-02-16 17:40:54,210: calibre_plugins.fanficfare_plugin.fanficfare.configurable(977): use_cloudscraper:true
FFF: DEBUG: 2021-02-16 17:40:54,211: calibre_plugins.fanficfare_plugin.fanficfare.configurable(996): use_browser_cache:
FFF: DEBUG: 2021-02-16 17:40:54,213: calibre_plugins.fanficfare_plugin.fanficfare.configurable(1010): use_basic_cache:true
FFF: DEBUG: 2021-02-16 17:40:54,214: calibre_plugins.fanficfare_plugin.fff_plugin(1426): update existing id:55908
FFF: DEBUG: 2021-02-16 17:40:54,216: calibre_plugins.fanficfare_plugin.fff_plugin(1640): title:39 Clues - 123fizzi - Watching Over
FFF: DEBUG: 2021-02-16 17:40:54,216: calibre_plugins.fanficfare_plugin.fff_plugin(1641): outfile:C:\Users\Gudin\AppData\Local\Temp\calibre_tybqwa\fanficfare_cubegj\bgmeta-ycluqn.epub
Worker Launch took: 0.162999868393
Job: 0 Download 1 FanFiction Book(s) finished
Download 1 FanFiction Book(s)
	FFF: INFO: 2021-02-16 17:40:55,013: calibre_plugins.fanficfare_plugin.jobs(54): CPUs:4
	FFF: INFO: 2021-02-16 17:40:55,013: calibre_plugins.fanficfare_plugin.jobs(57): FanFicFare v3.99.30
	FFF: INFO: 2021-02-16 17:40:55,015: calibre_plugins.fanficfare_plugin.jobs(74): Launch background process for site www.fanfiction.net:
	https://www.fanfiction.net/s/6410273/1/
	FFF: INFO: 2021-02-16 17:42:40,903: calibre_plugins.fanficfare_plugin.jobs(135): 
	
	================================================================================ site:(www.fanfiction.net)
	DEPRECATION: The OpenSSL being used by this python install (OpenSSL 1.0.2s  28 May 2019) does not meet the minimum supported version (>= OpenSSL 1.1.1) in order to support TLS 1.3 required by Cloudflare, You may encounter an unexpected Captcha or cloudflare 1020 blocks.
	FFF: INFO: 2021-02-16 17:40:57,000: calibre_plugins.fanficfare_plugin.jobs(210): 
	
	-------------------------------------------------------------------------------- https://www.fanfiction.net/s/6410273/1/
	FFF: DEBUG: 2021-02-16 17:40:57,256: calibre_plugins.fanficfare_plugin.fanficfare.configurable(977): use_cloudscraper:true
	FFF: DEBUG: 2021-02-16 17:40:57,257: calibre_plugins.fanficfare_plugin.fanficfare.configurable(996): use_browser_cache:
	FFF: DEBUG: 2021-02-16 17:40:57,259: calibre_plugins.fanficfare_plugin.fanficfare.configurable(1010): use_basic_cache:true
	FFF: DEBUG: 2021-02-16 17:40:57,262: calibre_plugins.fanficfare_plugin.fanficfare.adapters.adapter_fanfictionnet(112): URL: https://www.fanfiction.net/s/6410273/1/
	FFF: DEBUG: 2021-02-16 17:40:57,263: calibre_plugins.fanficfare_plugin.fanficfare.fetcher(233): 
	========== MISS (GET) BasicCache
	https://www.fanfiction.net/s/6410273/1/
	FFF: DEBUG: 2021-02-16 17:40:57,263: calibre_plugins.fanficfare_plugin.fanficfare.fetcher(439): 
	---------- REQ (GET) RequestsFetcher
	https://www.fanfiction.net/s/6410273/1/
	FFF: DEBUG: 2021-02-16 17:40:57,263: calibre_plugins.fanficfare_plugin.fanficfare.fetcher(475): initializing cloudscraper
	FFF: DEBUG: 2021-02-16 17:40:58,099: calibre_plugins.fanficfare_plugin.fanficfare.fetcher(446): response code:200
	FFF: DEBUG: 2021-02-16 17:40:58,101: calibre_plugins.fanficfare_plugin.fanficfare.fetcher(156): random sleep(6.00-18.00):16.33
	FFF: DEBUG: 2021-02-16 17:41:14,436: calibre_plugins.fanficfare_plugin.fanficfare.requestable(49): Encoding:utf8
	FFF: DEBUG: 2021-02-16 17:41:14,921: calibre_plugins.fanficfare_plugin.fanficfare.adapters.adapter_fanfictionnet(146): =Trying newer chapter: https://www.fanfiction.net/s/6410273/2/Watching-Over
	FFF: DEBUG: 2021-02-16 17:41:14,921: calibre_plugins.fanficfare_plugin.fanficfare.fetcher(233): 
	========== MISS (GET) BasicCache
	https://www.fanfiction.net/s/6410273/2/Watching-Over
	FFF: DEBUG: 2021-02-16 17:41:14,921: calibre_plugins.fanficfare_plugin.fanficfare.fetcher(439): 
	---------- REQ (GET) RequestsFetcher
	https://www.fanfiction.net/s/6410273/2/Watching-Over
	FFF: WARNING: 2021-02-16 17:41:43,226: calibre_plugins.fanficfare_plugin.fanficfare.adapters.adapter_fanfictionnet(153): Caught exception in check_next_chapter URL: https://www.fanfiction.net/s/6410273/2/Watching-Over Exception cloudscraper reports: "Detected a Cloudflare version 2 challenge, This feature is not available....".
	FFF: DEBUG: 2021-02-16 17:41:43,490: calibre_plugins.fanficfare_plugin.fanficfare.fetcher(233): 
	========== MISS (GET) BasicCache
	https://www.fanfiction.net/u/2330659/123fizzi
	FFF: DEBUG: 2021-02-16 17:41:43,490: calibre_plugins.fanficfare_plugin.fanficfare.fetcher(439): 
	---------- REQ (GET) RequestsFetcher
	https://www.fanfiction.net/u/2330659/123fizzi
	FFF: WARNING: 2021-02-16 17:42:11,825: calibre_plugins.fanficfare_plugin.fanficfare.adapters.adapter_fanfictionnet(340): Caught exception in skip_author_cover: cloudscraper reports: "Detected a Cloudflare version 2 challenge, This feature is not available....".
	FFF: INFO: 2021-02-16 17:42:12,010: calibre_plugins.fanficfare_plugin.jobs(310): write to C:\Users\Gudin\AppData\Local\Temp\calibre_tybqwa\fanficfare_cubegj\bgmeta-ycluqn.epub
	FFF: INFO: 2021-02-16 17:42:12,012: calibre_plugins.fanficfare_plugin.fanficfare.writers.base_writer(183): Save directly to file: C:\Users\Gudin\AppData\Local\Temp\calibre_tybqwa\fanficfare_cubegj\bgmeta-ycluqn.epub
	FFF: DEBUG: 2021-02-16 17:42:12,016: calibre_plugins.fanficfare_plugin.fanficfare.adapters.adapter_fanfictionnet(367): Getting chapter text from: https://www.fanfiction.net/s/6410273/1/
	FFF: DEBUG: 2021-02-16 17:42:12,016: calibre_plugins.fanficfare_plugin.fanficfare.fetcher(233): 
	========== MISS (GET) BasicCache
	https://www.fanfiction.net/s/6410273/1/Watching-Over
	FFF: DEBUG: 2021-02-16 17:42:12,017: calibre_plugins.fanficfare_plugin.fanficfare.fetcher(439): 
	---------- REQ (GET) RequestsFetcher
	https://www.fanfiction.net/s/6410273/1/Watching-Over
	FFF: INFO: 2021-02-16 17:42:40,371: calibre_plugins.fanficfare_plugin.fanficfare.writers.writer_epub(360): Saving EPUB Version 2.0
	
	FFF: INFO: 2021-02-16 17:42:40,903: calibre_plugins.fanficfare_plugin.jobs(145): 
	Download Results:
	Add https://www.fanfiction.net/s/6410273/1/Watching-Over Download epub completed, 1 failed chapters, 1 total chapters.
	
	FFF: INFO: 2021-02-16 17:42:40,903: calibre_plugins.fanficfare_plugin.jobs(169): 
	Add
	https://www.fanfiction.net/s/6410273/1/Watching-Over
	

FFF: DEBUG: 2021-02-16 17:42:53,099: calibre_plugins.fanficfare_plugin.fff_plugin(2107): update_error_column_loop bad Watching Over https://www.fanfiction.net/s/6410273/1/Watching-Over Download epub completed, 1 failed chapters, 1 total chapters.
FFF: DEBUG: 2021-02-16 17:42:53,111: calibre_plugins.fanficfare_plugin.fff_plugin(1766): add/update Watching Over https://www.fanfiction.net/s/6410273/1/Watching-Over
FFF: DEBUG: 2021-02-16 17:42:53,336: calibre_plugins.fanficfare_plugin.fff_plugin(1845): Finished Adding/Updating 1 books.
FFF: DEBUG: 2021-02-16 17:42:53,338: calibre_plugins.fanficfare_plugin.fff_plugin(1848): removed tdir
get_library_config - start
get_library_config - start
QueueProgressDialog - self.input_order= [u'epub', u'azw3', u'mobi', u'lit', u'prc', u'fb2', u'html', u'htm', u'xhtm', u'shtml', u'xhtml', u'zip', u'docx', u'odt', u'rtf', u'pdf', u'txt']
For book 'Watching Over', using format epub
Worker Launch took: 0.143000125885
Job: 1 Count Page/Word Statistics finished
Count Page/Word Statistics
	do_count_statistics - book_path=C:\Users\Gudin\AppData\Local\Temp\calibre_tybqwa\qity83_count_pages\55908.epub, pages_algorithm=1, page_count_mode=Estimate, statistics_to_run=[u'WordCount'], custom_chars_per_page=1500, icu_wordcount=True
	do_count_statistics - job started for file book_path=C:\Users\Gudin\AppData\Local\Temp\calibre_tybqwa\qity83_count_pages\55908.epub
	-------------------------------
	Logfile for book ID 55908 (Watching Over)
		Found 49 words
	55908
	do_statistics_for_book:  C:\Users\Gudin\AppData\Local\Temp\calibre_tybqwa\qity83_count_pages\55908.epub 1 Estimate [] [u'WordCount'] 1500 True
		Word count using icu_wordcount - trying to count_words
		Word count - used count_words: 49
		Word count: 49
	

About to refresh GUI - book_ids_to_update= [55908]
plugin Save Composite Custom Columns library D:\Calibre\@ Arkiv FFN Select Intake: updated 4 books in 0:00:00.008000

[JimmXinu]

Do you have use_basic_cache:true under [www.fanfiction.net] in personal.ini and uncommented?

Because this line:
"FFF: DEBUG: 2021-02-16 17:40:54,211: calibre_plugins.fanficfare_plugin.fanficfare.confi gurable(996): use_browser_cache:"

...says that you don't have use_browser_cache turned on.

[Tanjamuse]

Yes, but I made a doh-error... I put at the end of my PI, which meant it showed up under replace metadata.

I'm so sorry for the trouble.

[booster-t]

Well, it worked for about a week ... now back to the messed up chapters. I have the cache set to only ... if I knew how to add an image I would <sigh>

A Flower for the Soul TheBlack'sResurgence Update epub completed, added 1 chapters, 1 failed chapt for 22 total.

https:/www.fanfiction.net/s/13747655/1/A-Flower-for-the-Sou

[Tanjamuse]

Well this is just plain weird.

It went fine for a couple of stories and then I got the error again with the trouble with downloading chapters.

The first line below [defaults] is:
browser_cache_path:C:\Users\Gudin\AppData\Local\Go ogle\Chrome\User Data\Default\Cache

I have no idea why it makes that space in Google, when I look at it before I post it, it looks alright, but when I post the space is there, no matter how I write it out.

The first 2 lines below [www.fanfiction.net] is:
use_browser_cache:true
browser_cache_age_limit:4.0

This is the story-link: https://www.fanfiction.net/s/7341148/1/

and the error in the epub:

Error

FanFicFare failed to download this chapter. Because continue_on_chapter_error is set to true, the download continued.

Chapter URL:
https://www.fanfiction.net/s/7341148/1/

Error:
Traceback (most recent call last):
FailedToDownload: cloudscraper reports: "Detected a Cloudflare version 2 challenge, This feature is not available...."

Here's the debug-log:

calibre Debug log
calibre 4.23 [64bit]  embedded-python: True is64bit: True
Windows-10-10.0.18362-SP0 Windows ('64bit', 'WindowsPE')
('Windows', '10', '10.0.18362')
Python 2.7.16+
Windows: ('10', '10.0.18362', 'SP0', u'Multiprocessor Free')
Interface language: None
Successfully initialized third party plugins: User Category (1, 5, 4) && Count Pages (1, 9, 0) && Save Composite Custom Columns (1, 1, 0) && Generate Cover (1, 5, 22) && Job Spy (1, 0, 178) && Favourites Menu (1, 0, 5) && Find Duplicates (1, 6, 3) && FanFicFare (3, 99, 30) && View Manager (1, 5, 5) && Import List (1, 4, 0) && Reading List (1, 6, 7) && Tanja's Tools (0, 0, 9) && MultiColumnSearch (1, 0, 77)
calibre 4.23 [64bit]  embedded-python: True is64bit: True
Windows-10-10.0.18362-SP0 Windows ('64bit', 'WindowsPE')
('Windows', '10', '10.0.18362')
Python 2.7.16+
Windows: ('10', '10.0.18362', 'SP0', u'Multiprocessor Free')
Interface language: None
Successfully initialized third party plugins: User Category (1, 5, 4) && Count Pages (1, 9, 0) && Save Composite Custom Columns (1, 1, 0) && Generate Cover (1, 5, 22) && Job Spy (1, 0, 178) && Favourites Menu (1, 0, 5) && Find Duplicates (1, 6, 3) && FanFicFare (3, 99, 30) && View Manager (1, 5, 5) && Import List (1, 4, 0) && Reading List (1, 6, 7) && Tanja's Tools (0, 0, 9) && MultiColumnSearch (1, 0, 77)
Turning on automatic hidpi scaling
devicePixelRatio: 1.0
logicalDpi: 120.0 x 120.0
physicalDpi: 141.76744186 x 142.134715026
Using calibre Qt style: True
[0.00] Starting up...
[0.00] Showing splash screen...
[0.69] splash screen shown
[0.69] Initializing db...
[0.70] db initialized
[0.70] Constructing main UI...
DEPRECATION: The OpenSSL being used by this python install (OpenSSL 1.0.2s  28 May 2019) does not meet the minimum supported version (>= OpenSSL 1.1.1) in order to support TLS 1.3 required by Cloudflare, You may encounter an unexpected Captcha or cloudflare 1020 blocks.
Job Spy has begun initialization...
apply_save_to_directory_by_library:   libname is NOT tweaked; default directory used for:    @ Arkiv FFN Select Intake    is:  D:/Calibre/! SavedFromCalibre
Prior value used for 'save to disk dialog' in dynamic.pickle was:   D:\Calibre\! SavedFromCalibre
New Save-To Directory for Library:   D:\Calibre\! SavedFromCalibre
--->>>default template is:  {publisher}/{#fandoms:'re(re($,":"," "),"ยง","&")'}/{#story_id}/{#story_id}
--->>>apply_save_to_template_by_library:   libname is NOT tweaked; default template used for:    @ Arkiv FFN Select Intake    is:  {publisher}/{#fandoms:'re(re($,":"," "),"ยง","&")'}/{#story_id}/{#story_id}
--->>> job_spy_save_to_template was used to set this library's template to:  {publisher}/{#fandoms:'re(re($,":"," "),"ยง","&")'}/{#story_id}/{#story_id}
--->>>job_spy_save_cover_separately default value is:  True
--->>>apply_save_cover_separately_by_library:   libname is NOT tweaked; default value used for:    @ Arkiv FFN Select Intake    is:  True
--->>> job_spy_save_cover_separately was used to set this library's value to:  True
Calibre, and hence Job Spy, was gracefully shut down last time?  True
Last time daemon started:  never
Last time daemon failed:  never
Total daemon starts inception_to_date:  0
Total daemon failures inception-to-date:  0
Job Spy has finished initialization...
FFF: DEBUG: 2021-02-16 20:41:44,154: calibre_plugins.fanficfare_plugin.fff_plugin(222): Plugin FanFicFare macmenuhack file_path:C:\Users\Gudin\AppData\Roaming\calibre\plugins\fanficfare_macmenuhack.txt
MCS has finished initialization...
[4.42] main UI initialized...
[4.42] Hiding splash screen
[10.39] splash screen hidden
[10.41] Started up in 10.41 seconds with 10 books
FFF: DEBUG: 2021-02-16 20:42:06,910: calibre_plugins.fanficfare_plugin.fff_plugin(1110): FanFicFare v3.99.30
FFF: DEBUG: 2021-02-16 20:42:06,948: calibre_plugins.fanficfare_plugin.fff_plugin(1231): prep_download_loop url:https://www.fanfiction.net/s/7341148/1/
FFF: INFO: 2021-02-16 20:42:06,948: calibre_plugins.fanficfare_plugin.prefs(217): Attempting to read settings from predecessor--FFDL
FFF: INFO: 2021-02-16 20:42:06,948: calibre_plugins.fanficfare_plugin.prefs(222): Using default settings
FFF: DEBUG: 2021-02-16 20:42:07,210: calibre_plugins.fanficfare_plugin.fanficfare.configurable(1043): 1configuration.get_browser_cache:None
FFF: DEBUG: 2021-02-16 20:42:07,210: calibre_plugins.fanficfare_plugin.fanficfare.configurable(977): use_cloudscraper:true
FFF: DEBUG: 2021-02-16 20:42:07,211: calibre_plugins.fanficfare_plugin.fanficfare.configurable(996): use_browser_cache:true
FFF: DEBUG: 2021-02-16 20:42:07,213: calibre_plugins.fanficfare_plugin.fanficfare.configurable(998): browser_cache_path:C:\Users\Gudin\AppData\Local\Google\Chrome\User Data\Default\Cache
FFF: DEBUG: 2021-02-16 20:42:07,213: calibre_plugins.fanficfare_plugin.fanficfare.browsercache.blockfilecache(40): Using BlockfileCache
FFF: DEBUG: 2021-02-16 20:42:07,214: calibre_plugins.fanficfare_plugin.fanficfare.configurable(1010): use_basic_cache:true
FFF: DEBUG: 2021-02-16 20:42:07,216: calibre_plugins.fanficfare_plugin.fanficfare.configurable(1047): 2configuration.get_browser_cache:<calibre_plugins.fanficfare_plugin.fanficfare.browsercache.BrowserCache object at 0x00000265875F3188>
FFF: DEBUG: 2021-02-16 20:42:07,216: calibre_plugins.fanficfare_plugin.fff_plugin(1426): update existing id:55913
FFF: DEBUG: 2021-02-16 20:42:07,217: calibre_plugins.fanficfare_plugin.fff_plugin(1640): title:39 Clues - 97reddog - Gone Without a Word
FFF: DEBUG: 2021-02-16 20:42:07,217: calibre_plugins.fanficfare_plugin.fff_plugin(1641): outfile:C:\Users\Gudin\AppData\Local\Temp\calibre_53lvay\fanficfare_7uckdi\bgmeta-a7zdcf.epub
FFF: DEBUG: 2021-02-16 20:42:07,250: calibre_plugins.fanficfare_plugin.fanficfare.browsercache.basebrowsercache(212): save browser cache mappings(C:\Users\Gudin\AppData\Local\Temp\calibre_53lvay\fanficfare_7uckdi\qwzdkb.browser_cache)
Worker Launch took: 0.145999908447
Job: 0 Download 1 FanFiction Book(s) finished
Download 1 FanFiction Book(s)
	FFF: INFO: 2021-02-16 20:42:08,020: calibre_plugins.fanficfare_plugin.jobs(54): CPUs:4
	FFF: INFO: 2021-02-16 20:42:08,022: calibre_plugins.fanficfare_plugin.jobs(57): FanFicFare v3.99.30
	FFF: INFO: 2021-02-16 20:42:08,022: calibre_plugins.fanficfare_plugin.jobs(74): Launch background process for site www.fanfiction.net:
	https://www.fanfiction.net/s/7341148/1/
	FFF: INFO: 2021-02-16 20:43:44,063: calibre_plugins.fanficfare_plugin.jobs(135): 
	
	================================================================================ site:(www.fanfiction.net)
	DEPRECATION: The OpenSSL being used by this python install (OpenSSL 1.0.2s  28 May 2019) does not meet the minimum supported version (>= OpenSSL 1.1.1) in order to support TLS 1.3 required by Cloudflare, You may encounter an unexpected Captcha or cloudflare 1020 blocks.
	FFF: INFO: 2021-02-16 20:42:10,079: calibre_plugins.fanficfare_plugin.jobs(210): 
	
	-------------------------------------------------------------------------------- https://www.fanfiction.net/s/7341148/1/
	FFF: DEBUG: 2021-02-16 20:42:10,338: calibre_plugins.fanficfare_plugin.fanficfare.configurable(1043): 1configuration.get_browser_cache:None
	FFF: DEBUG: 2021-02-16 20:42:10,339: calibre_plugins.fanficfare_plugin.fanficfare.configurable(977): use_cloudscraper:true
	FFF: DEBUG: 2021-02-16 20:42:10,341: calibre_plugins.fanficfare_plugin.fanficfare.configurable(996): use_browser_cache:true
	FFF: DEBUG: 2021-02-16 20:42:10,342: calibre_plugins.fanficfare_plugin.fanficfare.configurable(998): browser_cache_path:C:\Users\Gudin\AppData\Local\Google\Chrome\User Data\Default\Cache
	FFF: DEBUG: 2021-02-16 20:42:10,345: calibre_plugins.fanficfare_plugin.fanficfare.browsercache.blockfilecache(40): Using BlockfileCache
	FFF: DEBUG: 2021-02-16 20:42:10,345: calibre_plugins.fanficfare_plugin.fanficfare.configurable(1010): use_basic_cache:true
	FFF: DEBUG: 2021-02-16 20:42:10,345: calibre_plugins.fanficfare_plugin.fanficfare.configurable(1047): 2configuration.get_browser_cache:<calibre_plugins.fanficfare_plugin.fanficfare.browsercache.BrowserCache object at 0x000001D457FFA1C8>
	FFF: DEBUG: 2021-02-16 20:42:10,345: calibre_plugins.fanficfare_plugin.fanficfare.browsercache.basebrowsercache(203): load browser cache mappings(C:\Users\Gudin\AppData\Local\Temp\calibre_53lvay\fanficfare_7uckdi\qwzdkb.browser_cache)
	FFF: DEBUG: 2021-02-16 20:42:10,346: calibre_plugins.fanficfare_plugin.fanficfare.adapters.adapter_fanfictionnet(112): URL: https://www.fanfiction.net/s/7341148/1/
	FFF: DEBUG: 2021-02-16 20:42:10,346: calibre_plugins.fanficfare_plugin.fanficfare.fetcher(233): 
	========== MISS (GET) BasicCache
	https://www.fanfiction.net/s/7341148/1/
	FFF: DEBUG: 2021-02-16 20:42:10,348: calibre_plugins.fanficfare_plugin.fanficfare.fetcher(274): 
	========== MISS (GET) BrowserCache
	https://www.fanfiction.net/s/7341148/1/
	FFF: DEBUG: 2021-02-16 20:42:10,348: calibre_plugins.fanficfare_plugin.fanficfare.fetcher(439): 
	---------- REQ (GET) RequestsFetcher
	https://www.fanfiction.net/s/7341148/1/
	FFF: DEBUG: 2021-02-16 20:42:10,348: calibre_plugins.fanficfare_plugin.fanficfare.fetcher(475): initializing cloudscraper
	FFF: DEBUG: 2021-02-16 20:42:11,144: calibre_plugins.fanficfare_plugin.fanficfare.fetcher(446): response code:200
	FFF: DEBUG: 2021-02-16 20:42:11,145: calibre_plugins.fanficfare_plugin.fanficfare.fetcher(156): random sleep(6.00-18.00):6.35
	FFF: DEBUG: 2021-02-16 20:42:17,499: calibre_plugins.fanficfare_plugin.fanficfare.requestable(49): Encoding:utf8
	FFF: DEBUG: 2021-02-16 20:42:17,953: calibre_plugins.fanficfare_plugin.fanficfare.adapters.adapter_fanfictionnet(146): =Trying newer chapter: https://www.fanfiction.net/s/7341148/2/Gone-Without-a-Word
	FFF: DEBUG: 2021-02-16 20:42:17,953: calibre_plugins.fanficfare_plugin.fanficfare.fetcher(233): 
	========== MISS (GET) BasicCache
	https://www.fanfiction.net/s/7341148/2/Gone-Without-a-Word
	FFF: DEBUG: 2021-02-16 20:42:17,954: calibre_plugins.fanficfare_plugin.fanficfare.fetcher(274): 
	========== MISS (GET) BrowserCache
	https://www.fanfiction.net/s/7341148/2/Gone-Without-a-Word
	FFF: DEBUG: 2021-02-16 20:42:17,954: calibre_plugins.fanficfare_plugin.fanficfare.fetcher(439): 
	---------- REQ (GET) RequestsFetcher
	https://www.fanfiction.net/s/7341148/2/Gone-Without-a-Word
	FFF: WARNING: 2021-02-16 20:42:46,328: calibre_plugins.fanficfare_plugin.fanficfare.adapters.adapter_fanfictionnet(153): Caught exception in check_next_chapter URL: https://www.fanfiction.net/s/7341148/2/Gone-Without-a-Word Exception cloudscraper reports: "Detected a Cloudflare version 2 challenge, This feature is not available....".
	FFF: DEBUG: 2021-02-16 20:42:46,664: calibre_plugins.fanficfare_plugin.fanficfare.fetcher(233): 
	========== MISS (GET) BasicCache
	https://www.fanfiction.net/u/2460613/97reddog
	FFF: DEBUG: 2021-02-16 20:42:46,665: calibre_plugins.fanficfare_plugin.fanficfare.fetcher(274): 
	========== MISS (GET) BrowserCache
	https://www.fanfiction.net/u/2460613/97reddog
	FFF: DEBUG: 2021-02-16 20:42:46,667: calibre_plugins.fanficfare_plugin.fanficfare.fetcher(439): 
	---------- REQ (GET) RequestsFetcher
	https://www.fanfiction.net/u/2460613/97reddog
	FFF: WARNING: 2021-02-16 20:43:15,059: calibre_plugins.fanficfare_plugin.fanficfare.adapters.adapter_fanfictionnet(340): Caught exception in skip_author_cover: cloudscraper reports: "Detected a Cloudflare version 2 challenge, This feature is not available....".
	FFF: INFO: 2021-02-16 20:43:15,305: calibre_plugins.fanficfare_plugin.jobs(310): write to C:\Users\Gudin\AppData\Local\Temp\calibre_53lvay\fanficfare_7uckdi\bgmeta-a7zdcf.epub
	FFF: INFO: 2021-02-16 20:43:15,306: calibre_plugins.fanficfare_plugin.fanficfare.writers.base_writer(183): Save directly to file: C:\Users\Gudin\AppData\Local\Temp\calibre_53lvay\fanficfare_7uckdi\bgmeta-a7zdcf.epub
	FFF: DEBUG: 2021-02-16 20:43:15,313: calibre_plugins.fanficfare_plugin.fanficfare.adapters.adapter_fanfictionnet(367): Getting chapter text from: https://www.fanfiction.net/s/7341148/1/
	FFF: DEBUG: 2021-02-16 20:43:15,315: calibre_plugins.fanficfare_plugin.fanficfare.fetcher(233): 
	========== MISS (GET) BasicCache
	https://www.fanfiction.net/s/7341148/1/Gone-Without-a-Word
	FFF: DEBUG: 2021-02-16 20:43:15,315: calibre_plugins.fanficfare_plugin.fanficfare.fetcher(274): 
	========== MISS (GET) BrowserCache
	https://www.fanfiction.net/s/7341148/1/Gone-Without-a-Word
	FFF: DEBUG: 2021-02-16 20:43:15,315: calibre_plugins.fanficfare_plugin.fanficfare.fetcher(439): 
	---------- REQ (GET) RequestsFetcher
	https://www.fanfiction.net/s/7341148/1/Gone-Without-a-Word
	FFF: INFO: 2021-02-16 20:43:43,677: calibre_plugins.fanficfare_plugin.fanficfare.writers.writer_epub(360): Saving EPUB Version 2.0
	
	FFF: INFO: 2021-02-16 20:43:44,063: calibre_plugins.fanficfare_plugin.jobs(145): 
	Download Results:
	Add https://www.fanfiction.net/s/7341148/1/Gone-Without-a-Word Download epub completed, 1 failed chapters, 1 total chapters.
	
	FFF: INFO: 2021-02-16 20:43:44,063: calibre_plugins.fanficfare_plugin.jobs(169): 
	Add
	https://www.fanfiction.net/s/7341148/1/Gone-Without-a-Word
	

FFF: DEBUG: 2021-02-16 20:44:07,354: calibre_plugins.fanficfare_plugin.fff_plugin(2107): update_error_column_loop bad Gone Without a Word https://www.fanfiction.net/s/7341148/1/Gone-Without-a-Word Download epub completed, 1 failed chapters, 1 total chapters.
FFF: DEBUG: 2021-02-16 20:44:07,365: calibre_plugins.fanficfare_plugin.fff_plugin(1766): add/update Gone Without a Word https://www.fanfiction.net/s/7341148/1/Gone-Without-a-Word
FFF: DEBUG: 2021-02-16 20:44:07,582: calibre_plugins.fanficfare_plugin.fff_plugin(1845): Finished Adding/Updating 1 books.
FFF: DEBUG: 2021-02-16 20:44:07,585: calibre_plugins.fanficfare_plugin.fff_plugin(1848): removed tdir
get_library_config - start
get_library_config - start
QueueProgressDialog - self.input_order= [u'epub', u'azw3', u'mobi', u'lit', u'prc', u'fb2', u'html', u'htm', u'xhtm', u'shtml', u'xhtml', u'zip', u'docx', u'odt', u'rtf', u'pdf', u'txt']
For book 'Gone Without a Word', using format epub
Worker Launch took: 0.148999929428
Job: 1 Count Page/Word Statistics finished
Count Page/Word Statistics
	do_count_statistics - book_path=C:\Users\Gudin\AppData\Local\Temp\calibre_53lvay\x4ts3b_count_pages\55913.epub, pages_algorithm=1, page_count_mode=Estimate, statistics_to_run=[u'WordCount'], custom_chars_per_page=1500, icu_wordcount=True
	do_count_statistics - job started for file book_path=C:\Users\Gudin\AppData\Local\Temp\calibre_53lvay\x4ts3b_count_pages\55913.epub
	-------------------------------
	Logfile for book ID 55913 (Gone Without a Word)
		Found 51 words
	55913
	do_statistics_for_book:  C:\Users\Gudin\AppData\Local\Temp\calibre_53lvay\x4ts3b_count_pages\55913.epub 1 Estimate [] [u'WordCount'] 1500 True
		Word count using icu_wordcount - trying to count_words
		Word count - used count_words: 51
		Word count: 51
	

About to refresh GUI - book_ids_to_update= [55913]
plugin Save Composite Custom Columns library D:\Calibre\@ Arkiv FFN Select Intake: updated 10 books in 0:00:00.007000

[ownedbycats]

One thing to note is that if you're using "Update Existing Fanfic" instead of the Add URLs for the chapters directly, you need to also open the first chapter in the browser or FFF won't find it in cache and try to fallback to the site. I made this mistake.

[JimmXinu]

Your log shows that you have browser cache turned on now, so that's progress.

But that story page wasn't found in the cache.

I've shown below the lines to look for in debug log that tell you both of those things:

Originally Posted by Tanjamuse

Well this is just plain weird.

It went fine for a couple of stories and then I got the error again with the trouble with downloading chapters.
...

FFF: DEBUG: 2021-02-16 20:42:07,211: calibre_plugins.fanficfare_plugin.fanficfare.configurable(996): use_browser_cache:true
FFF: DEBUG: 2021-02-16 20:42:07,213: calibre_plugins.fanficfare_plugin.fanficfare.configurable(998): browser_cache_path:C:\Users\Gudin\AppData\Local\Google\Chrome\User Data\Default\Cache
FFF: DEBUG: 2021-02-16 20:42:07,213: calibre_plugins.fanficfare_plugin.fanficfare.browsercache.blockfilecache(40): Using BlockfileCache
...
calibre_plugins.fanficfare_plugin.fanficfare.fetcher(274): 
	========== MISS (GET) BrowserCache
	https://www.fanfiction.net/s/7341148/1/

Have you made sure that you have force-refreshed(reloaded) that page in your browser in the last 4 hours? And that it shows all the chapters?

Are you sure that you did so in Chrome in the Default user profile and not any secondary profile?

[Tanjamuse]

In this case, it's set to overwrite always.

I've opened the link I posted, and I always open it/refresh it before I try to download the story, and go through all the chapters.

I only have the default folder in chrome.

[ownedbycats]

Originally Posted by Tanjamuse

In this case, it's set to overwrite always.

I've opened the link I posted, and I always open it/refresh it before I try to download the story, and go through all the chapters.

I only have the default folder in chrome.

If you've previously opened the story, the cached version might not be new enough for FFF.

Ctrl+F5 on all the chapters would likely be annoying, so the quickest way is to use Menu > More Tools > Delete Browsing Data > Cache just to dump the old cache entirely then run through the story so the cache is guaranteed to be fresh.

Be careful not to delete cookies or anything else you want to keep.

EDIT: Try Jim's suggestion below first.

[JimmXinu]

I have a theory what's going on now.

Tanjamuse: try it with "Background Metadata" unchecked.

UPDATE: Skip that--try the new test version instead.

[JimmXinu]

New Test Version Posted

2021-02-16
- Fix for browser_cache with bgmeta.

Turns out with "Background Metadata" checked the 'on demand' cache loading was skipped because the BG job thought it had already been run.

[ownedbycats]

Question: How close is FFF to the next stable release?

[JimmXinu]

Considering we just found another bug? Farther than I thought this morning. Probably the full month, so ~20th?