[GUI Plugin] FanFicFare

[dwraith0877]

Originally Posted by JimmXinu

I'm not seeing that problem. And if it were happening to everyone, it would have been reported by now.

Please provide a couple story URLs that exhibit the problem for you. It would also be helpful to see a debug log--run Calibre in debug mode before trying to download (under Calibre's Preferences dropdown).

Note that long stories can take a long time to download--sometimes hours.

IMO, it's extremely unlikely that any change in the newest version caused this, but past releases are available if you want to try rolling back.

Log readout from restarting calibre after fff running for ~11.5 hrs...:
calibre Debug log
calibre 4.20 [64bit] embedded-python: True is64bit: True
Windows-10-10.0.18362-SP0 Windows ('64bit', 'WindowsPE')
('Windows', '10', '10.0.18362')
Python 2.7.16+
Windows: ('10', '10.0.18362', 'SP0', u'Multiprocessor Free')
Interface language: None
Successfully initialized third party plugins: Generate Cover (1, 5, 25) && Find Duplicates (1, 7, 2) && FanFicFare (3, 21, 0)
calibre 4.20 [64bit] embedded-python: True is64bit: True
Windows-10-10.0.18362-SP0 Windows ('64bit', 'WindowsPE')
('Windows', '10', '10.0.18362')
Python 2.7.16+
Windows: ('10', '10.0.18362', 'SP0', u'Multiprocessor Free')
Interface language: None
Successfully initialized third party plugins: Generate Cover (1, 5, 25) && Find Duplicates (1, 7, 2) && FanFicFare (3, 21, 0)
Turning on automatic hidpi scaling
devicePixelRatio: 1.0
logicalDpi: 120.0 x 120.0
physicalDpi: 128.0 x 128.186915888
Using calibre Qt style: True
[0.00] Starting up...
[0.00] Showing splash screen...
[2.02] splash screen shown
[2.02] Initializing db...
[7.58] db initialized
[7.58] Constructing main UI...
FFF: DEBUG: 2020-07-14 15:01:44,960: calibre_plugins.fanficfare_plugin.fff_plugin(209): Plugin FanFicFare macmenuhack file_path:C:\Users\Dominic A. Duguay\AppData\Roaming\calibre\plugins\fanficfare_ macmenuhack.txt
[140.58] main UI initialized...
[140.58] Hiding splash screen
[216.80] splash screen hidden
[216.81] Started up in 216.81 seconds with 20772 books
FFF: DEBUG: 2020-07-14 15:07:25,290: calibre_plugins.fanficfare_plugin.fff_plugin(969): add_tag:None
FFF: DEBUG: 2020-07-14 15:07:25,312: calibre_plugins.fanficfare_plugin.fanficfare.adapt ers.adapter_storiesonlinenet(42): StoriesOnlineNetAdapter.__init__ - url='https://storiesonline.net/s/17813/after-the-energists-championships'
FFF: DEBUG: 2020-07-14 15:07:25,336: calibre_plugins.fanficfare_plugin.fff_plugin(979): FanFicFare v3.21.0
FFF: DEBUG: 2020-07-14 15:07:25,424: calibre_plugins.fanficfare_plugin.fff_plugin(1093) : url:https://storiesonline.net/s/17813
FFF: INFO: 2020-07-14 15:07:25,430: calibre_plugins.fanficfare_plugin.prefs(214): Attempting to read settings from predecessor--FFDL
FFF: INFO: 2020-07-14 15:07:25,430: calibre_plugins.fanficfare_plugin.prefs(219): Using default settings
FFF: DEBUG: 2020-07-14 15:07:25,523: calibre_plugins.fanficfare_plugin.fanficfare.adapt ers.adapter_storiesonlinenet(42): StoriesOnlineNetAdapter.__init__ - url='https://storiesonline.net/s/17813'
FFF: DEBUG: 2020-07-14 15:07:25,551: calibre_plugins.fanficfare_plugin.fanficfare.adapt ers.adapter_storiesonlinenet(149): URL: https://storiesonline.net/s/17813
FFF: DEBUG: 2020-07-14 15:07:25,552: calibre_plugins.fanficfare_plugin.fanficfare.confi gurable(1135): #####################################
pagecache(GET) MISS: https://storiesonline.net/s/17813:i
FFF: DEBUG: 2020-07-14 15:07:26,151: calibre_plugins.fanficfare_plugin.fanficfare.confi gurable(993): Encoding:utf8
FFF: DEBUG: 2020-07-14 15:07:26,157: calibre_plugins.fanficfare_plugin.fanficfare.adapt ers.adapter_storiesonlinenet(110): Will now login to URL (https://storiesonline.net/sol-secure/login.php) as (dwraith0877@yahoo.ca)
FFF: DEBUG: 2020-07-14 15:07:26,160: calibre_plugins.fanficfare_plugin.fanficfare.confi gurable(1135): #####################################
pagecache(GET) MISS: https://storiesonline.net/sol-secure/login.php
FFF: DEBUG: 2020-07-14 15:07:28,451: calibre_plugins.fanficfare_plugin.fanficfare.confi gurable(993): Encoding:utf8
FFF: DEBUG: 2020-07-14 15:07:28,552: calibre_plugins.fanficfare_plugin.fanficfare.confi gurable(1063): #####################################
pagecache(POST) MISS: https://storiesonline.net/sol-secure...flwJpVIthg%3D?
FFF: DEBUG: 2020-07-14 15:07:29,141: calibre_plugins.fanficfare_plugin.fanficfare.confi gurable(993): Encoding:utf8
FFF: DEBUG: 2020-07-14 15:07:29,147: calibre_plugins.fanficfare_plugin.fanficfare.confi gurable(1135): #####################################
pagecache(GET) MISS: https://storiesonline.net/s/17813:i
FFF: DEBUG: 2020-07-14 15:07:29,410: calibre_plugins.fanficfare_plugin.fanficfare.confi gurable(993): Encoding:utf8
FFF: DEBUG: 2020-07-14 15:07:29,798: calibre_plugins.fanficfare_plugin.fanficfare.adapt ers.adapter_storiesonlinenet(211): Number of chapters: 51
FFF: DEBUG: 2020-07-14 15:07:29,973: calibre_plugins.fanficfare_plugin.fanficfare.confi gurable(1135): #####################################
pagecache(GET) MISS: https://storiesonline.net/a/al-canadian/1
FFF: DEBUG: 2020-07-14 15:07:30,256: calibre_plugins.fanficfare_plugin.fanficfare.confi gurable(993): Encoding:utf8
FFF: DEBUG: 2020-07-14 15:07:30,693: calibre_plugins.fanficfare_plugin.fanficfare.adapt ers.adapter_storiesonlinenet(291): Found story row on page 1
FFF: DEBUG: 2020-07-14 15:07:30,723: calibre_plugins.fanficfare_plugin.fanficfare.confi gurable(1135): #####################################
pagecache(GET) MISS: https://storiesonline.net/series/1066/the-energists
FFF: DEBUG: 2020-07-14 15:07:30,987: calibre_plugins.fanficfare_plugin.fanficfare.confi gurable(993): Encoding:utf8
FFF: DEBUG: 2020-07-14 15:07:31,404: calibre_plugins.fanficfare_plugin.fanficfare.adapt ers.adapter_storiesonlinenet(379): Do not have a universe
FFF: DEBUG: 2020-07-14 15:07:32,993: calibre_plugins.fanficfare_plugin.fff_plugin(1272) : from URL(https://storiesonline.net/s/17813)
FFF: DEBUG: 2020-07-14 15:07:33,640: calibre_plugins.fanficfare_plugin.fff_plugin(1285) : existing found by identifier URL
FFF: DEBUG: 2020-07-14 15:07:33,664: calibre_plugins.fanficfare_plugin.fff_plugin(1407) : existing epub tmp:C:\Users\DOMINI~1.DUG\AppData\Local\Temp\calib re_olhrgx\fanficfare_0kfym_\old-28888-wgqkbm.epub
FFF: DEBUG: 2020-07-14 15:07:33,999: calibre_plugins.fanficfare_plugin.fff_plugin(1474) : title:After the Energists: Championships, Concerts & Completion
FFF: DEBUG: 2020-07-14 15:07:34,000: calibre_plugins.fanficfare_plugin.fff_plugin(1475) : outfile:C:\Users\DOMINI~1.DUG\AppData\Local\Temp\c alibre_olhrgx\fanficfare_0kfym_\After the Energists_ Championships_ Concerts & Completion-AL-Canadian-fluvmq.epub
FFF: DEBUG: 2020-07-14 15:07:34,426: calibre_plugins.fanficfare_plugin.fff_plugin(1093) : url:https://www.fanfiction.net/s/7984260/1/
FFF: DEBUG: 2020-07-14 15:07:34,520: calibre_plugins.fanficfare_plugin.fanficfare.confi gurable(1179):
===========
set sleep time 1.0
===========
FFF: DEBUG: 2020-07-14 15:07:34,522: calibre_plugins.fanficfare_plugin.fanficfare.adapt ers.adapter_fanfictionnet(100): URL: https://www.fanfiction.net/s/7984260/1/
FFF: DEBUG: 2020-07-14 15:07:34,523: calibre_plugins.fanficfare_plugin.fanficfare.confi gurable(1135): #####################################
pagecache(GET) MISS: https://www.fanfiction.net/s/7984260/1/
FFF: DEBUG: 2020-07-14 15:07:37,075: calibre_plugins.fanficfare_plugin.fanficfare.confi gurable(993): Encoding:utf8
FFF: DEBUG: 2020-07-14 15:07:39,164: calibre_plugins.fanficfare_plugin.fff_plugin(1272) : from URL(https://www.fanfiction.net/s/7984260/1/)
FFF: DEBUG: 2020-07-14 15:07:40,249: calibre_plugins.fanficfare_plugin.fff_plugin(1474) : title:Second World
FFF: DEBUG: 2020-07-14 15:07:40,250: calibre_plugins.fanficfare_plugin.fff_plugin(1475) : outfile:C:\Users\DOMINI~1.DUG\AppData\Local\Temp\c alibre_olhrgx\fanficfare_0kfym_\Second World-Deadlandmarshal-hvsq0v.epub
Exception in thread Thread-3:
Traceback (most recent call last):
File "threading.py", line 801, in __bootstrap_inner
File "site-packages\calibre\utils\ipc\server.py", line 313, in run
File "site-packages\calibre\utils\ipc\server.py", line 231, in launch_worker
CriticalError: Failed to launch worker process:
Traceback (most recent call last):
File "site-packages\calibre\utils\ipc\server.py", line 240, in do_launch
File "site-packages\calibre\utils\ipc\launch.py", line 232, in __call__
File "subprocess.py", line 394, in __init__
File "subprocess.py", line 644, in _execute_child
WindowsError: [Error 2] The system cannot find the file specified

[ILB]

With "make anthology epub from web page" I don´t get an consistent title.
On some I get the series title but on others I get the title of the first part as title of the epub.

For example:
series "Pyjama Verse" https://archiveofourown.org/series/41589
--> title "Pyjama Verse Anthology"
but on series "Technomage" https://archiveofourown.org/series/1779154
--> title "An Assist Anthology" ( which is the title of Part 1 of the series)


Another question to anthologies:
I manually add the series name in column "series" with number/volume "0".
Would it be possible to add this automatically?

[ownedbycats]

dwraith0877 - the "failed to launch worker process" often means that some antivirus or something is eating it. Do you use Avast? Several users have reported problems with that recently.

[JimmXinu]

ownedbycats is correct.

The FFF parts all worked fine getting metadata from the sites before starting the background process failed:

CriticalError: Failed to launch worker process:
Traceback (most recent call last):
  File "site-packages\calibre\utils\ipc\server.py", line 240, in do_launch
  File "site-packages\calibre\utils\ipc\launch.py", line 232, in __call__
  File "subprocess.py", line 394, in __init__
  File "subprocess.py", line 644, in _execute_child
WindowsError: [Error 2] The system cannot find the file specified

This thread shows the same problem but with a different background process and how it was solved for that user.

ADDED: I do wonder, however, why Calibre isn't noticing and reporting this error...

[JimmXinu]

Originally Posted by ILB

With "make anthology epub from web page" I don´t get an consistent title.
On some I get the series title but on others I get the title of the first part as title of the epub.

For example:
series "Pyjama Verse" https://archiveofourown.org/series/41589
--> title "Pyjama Verse Anthology"
but on series "Technomage" https://archiveofourown.org/series/1779154
--> title "An Assist Anthology" ( which is the title of Part 1 of the series)

The 'Make anthology from web page' feature only looks for story URLs in the page given. It doesn't do any further parsing on it. (Which is why it can work on a wide spectrum of different pages.) But it also means that it doesn't actually know that you've asked for a specific series.

FFF uses the series name for the anthology only if the series metadata entry is the same for all the books. The first book in Technomage has "2020 LDWS" for it's series value and "Technomage" for it's series01.

I'm not immediately thinking of any reasonable way to check the numbered series entries, but I'll ponder it. I can already foresee that you could get a series name you didn't expect if all the requested stories were members of the same two series. Like a series list for a) 'This show' and separate series list for b) 'This show, season 2' where 'b' is a subset of 'a'.

Originally Posted by ILB

Another question to anthologies:
I manually add the series name in column "series" with number/volume "0".
Would it be possible to add this automatically?

Hmmm. That was requested a couple months ago and I gave a somewhat flippant answer.

But since it's been requested twice now, I will at least look into it. I've accommodated stranger things.

[JimmXinu]

New Test Version Posted

2020-07-15
- Add 'Series [0]' option for new anthologies.
- For anthologies, look for common val in numbered series00 if not all share 'series'.

Look in FFF's config under the 'Standard Columns' tab for the new anthology option for 'series [0]'.

The code to look for common series across all stories, not just the first series is a bit complex, but it looks like it works.

It turns out there are only two supported sites that can have multiple series, but since one of them is AO3...

ADDED: Please review the displayed text and hover-over tooltip for the new option. Once submitted for translation I am reluctant to change those.

[ownedbycats]

Possible bug report:

When clicking on a syntax error after editing personal.ini, it took me to the beginning of replace_metadata (and highlighted the replace_metadata: header) instead of the glitched line.

Also, difficult-to-read text in dark mode.

[ILB]

Originally Posted by JimmXinu

New Test Version Posted

2020-07-15
- Add 'Series [0]' option for new anthologies.
- For anthologies, look for common val in numbered series00 if not all share 'series'.

Look in FFF's config under the 'Standard Columns' tab for the new anthology option for 'series [0]'.

The code to look for common series across all stories, not just the first series is a bit complex, but it looks like it works.

It turns out there are only two supported sites that can have multiple series, but since one of them is AO3...

ADDED: Please review the displayed text and hover-over tooltip for the new option. Once submitted for translation I am reluctant to change those.

Thanks! It works wonderfully.
I got the title right for both of my example series. And the automatically filled series column is the icing on the cake.

I think text and hover-over tooltip sound good - but I also know what its purpose is

[JimmXinu]

Originally Posted by ownedbycats

Possible bug report:

When clicking on a syntax error after editing personal.ini, it took me to the beginning of replace_metadata (and highlighted the replace_metadata: header) instead of the glitched line.

Also, difficult-to-read text in dark mode.

As I recall, it was problematic to highlight the correct line in a multi-line setting like replace_metadata depending on the error. So it shows you the error and puts you at the start of the setting.

Link color will be lighter in next test version.

[ownedbycats]

Thanks. I also noticed that the line got truncated even if I resized the error box. I think the missing text was just the rest of the long regex though.

[vikarti]

ficbook.net's support appears to stop working
5 random stories results in

Статус
Название
Автор
Комментарий
URL
Ошибка
Превентивный удар или пятьсот лет синевы
Игрохим
'NoneType' object has no attribute 'get_text'
https://www.ficbook.net/readfic/6246312
Ошибка
Тёмная сторона Гермионы Грейнджер или шанс начать жить сначала
Изгнанная из ада
'NoneType' object has no attribute 'get_text'
https://www.ficbook.net/readfic/1530477
Ошибка
Элис
grvitaly
'NoneType' object has no attribute 'get_text'
https://www.ficbook.net/readfic/9171888
Ошибка
Determinatoris
prometei33
'NoneType' object has no attribute 'get_text'
https://www.ficbook.net/readfic/9146978
Ошибка
ME Afterlife: Комиссар по этике
Роман Никитин
'NoneType' object has no attribute 'get_text'
https://www.ficbook.net/readfic/2680238


Site's design also looks differently

[Grimbart]

Hello All,

I checked it on 2 Windows PC and 1 Linux System. I cant download or update storys if the are on fanfiction.net since weeks now.

Most time i get a read op timeed out.

On fanfiktion.de i don´t get the updates zu work. Every time i have to use overwrite to download the new chapters.

Here are some examples for fanfiction.net

https://www.fanfiction.net/s/1249633...e-purpurne-Elf

Status Titel Autor Kommentar URL
Fehler Unknown Unknown ('The read operation timed out',) https://www.fanfiction.net/s/1249633/1/


https://www.fanfiction.net/s/11803449/1/Immer-wachsam

Status Titel Autor Kommentar URL
Fehler Unknown Unknown ('The read operation timed out',) https://www.fanfiction.net/s/11803449/1/

[JimmXinu]

Originally Posted by Grimbart

I checked it on 2 Windows PC and 1 Linux System. I cant download or update storys if the are on fanfiction.net since weeks now.

Most time i get a read op timeed out.

Network errors like usually indicate that you are being blocked or throttled somewhere.

Sometimes it's firewall software on your network or on networks between you and the servers, sometimes it's the servers throttling your access because you (or even someone else in your network 'area') has been generating too much traffic. FFnet is known to do that.

About the only thing you can try in FFF is changing the user_agent setting in personal.ini to something that looks like a manual browser. Like user_agent:Mozilla/5.0

[JimmXinu]

New Test Version Posted

2020-07-16
- New Site: www.scribblehub.com - Thanks, mavi0! (ADDED)
- Fixes for site changes: adapter_ficbooknet
- Change INI error link blue color in dark mode.

[ownedbycats]

Far more readable now. Thank you.