[GUI Plugin] FanFicFare

[JimmXinu]

New Test Version Posted

2018-03-18

- Revert "Remove defunct site www.destinysgateway.com" - Site is back.

[Ladyrixx]

Is there a way to queue up all your anthology books to update? It's a pain to select each anthology I have and tell it to update. It would be fine if the same confirmation box popped up to verify that the story urls are correct, I would just like to queue them up like how you can queue multiple books to edit metadata individually.

[JimmXinu]

No, there isn't.

Anthologies are created by using the same mechanism that does multiple individual books. IE, internally FFF runs each book download as if given individually, unbundling / bundling the anthology (using EpubMerge) as needed.

Anthology is honestly kind of a tacked-on feature. I think the plugin might have to be significantly redesigned to do more than one at a time.

But I'll look into it.

[flamingsword108]

Fanficfare is nice in that it provides a platform to download several types of ebooks including Chinese Webnovels and Fanfiction.
However their is a lack of support for sites that also host Korean and JP Webnovels.
I would like to request both
https://wuxiaworld.online/
and
http://novelfull.com/

Thank you

[Mieeka]

Is it possible to add a function when "check for existing Series Anthology books" and "reject Without confirmation" is turned on that a copy-pastable list of titles is generated at the end of "Get Story URL's from Email" so i know ones i need to manually update without wading through my emails?

[JimmXinu]

Multi-reply!

Originally Posted by flamingsword108

Fanficfare is nice in that it provides a platform to download several types of ebooks including Chinese Webnovels and Fanfiction.
However their is a lack of support for sites that also host Korean and JP Webnovels.
I would like to request both
https://wuxiaworld.online/
and
http://novelfull.com/

FFF supports some translated webnovel sites because a few user/developers wanted them and contributed code to add them to the project.

I (Jim) am not interested in adding more webnovel sites myself because: I don't read them; they aren't fanfiction; and some appear to have published copyrighted material on them.

The current webnovel situation reminds me strongly of the fansub and bittorrent era of anime a few years ago.

At this time, I don't plan to remove the webnovel sites already supported, and I will consider contributed code to add them to the project, but I don't promise to add any that I see possible legal issues with.

Originally Posted by Mieeka

Is it possible to add a function when "check for existing Series Anthology books" and "reject Without confirmation" is turned on that a copy-pastable list of titles is generated at the end of "Get Story URL's from Email" so i know ones i need to manually update without wading through my emails?

After download, open the Jobs list (click Jobs in Calibre lower right corner) and look at the details of the download job (double click) you'll see a lot of debug output but at the bottom will be lists of download results, successful URLs, and unsuccessful URLs.

Example:

FFF: INFO: 2019-03-22 14:15:42,213: calibre_plugins.fanficfare_plugin.jobs(102): 
Download Results:
http://test1.com?sid=66 Update epub completed, added 0 chapters for 9 total.
http://test1.com?sid=67 Update epub completed, added 0 chapters for 9 total.
http://test1.com?sid=68 Update epub completed, added 0 chapters for 9 total.
http://test1.com?sid=1002 Update epub completed, added 0 chapters for 2 total.
http://test1.com?sid=50 Update epub completed, added 0 chapters for 9 total.
http://test1.com?sid=5 Story in Series Anthology(The Great Test [5]).
http://test1.com?sid=2 Story in Series Anthology(The Great Test [2]).

FFF: INFO: 2019-03-22 14:15:42,214: calibre_plugins.fanficfare_plugin.jobs(104): 
Successful:
http://test1.com?sid=66
http://test1.com?sid=67
http://test1.com?sid=68
http://test1.com?sid=1002
http://test1.com?sid=50

FFF: INFO: 2019-03-22 14:15:42,214: calibre_plugins.fanficfare_plugin.jobs(105): 
Unsuccessful:
http://test1.com?sid=5
http://test1.com?sid=2

[flamingsword108]

Originally Posted by JimmXinu

Multi-reply!

FFF supports some translated webnovel sites because a few user/developers wanted them and contributed code to add them to the project.

I (Jim) am not interested in adding more webnovel sites myself because: I don't read them; they aren't fanfiction; and some appear to have published copyrighted material on them.

The current webnovel situation reminds me strongly of the fansub and bittorrent era of anime a few years ago.

At this time, I don't plan to remove the webnovel sites already supported, and I will consider contributed code to add them to the project, but I don't promise to add any that I see possible legal issues with.

You are right in that several webnovels have been licensed. However there are several fan translations as well that are not. The problem is that each of these fantranslations is hosted on a seperate website depending on the translator. Sites like webnovel.online provide a platform where you can find all of them so providing support for that allows you to download everything. And nearly all the stuff from webnovel (that has been licensed) can also be found on wuxiaworld.co (which is already supported). These websites have the benefit of holding much more unlicensed JP/Korean content. Finally you cannot be charged for downloading copyright content only distributing it. (Thats why they can go after torrents as you are uploading as well when you seed) So regardless of the morality itself, from a legal standpoint it is untouchable.
That being said I understand your reluctance to add sources that make you uncomfortable. Thank you very much for your reply and for the plugin itself which is absolutely amazing.

[JesseTheK]

I'm running FFF 3.6.0 and Calibre 3.40.1 on macOS Mojave 10.14.3

I can't make an "Anthology ePub from Web Page" for this 33-part AO3 series
https://archiveofourown.org/series/67323

In Calibre, FFF's error message is "No valid story URLs found on given page."

Log

Spoiler:

Convert book 1 of 1 (fanficfare)
Python function terminated unexpectedly: Could not find an e-book inside the archive
Processing archive...
Traceback (most recent call last):
File "/Applications/calibre.app/Contents/Resources/Python/lib/python2.7/site.py", line 154, in main
return run_entry_point()
File "/Applications/calibre.app/Contents/Resources/Python/lib/python2.7/site.py", line 114, in run_entry_point
return getattr(pmod, func)()
File "site-packages/calibre/utils/ipc/worker.py", line 199, in main
File "site-packages/calibre/gui2/convert/gui_conversion.py", line 42, in gui_convert_override
File "site-packages/calibre/gui2/convert/gui_conversion.py", line 24, in gui_convert
File "site-packages/calibre/ebooks/conversion/plumber.py", line 729, in __init__
File "site-packages/calibre/ebooks/conversion/plumber.py", line 810, in unarchive
File "site-packages/calibre/ebooks/conversion/plumber.py", line 821, in find_html_index
ValueError: Could not find an e-book inside the archive

On the web service, the error message is different

Spoiler:

Bad Story URL: (https://archiveofourown.org/series/67323) for site: (archiveofourown.org) Example: (https://archiveofourown.org/works/123456 https://archiveofourown.org/collecti...e/works/123456 https://archiveofourown.org/works/123456/chapters/78901) Source

This function has worked well for other series--FFF just created an anthology containing 17 stores from this series:
https://archiveofourown.org/series/747750
----
I adore this plugin and it makes my life much happier. Thank you for your continuing work.

[ilovejedd]

Originally Posted by JesseTheK

I'm running FFF 3.6.0 and Calibre 3.40.1 on macOS Mojave 10.14.3

I can't make an "Anthology ePub from Web Page" for this 33-part AO3 series
https://archiveofourown.org/series/67323

In Calibre, FFF's error message is "No valid story URLs found on given page."

Log

Spoiler:

Convert book 1 of 1 (fanficfare)
Python function terminated unexpectedly: Could not find an e-book inside the archive
Processing archive...
Traceback (most recent call last):
File "/Applications/calibre.app/Contents/Resources/Python/lib/python2.7/site.py", line 154, in main
return run_entry_point()
File "/Applications/calibre.app/Contents/Resources/Python/lib/python2.7/site.py", line 114, in run_entry_point
return getattr(pmod, func)()
File "site-packages/calibre/utils/ipc/worker.py", line 199, in main
File "site-packages/calibre/gui2/convert/gui_conversion.py", line 42, in gui_convert_override
File "site-packages/calibre/gui2/convert/gui_conversion.py", line 24, in gui_convert
File "site-packages/calibre/ebooks/conversion/plumber.py", line 729, in __init__
File "site-packages/calibre/ebooks/conversion/plumber.py", line 810, in unarchive
File "site-packages/calibre/ebooks/conversion/plumber.py", line 821, in find_html_index
ValueError: Could not find an e-book inside the archive

On the web service, the error message is different

Spoiler:

Bad Story URL: (https://archiveofourown.org/series/67323) for site: (archiveofourown.org) Example: (https://archiveofourown.org/works/123456 https://archiveofourown.org/collecti...e/works/123456 https://archiveofourown.org/works/123456/chapters/78901) Source

AO3 username and password information set correctly in preferences?

[JesseTheK]

Thank you--I hadn't realized I needed to do this.

Originally Posted by ilovejedd

AO3 username and password information set correctly in preferences?

So I did this--that is, I clicked FanFicFare,
selected Configure FanFicFare from dropdown menu
selected the Personal tab
Clicked "Edit personal.ini"
Added under [archiveofourown.org]

username:Jesse_the_K
password:myactualpassword
collect_series: true

And I got the anthology in a tidy ePub. Magic--I'm so glad you're both here.

[JimmXinu]

New Test Version Posted

2018-03-26
- Recognize destinysgateway.com and www.destinysgateway.com
- Remove ncisfic.com -- moved to AO3.
- Fix date format for adapter_gluttonyfictioncom

[Chrysanthemum]

Hello,
I've been using FFF for a while now, and recently noticed that when I get an email from archive of our own that one of my subscriptions has updated, FFF says there is No update. Today one was updated, and on the website has 6 chapters. FFF says there is No update, and my Calibre copy remains with only 5 chapters.
I am not a tech person, so if there is something wrong with the code, I wouldn't know it.
Any ideas?

[JimmXinu]

Originally Posted by Chrysanthemum

I've been using FFF for a while now, and recently noticed that when I get an email from archive of our own that one of my subscriptions has updated, FFF says there is No update. Today one was updated, and on the website has 6 chapters. FFF says there is No update, and my Calibre copy remains with only 5 chapters.

Did you have the email setup working before? It's setup in FanFicFare configuration in the Email tab.

FFF will only look in Unread emails, does it work if you mark the email Unread in your email client and try again?

If it still doesn't work, can you copy the email and paste it here for me to see? I especially want to see if the story URL form has changed.

[Chrysanthemum]

Originally Posted by JimmXinu

Did you have the email setup working before? It's setup in FanFicFare configuration in the Email tab.

FFF will only look in Unread emails, does it work if you mark the email Unread in your email client and try again?

If it still doesn't work, can you copy the email and paste it here for me to see? I especially want to see if the story URL form has changed.

I never used the email set up. I am referring to subscribing directly to the stories I follow from the Archive of Our Own website. They email me when a story has been updated. I check their website, and indeed the story has been updated. I move to Calibre, select the story, click update existing story. It is at this point that I receive the message there is no update.

[JimmXinu]

Originally Posted by Chrysanthemum

I never used the email set up. I am referring to subscribing directly to the stories I follow from the Archive of Our Own website. They email me when a story has been updated. I check their website, and indeed the story has been updated. I move to Calibre, select the story, click update existing story. It is at this point that I receive the message there is no update.

What is the story URL?

Are you sure that the copy you have in your library is from AO3 and not ffnet or another site? That's the only idea that comes to mind.