[GUI Plugin] FanFicFare

[jklly12]

Ok Running Now. Are we talking my computer hard drive or calibre's ? right now my computer has about 233GB left but I really need to delete some files off of it. Now Calibre's I can remove my complete Folder the files in there over to my one drive.

[jennifer_voorhee]

Originally Posted by JimmXinu

Stories restricted to registered users work fine for me.

You can use either [archiveofourown.org] or [www.archiveofourown.org], but I don't recommend using both because that will cause confusion.

If you get the story, just not the tags, then your user/pass must be correct.

I'm going to need to see some examples story URLs that give you the problem to help any further.

Okay, I tried changing from www.archiveofourown.org to archiveofourown.org in personal.ini, and I also double-checked my username and password. It's correct. I can log in just fine with that username and password. It didn't seem to make a difference for downloading the story tags, though.

Right now I'm working on downloading stories from The Hex Files collection. I'll give the link to the collection, as well as a link for a sample story. I've had nearly all I've downloaded from the collection the past few days where I've had to manually add in the tags from the story (that I want to keep at least).

Collection: http://archiveofourown.org/collections/thehexfiles

I just tested downloading the following story to verify that the changes I made to personal.ini didn't help with the tags: http://archiveofourown.org/collectio.../works/8208695 or http://archiveofourown.org/works/820...pters/18808589

The following tags were automatically added to Calibre for this fic: Completed, Draco Malfoy/Harry Potter, FanFiction, Harry Potter - J. K. Rowling, M/M

However, the story has the following additional tags, which I need to add manually (but never have in the past when downloading from AO3): Angst, Dark, Drama, First Time, Romance, Explicit Language, Sexual Content

[JimmXinu]

Originally Posted by jklly12

Ok Running Now. Are we talking my computer hard drive or calibre's ? right now my computer has about 233GB left but I really need to delete some files off of it. Now Calibre's I can remove my complete Folder the files in there over to my one drive.

The drive you keep your Calibre library on, and the drive for Calibre's temp directory are the ones that would matter.

[JimmXinu]

Originally Posted by jennifer_voorhee

...
The following tags were automatically added to Calibre for this fic: Completed, Draco Malfoy/Harry Potter, FanFiction, Harry Potter - J. K. Rowling, M/M

However, the story has the following additional tags, which I need to add manually (but never have in the past when downloading from AO3): Angst, Dark, Drama, First Time, Romance, Explicit Language, Sexual Content

I get those tags fine for that story. But the fact it's the 'Additional Tags' specifically gives me a couple ideas.

Idea one:

The 'Additional Tags' are parsed by FFF into a metadata entry called freeformtags. By default, freeformtags are included in genre (AO3 doesn't have a field named genre).

Also by default, FFF includes genre in include_subject_tags, which is what 'tags' are called inside epubs and what FFF uses to populate Calibre's Tags field.

So I theorize that you've changed something in your personal.ini that breaks that chain. If you can't find it yourself, you can use the 'View "Safe" personal.ini' button and post it here for me to look at.

Idea two:

Alternatively, if it's truly only happening for 'logged in' stories, it's possible that the AO3 skin you are using breaks the screen scraping. I've seen it before on other sides, but not previously on AO3. FFF generally only supports the default skin for each site--in AO3's case, literally 'Default'.

[jklly12]

Originally Posted by JimmXinu

The drive you keep your Calibre library on, and the drive for Calibre's temp directory are the ones that would matter.

The Drive I keep calibre on is my c drive and that is the 233 as far as temp drive how do i access that? Also I am not able to recreate the issue since i deleted the two fics in question

[JimmXinu]

Originally Posted by jklly12

The Drive I keep calibre on is my c drive and that is the 233 as far as temp drive how do i access that? Also I am not able to recreate the issue since i deleted the two fics in question

If it's not still happening, then it's probably not full disk(s). OTOH, I've seen that sort of bug mean failing system memory or other larger problems before.

I suggest running memtest and other general system diags to see if your computer is having problems.

[Tanjamuse]

Everytime I try to update a story by mail or just a link from Bloodshedverse.com I get the following error:

Bad
Unknown
Unknown
http://bloodshedverse.com/stories.php?go=read&no=14212
http://bloodshedverse.com/stories.php?go=read&no=14212

and it's not because the story doesn't exist, because if I choose update existing story it updates just fine.

Have I done something in my personal.ini which causes problems when I try to update via link instead of in the plugin?

Here's the link I tried http://www.bloodshedverse.com/storie...=read&no=14212

[jennifer_voorhee]

Originally Posted by JimmXinu

I get those tags fine for that story. But the fact it's the 'Additional Tags' specifically gives me a couple ideas.

Idea one:

The 'Additional Tags' are parsed by FFF into a metadata entry called freeformtags. By default, freeformtags are included in genre (AO3 doesn't have a field named genre).

Also by default, FFF includes genre in include_subject_tags, which is what 'tags' are called inside epubs and what FFF uses to populate Calibre's Tags field.

So I theorize that you've changed something in your personal.ini that breaks that chain. If you can't find it yourself, you can use the 'View "Safe" personal.ini' button and post it here for me to look at.

Idea two:

Alternatively, if it's truly only happening for 'logged in' stories, it's possible that the AO3 skin you are using breaks the screen scraping. I've seen it before on other sides, but not previously on AO3. FFF generally only supports the default skin for each site--in AO3's case, literally 'Default'.

First, I guess I can't honestly say that's it's "just" the restricted stories, so maybe some other problem is occurring. The majority of stories from the collection, which is all I've been downloading from AO3 the past week, are restricted, so since I'd never encountered the problem before I thought the restriction was the issue. I can't personally recall if I've downloaded restricted stories in the past or not, but I know I've never noticed the problem with tags until this week.

When logged in, I am using a different skin, AO3's "Reversi" skin, since I prefer the dark background with light text on those occasions I decide to read something over my browser instead of my Kindle. I think I've been using Reversi for maybe a year or so.

Finally, I don't think anything should have been changed in my personal.ini, other than adding usernames/passwords, etc. for the sites I've downloaded from in the past. Just in case, here's my "Safe" personal.ini:

## This is an example of what your personal configuration might look
## like. Uncomment options by removing the '#' in front of them.

[defaults]
## [defaults] section applies to all formats and sites but may be
## overridden at several levels. Example:

## [defaults]
## titlepage_entries: category,genre, status
## [www.whofic.com]
## # overrides defaults.
## titlepage_entries: category,genre, status,dateUpdated,rating
## [epub]
## # overrides defaults & site section
## titlepage_entries: category,genre, status,datePublished,dateUpdated,dateCreated
## [www.whofic.com:epub]
## # overrides defaults, site section & format section
## titlepage_entries: category,genre, status,datePublished
## [overrides]
## # overrides all other sections
## titlepage_entries: category

## Some sites also require the user to confirm they are adult for
## adult content. Uncomment by removing '#' in front of is_adult.
#is_adult:true

## Don't like the numbers at the start of chapter titles on some
## sites? You can use strip_chapter_numbers to strip them off. Just
## want to make them all look the same? Strip them off, then add them
## back on with add_chapter_numbers. Don't like the way it strips
## numbers or adds them back? See chapter_title_strip_pattern and
## chapter_title_add_pattern.
#strip_chapter_numbers:true
#add_chapter_numbers:true

## Add this to genre if there's more than one category.
#add_genre_when_multi_category: Crossover

[epub]
## include images from img tags in the body and summary of stories.
## Images will be converted to jpg for size if possible. Images work
## in epub format only. To get mobi or other format with images,
## download as epub and use Calibre to convert.
#include_images:true

## If not set, the summary will have all html stripped for safety.
## Both this and include_images must be true to get images in the
## summary.
#keep_summary_html:true

## If set, the first image found will be made the cover image. If
## keep_summary_html is true, any images in summary will be before any
## in chapters.
#make_firstimage_cover:true

## Resize images down to width, height, preserving aspect ratio.
## Nook size, with margin.
#image_max_size: 580, 725

## Change image to grayscale, if graphics library allows, to save
## space.
#grayscale_images: false


## Most common, I expect will be using this to save username/passwords
## for different sites. Here are a few examples. See defaults.ini
## for the full list.

[www.fictionpad.com]
username:XXXXXXXX
password:XXXXXXXX

[archiveofourown.org]
username:XXXXXXXX
password:XXXXXXXX
is_adult:true

[www.twilighted.net]
username:XXXXXXXX
password:XXXXXXXX
## default is false
#collect_series: true

[www.twcslibrary.net]
username:XXXXXXXX
password:XXXXXXXX
is_adult:true
## default is false
#collect_series: true

[www.tthfanfic.org]
username:XXXXXXXX
password:XXXXXXXX
is_adult:true
## tth is a little unusual--it doesn't require user/pass, but the site
## keeps track of which chapters you've read and won't send another
## update until it thinks you're up to date. This way, on download,
## it thinks you're up to date.

[www.destinysgateway.com]
is_adult:true

[nha.magical-worlds.us]
is_adult:true

[fanfiction.portkey.org]
is_adult:true

[ficwad.com]
#username:XXXXXXXX
#password:XXXXXXXX

[www.adastrafanfic.com]
## Some sites do not require a login, but do require the user to
## confirm they are adult for adult content.
#is_adult:true

[www.fictionalley.org]
is_adult:true

[www.harrypotterfanfiction.com]
is_adult:true

[adult-fanfiction.org]
is_adult:true

[www.fimfiction.net]
#is_adult:true
#fail_on_password:XXXXXXXX


## This section will override anything in the system defaults or other
## sections here.
[overrides]
## default varies by site. Set true here to force all sites to
## collect series.
#collect_series: true

[JimmXinu]

Originally Posted by Tanjamuse

Everytime I try to update a story by mail or just a link from Bloodshedverse.com I get the following error:

http://bloodshedverse.com/stories.php?go=read&no=14212
...

That's a link to an individual chapter. The adapter_bloodshedversecom code is taking 14212 as the storyId and it isn't. So when it looks for that story on the author page by 14212, it isn't found.

Your existing stories work because they refer to the first chapter/story URL instead of a later chapter.

Fortunately, we've seen this problem before with other sites, so the system is already designed to handle the storyId changing while fetching metadata. I'll have a fix in the next test version that will automatically correct the storyId.

[Tanjamuse]

Thanks. I thought it was something in my Personal.ini

[JimmXinu]

@jennifer_voorhee:

I don't see anything in your personal.ini that would affect the issue. Nor does changing my account to Reversi skin duplicate it. Or even using both your personal.ini and Reversi skin.

What will cause 'Additional Tags' not to be collected is if you have the switch 'Hide additional tags' checked in your AO3 account preferences. So far, that's the only way I've found to get your reported behavior.

EDIT: That would also explain why you only see the problem with restricted stories--FFF doesn't login if it doesn't have to.

[JimmXinu]

New test version posted (direct link)

2017-01-18
- adapter_bloodshedversecom needs to be able to change storyId.
- Bump test version

[DisturbedDragon]

So as of the last update my calibre has begun getting errors, but only for specific stories. I first realized it when instead of saying that none of my books needed updating I had 0 updated and 3452 non updated books (though the majority aren't actually from FFF). I thought that maybe it was just a style change, but then the next time it was downloading two books before saying that. I took a look at the log and here's where I believe it ran into an error:
AttributeError: 'NoneType' object has no attribute 'find'
I'm not sure why I can update stories from the same site (sufficientvelocity) but two specific stories are throwing that error. Is there anything I can do to fix it?

[JimmXinu]

Originally Posted by DisturbedDragon

...
AttributeError: 'NoneType' object has no attribute 'find'
I'm not sure why I can update stories from the same site (sufficientvelocity) but two specific stories are throwing that error. Is there anything I can do to fix it?

I cannot help you with that little information. I can't even look to see if I get the same problem without you providing the story URLs.

Run Calibre in debug mode (Calibre Preferences->Restart in Debug), attempt to download or update a few stories, then post the error log (preferably wrapped in spoiler and code tags).

I will also refer you to the FAQ: Why shouldn't I just select my entire library and use FanFicFare plugin to check for updates?

[JimmXinu]

New test version posted (direct link)

2017-01-19
- New Site: asianfanfics.com - Thanks 444555!
- Tweak to adapter_whoficcom from GComyn.
- Bump test version

2017-01-18
- adapter_bloodshedversecom needs to be able to change storyId.
- Bump test version

2017-01-14
- Edge case fixes for errorcol and lastcheckedcol.
- Add author_avatar_cover option for base_xenforoforum.
- Bump test version

2017-01-12
- Make base_efiction_adapter honor keep_summary_html:true option.
- Bump test version