[GUI Plugin] FanFicFare

[Tanjamuse]

I came across a new error from FFnet.

IncompleteRead(630 bytes read)

Here's a link:

https://www.fanfiction.net/s/13129508/1/

[JimmXinu]

Originally Posted by Tanjamuse

I came across a new error from FFnet.

IncompleteRead(630 bytes read)

Here's a link:

https://www.fanfiction.net/s/13129508/1/

A quick search of the thread for IncompleteRead finds:

https://www.mobileread.com/forums/sh...ad#post3580168

...which links to:

https://www.mobileread.com/forums/sh...69#post3336369

Short answer: in past, it's been caused by the user's software firewall(s).

[Tanjamuse]

Then why, is it only that link and another?

[JimmXinu]

Originally Posted by Tanjamuse

Then why, is it only that link and another?

I don't know. I would speculate that there's something in the text/headers/images for those stories that are tripping your firewall to 'protect' you by changing or removing certain bytes.

What I do know is that I'm not seeing that problem with the story URL you gave, nor with other ffnet stories. Nor have other users reported the same problem.

I've directed you to what was determined to be the problem in past when someone saw IncompleteRead errors.

[talldarkknight]

Jimm,

I'm grateful to you for creating such a wonderful tool that is helping so many of us in archiving our favorite reads. I primarily use it for storiesonline.net, but I will also be checking out the other supported sites as I wasn't previously aware of them.

I primarily use the Calibre plugin as it works absolutely fine. However, today I encountered errors while trying to download stories from storiesonline.net.

Apparently, the site has two access mode: filtered and full. The story I was trying to download was available only under full access mode. But surprisingly the plugin keeps showing 403:Forbidden error. I can download other stories but this set of stories are the only ones giving me the error. Then I tried the web service and got the same error.

Hope if you find time you'd be able to look into the issue.

[JimmXinu]

Originally Posted by talldarkknight

Apparently, the site has two access mode: filtered and full. The story I was trying to download was available only under full access mode. But surprisingly the plugin keeps showing 403:Forbidden error. I can download other stories but this set of stories are the only ones giving me the error. Then I tried the web service and got the same error.

There's code in the storiesonline adapter to require site login in case of a 401 response, but nothing specific for 403.

If you want to post (or PM if story is NSFW) a few story URLs that exhibit the problem I will look into it.

(For future reference, please always include story URLs when reporting issues.)

[talldarkknight]

Originally Posted by JimmXinu

There's code in the storiesonline adapter to require site login in case of a 401 response, but nothing specific for 403.

If you want to post (or PM if story is NSFW) a few story URLs that exhibit the problem I will look into it.

(For future reference, please always include story URLs when reporting issues.)

I apologize for not linking the stories in my post. It wasn't until I had clicked submit post I realized that w/o links to the stories it wouldn't be easy to catch the issue.
Here's a

Moderator Notice
Personal link removed

series of stories[/URL] that gave me the error initially.

I get the following error on the site:

This series has no stories at your access level.
You must Change your access level

While using the FanFicFare plugin and webservice, I get the 403 error.
Thanks for looking into it.

[JimmXinu]

Originally Posted by talldarkknight

Here's a
Personal link removed series of stories[/URL] that gave me the error initially.

theducks apparently removed the link before I had a chance to see. Can you send it to me in PM? Thanks.

(Also not sure why MR isn't sending me notice emails for this thread anymore. Hopefully unsub/re-sub will fix it.)

[talldarkknight]

Originally Posted by JimmXinu

theducks apparently removed the link before I had a chance to see. Can you send it to me in PM? Thanks.

I don't have enough privileges to use PM. You can search "Cammie Sue by reallifedragon" to get the series of story.

[JimmXinu]

Originally Posted by talldarkknight

I don't have enough privileges to use PM. You can search "Cammie Sue by reallifedragon" to get the series of story.

Works fine for me as long as I have a good user(by email) and password either in personal.ini or entered manually. FYI, you can't use the Background Metadata option unless your user/pass is in personal.ini.

We've seen other problems with this site before if you don't use the default theme.

I don't know how one gets PM privileges on MR. But I do wonder why I haven't been getting notice emails.

[talldarkknight]

Originally Posted by JimmXinu

Works fine for me as long as I have a good user(by email) and password either in personal.ini or entered manually. FYI, you can't use the Background Metadata option unless your user/pass is in personal.ini.

We've seen other problems with this site before if you don't use the default theme.

I have set up multiple accounts in personal.ini through which I've easily downloaded stories without facing issues. Theme is set at Classic. I get the error only in some stories. Were you able to download using the plugin? Can you try "Melissa's Secrets by Pookie" (/s/38248)?

What do you mean by the background metadata option?

[JimmXinu]

New Test Version posted

2018-12-03
- Change for adapter_storiesonlinenet for 'Full Access' stories.

Originally Posted by talldarkknight

I have set up multiple accounts in personal.ini through which I've easily downloaded stories without facing issues. Theme is set at Classic. I get the error only in some stories. Were you able to download using the plugin? Can you try "Melissa's Secrets by Pookie" (/s/38248)?

What do you mean by the background metadata option?

When updating an existing story in your library from the library (ie, not by URL), there's an option to push all of the metadata gathering into the background process. It doesn't have a way to stop and ask for user/password.

[talldarkknight]

Originally Posted by JimmXinu

New Test Version posted

2018-12-03
- Change for adapter_storiesonlinenet for 'Full Access' stories.



When updating an existing story in your library from the library (ie, not by URL), there's an option to push all of the metadata gathering into the background process. It doesn't have a way to stop and ask for user/password.

Thanks for resolving it so quickly and elegantly.

[edeniz]

I need help with my replace_metadata. Several stories throw fanficfare into an infinite loop or something, so that calibre always freezes up (for hours if I let it) whenever trying to download them.

Example link: https://archiveofourown.org/works/8892235[1]

What they have in common is a specific metadata replacement in my ini:

Spoiler:

 genre=>(.*)=>\1\,Alternate Universe - Time Travel\,Time Travel&&description=>([Tt]ime-? ?[Tt]ravel)
 genre=>^[Tt]ime ?-?[Tt]ravel$|^Peggy Sue$|^time travel with a huge twist$=>Time Travel\,Alternate Universe - Time Travel
 genre=>^Alternate Universe - Time Travel$=>Time Travel\,Alternate Universe - Time Travel
 genre=>^[Tt]ime [Tt]ravel [Aa][Uu]$=>Alternate Universe - Time Travel\,Time Travel
 genre=>^can you believe I wrote another time travel fic\?$=>Time Travel

I know that whatever is wrong with these lines is something obvious staring me right in the face, because that's kinda a recurring problem with me. But I still can't figure it out.

[JimmXinu]

Originally Posted by edeniz

I need help with my replace_metadata. Several stories throw fanficfare into an infinite loop or something, so that calibre always freezes up (for hours if I let it) whenever trying to download them.
...

Copying that snippet into my personal.ini, I don't see any issues with the one story given.

replace_metadata isn't supposed to allow infinite loops--and even if it did, Calibre would run out of memory and error before hours had passed.

If you can send me a copy of your full personal.ini file it might help (use the 'View "Safe" personal.ini' button).

If you use the "Saved Metadata Column" feature (which I recommend to anyone with complex metadata setup), you can prove whether it's the metadata processing or not by doing an update with "Update Calibre Metadata from Saved Metadata Column" option.

You could also run Calibre in debug mode and see if you get any useful logging from that.