[GUI Plugin] FanFicFare

[JimmXinu]

Originally Posted by ILB

...
I think it depends if it´s very complicated or complex to work in the changes. If the result justifies the expense.

If I already knew how many restricted stories there are as a percentage, I probably wouldn't be asking for opinions.

This is the second time in the last 30 days AO3 has changed their login, increasing the complexity. I haven't tracked down every detail, but it looks like it now uses JS to call a separate JSON URL to get an auth token for login.

Even if I continue trying to support AO3 login, it has become a moving target that may already be out of range.

Originally Posted by ILB

I´d prefer the possibility to download it with FFF
...
edit: How does it affect the "Get StoryURL´s from Email" ?

Originally Posted by MerlinMama

Question: if it needs a login, will we be asked? I seem to remember this happening (maybe not for AO3) before I set up my personal.ini the first time.

'Restricted' story URLs, regardless of source, will throw an error:
"AO3 doesn't allow download of (%s) without login and user/password login by automated tools such as FanFicFare is blocked by AO3 site." % self.url

I believe lists (author pages and series pages) will not show you restricted stories when not logged in.

Oh, and without login, FFF will not be able to collect your bookmarks that you've added to stories.

[ILB]

@MerlinMama
I got the question for the login - although I have entered everything nevertheless came an error message:

Spoiler:

Failed to Login for URL: (https://archiveofourown.org/works/20...iew_adult=true) with username: (ILB_S)

I understood it so that the login itself has changed.
To input the login data in personal.ini helps only so you do not have to enter it manually each time. So it would not make a difference if FFF uses personal.ini or you enter the data yourself.
It´s the login process that changed - if I have not misunderstood.

[JimmXinu]

Originally Posted by ILB

It´s the login process that changed - if I have not misunderstood.

Correct. FanFicFare cannot currently login to AO3 due to changes on the site.

I am on the verge of just removing the login code for AO3 from FFF rather than trying to keep up with their ever more complex changes.

I believe that would only effect user-only 'restricted' stories on AO3, but I'm not sure how big a set that is, so I'm gathering opinions.

[ThatLibraryRat]

Originally Posted by JimmXinu

I believe that would only effect user-only 'restricted' stories on AO3, but I'm not sure how big a set that is, so I'm gathering opinions.

I don't know for sure how many I have (any idea how to go about making FFF help tagging them for a personalised column?) but I estimate having around a dozen of them in my 'in progress, may be updated' list. Since that category has around six hundred stories... really few?
Could you perhaps make a line in personal.ini to ignore the stories asking for the login and tagging them so they aren't drowned in the mass?
Any way, good luck at the drawing board.

Thank you infinitely for all your work!

[ILB]

Originally Posted by ThatLibraryRat

Could you perhaps make a line in personal.ini to ignore the stories asking for the login and tagging them so they aren't drowned in the mass?

That´s a good idea. If it´s not rational to adjust the login it would be helpful to know which stories are affected to manually get them direct from AO3.

[JimmXinu]

Originally Posted by ThatLibraryRat

Could you perhaps make a line in personal.ini to ignore the stories asking for the login and tagging them so they aren't drowned in the mass?

If you use the existing 'Update/Overwrite Error Column' setting under the Custom Columns tab, it will record the new error.

Thanks for giving me at least some rough figures.

[firefoxxy]

Hi Jimm,
I second ThatLibraryRat's numbers/ratio of locked stories on AO3.

Originally Posted by JimmXinu

it will record the new error.

I'm not using a column for that - will it still be shown as an error in the FFF protocol?

[JimmXinu]

Originally Posted by firefoxxy

Hi Jimm,
I second ThatLibraryRat's numbers/ratio of locked stories on AO3.

I'm not using a column for that - will it still be shown as an error in the FFF protocol?

I'm not sure what you mean by FFF protocol. The error appears in the log, if that's what you mean.

I'm going to post a test version with AO3 login removed shortly.

[JimmXinu]

New Test Version Posted

2017-09-16
- Add --json-meta CLI option for --meta-only output, tweak --meta-only output.
- Remove AO3 login rather that try to update with extra .json call for token.

Will give new error:
"AO3 doesn't allow download of (<storyurl>) without login and user/password login by automated tools such as FanFicFare is blocked by AO3 site."

[JimmXinu]

New Test Version Posted

2017-09-19
- Change some network warning and non-halting error logs to debug due to QQ login showing them in CLI.
- Fix webnovel.com escaping again (#231) -- thanks, cryzed

[ThatLibraryRat]

Originally Posted by JimmXinu

Will give new error:
"AO3 doesn't allow download of (<storyurl>) without login and user/password login by automated tools such as FanFicFare is blocked by AO3 site."

"AO3 doesn't allow download of (<storyurl>) without logging in and login by automated tools such as FanFicFare is blocked."
You have a few repetitions that make it confusing.

Also, it looks like my stories from the spacebattles forum aren't being updated.
Ex: https://forums.spacebattles.com/thre...-cross.379348/
FFF is telling me stubbornly that the story hasn't been updated since August the 1th.
I just caught the issue today.

[JimmXinu]

Originally Posted by ThatLibraryRat

"AO3 doesn't allow download of (<storyurl>) without logging in and login by automated tools such as FanFicFare is blocked."
You have a few repetitions that make it confusing.

What wording would you suggest?

Originally Posted by ThatLibraryRat

Also, it looks like my stories from the spacebattles forum aren't being updated.
Ex: https://forums.spacebattles.com/thre...-cross.379348/
FFF is telling me stubbornly that the story hasn't been updated since August the 1th.

I follow that story too and it updated fine for me today. Do you have at least v2.17.1 of FFF?

Also, can you be more specific about how you are trying to update it and the response you get?

[MerlinMama]

Originally Posted by JimmXinu

What wording would you suggest?

I also had to read it through a few times, because I knew you would have written it that way for a reason. Once I 'got' it, it made sense. The 'and' kept tripping me up. I think just the minuscule changes below would help, but that is my opinion only.

"AO3 doesn't allow download of (<storyurl>) without login. User/password login by automated tools such as FanFicFare is blocked by AO3 site."

"AO3 doesn't allow download of (<storyurl>) without login but user/password login by automated tools such as FanFicFare is blocked by AO3 site."

Perhaps @ThatLibraryRat could weigh in if that clears things up?

[MrKonan]

Hi, I'm having issues with FFF's "Get Story URLs from web Page (individual book)" on SOL (any authors) but example: http://storiesonline.net/a/Ka_Hmnd I only get about 10 item results from 7 pages of posted stories.
Here are the debug log and .INIs

Thanks

[JimmXinu]

Multi-reply

Originally Posted by MerlinMama

I also had to read it through a few times, because I knew you would have written it that way for a reason. Once I 'got' it, it made sense. The 'and' kept tripping me up. I think just the minuscule changes below would help, but that is my opinion only.
...

How about:

AO3 doesn't allow download of (%s) by tools such as FanFicFare. Automated user/password login is blocked by AO3.

Originally Posted by MrKonan

Hi, I'm having issues with FFF's "Get Story URLs from web Page (individual book)" on SOL (any authors) but example: http://storiesonline.net/a/Ka_Hmnd I only get about 10 item results from 7 pages of posted stories.

Yep, that's the way it works. "Get Story URLs from web Page" work on individual web pages. Since those are 7 pages, you have to fetch them each separately.

The "Get Story URLs from web Page" code is shared across all sites which has the disadvantage that site specifics like that aren't supported. But it does have the advantage that you can point it at any web page that has story URLs, not just pages on supported sites.