[GUI Plugin] FanFictionDownLoader - Page 236

JimmXinu · 12-02-2014, 07:56 PM

Quote:

Originally Posted by arthurh3535

I'm not actually getting Literotica.com to actually download any more (in Calibre).

I spot checked a recent story there and it worked for me.

Please post story URL(s) for a story (or a few) that you're having problems with.

It would also be helpful if you ran calibre in debug mode (ctrl-shft-r) and post the debug log from trying to download a story that failed.

Tanjamuse · 12-03-2014, 05:29 AM

How do I change the little t in Angel: the Series to a capital T? I've tried replacing metadata, but it doesnt seem to be working

Quote:

category=>Angel$=>Angel: The Series
category=>Angel The Series=>Angel: The Series
category=>AtS=>Angel: The Series
category=>Angel - Fandom=>Angel: The Series

It still turns out little t's.

JimmXinu · 12-03-2014, 09:49 AM

Quote:

Originally Posted by Tanjamuse

How do I change the little t in Angel: the Series to a capital T? I've tried replacing metadata, but it doesnt seem to be working

It still turns out little t's.

Please provide example story URLs for the cases you're trying to change.

Tanjamuse · 12-03-2014, 09:50 AM

It's anyone of them, but here you go:

http://archiveofourown.org/works/2699654

JimmXinu · 12-03-2014, 09:55 AM

Quote:

Originally Posted by Tanjamuse

It's anyone of them, but here you go:

http://archiveofourown.org/works/2699654

None of the replacement lines you listed before match the category for that story. There aren't any special characters to be escaped this time, just copy it and change it:

Code:

 Angel: the Series=>Angel: The Series

JimmXinu · 12-03-2014, 09:57 AM

Quote:

Originally Posted by JimmXinu

None of the replacement lines you listed before match the category for that story. There aren't any special characters to be escaped this time, just copy it and change it:

Code:

 Angel: the Series=>Angel: The Series

Just remembered:

Note, however, that if you're putting that into a calibre tags column, calibre remembers the case used the first time the same string (case-insensitive) was added and will show that even if FFDL gives it in a different case. Use calibre's tag browser to rename the tag in that case.

Tanjamuse · 12-03-2014, 10:01 AM

Do I have to change it ever time or just the first time?

JimmXinu · 12-03-2014, 10:20 AM

Quote:

Originally Posted by Tanjamuse

Do I have to change it ever time or just the first time?

Probably just the first time. Try it and see.

JimmXinu · 12-04-2014, 03:19 PM

Attached is a new, experimental, test version that uses newer HTML parser libraries (BeautifulSoup4 and html5lib) for fanfiction.net, archiveofourown.org, ficwad.com and tthfanfic.org; and for some internal parts. This is a change that cryzed has been working and lobbying for.

The newer parser is (in theory) more forgiving of poor HTML code, better equipped to deal with Unicode, and easier to work with for the developers.

I've been using it for a couple weeks and I've fixed the problems I've found, but it won't surprise me when more crop up.

Only try this if you're willing to deal with potential issues. That said, I would appreciate feedback from testers. Thanks.

JOJO1 · 12-04-2014, 03:58 PM

Hi Jim,
here is Jojo1 from Germany.
The site FanFiktion.de has changed a little bit again. So the FF-Downloader-bs4 can't catch the stories.
Please, can you help me again?

Thanks for your help
Jojo1

JimmXinu · 12-04-2014, 08:17 PM

...now with fixes for fanfiktion.de. Other details remain the same as two posts back.

arthurh3535 · 12-05-2014, 12:57 AM

Quote:

Originally Posted by JimmXinu

I spot checked a recent story there and it worked for me.

Please post story URL(s) for a story (or a few) that you're having problems with.

It would also be helpful if you ran calibre in debug mode (ctrl-shft-r) and post the debug log from trying to download a story that failed.

I thought, sure!

Then I try the very first random new story and it works after it failed on six or seven attempts. Then I tried a second and bing, it just worked again. Then I tracked down one that had failed and it just worked this time.

I have no idea.

fathertyme · 12-05-2014, 09:58 PM

Not a major issue, but something I figured I'd mention just in case it hasn't come up before. I've noticed it a couple times before, but I actually have a link for you this time :P

On Storiesonline, ffdl does not pick up the second author if more than one author is listed.

example:

http://storiesonline.net/s/10724/iss...-fiction-story

don't know if this is fixable or not.. Would be nice to for archival purposes, but more of a gripe than a problem :P

JimmXinu · 12-05-2014, 11:41 PM

Now with previous changes plus multiple authors for storiesonline.net as per fathertyme's post. 'Universe' is still only searched for the first author.

Note that the storiesonline.net adapter hasn't been updated to BS4. It's rather more complicated than typical and I don't read that site, so I don't have a stable of test stories to check it against.

fathertyme · 12-06-2014, 02:26 AM

At a quick glance, that looks like it worked. It picked up the secondary (original) author. The author links are set correctly. The encoding seems to match what was on the website, and I don't see any glaring flaws in the epub that was produced.

If there are specific things you would like me to check on, let me know, and I'll see what I can do in the time permitting (around work schedules, decorating, etc...)

12-04-2014, 03:19 PM	#3534
JimmXinu Plugin Developer Posts: 7,011 Karma: 4604635 Join Date: Dec 2011 Location: Midwest USA Device: Kobo Clara Colour running KOReader	Alpha Version Attached is a new, experimental, test version that uses newer HTML parser libraries (BeautifulSoup4 and html5lib) for fanfiction.net, archiveofourown.org, ficwad.com and tthfanfic.org; and for some internal parts. This is a change that cryzed has been working and lobbying for. The newer parser is (in theory) more forgiving of poor HTML code, better equipped to deal with Unicode, and easier to work with for the developers. I've been using it for a couple weeks and I've fixed the problems I've found, but it won't surprise me when more crop up. Only try this if you're willing to deal with potential issues. That said, I would appreciate feedback from testers. Thanks. Last edited by JimmXinu; 12-04-2014 at 08:17 PM. Reason: Remove obsolete test versions - replaced by newer test or released version.

12-04-2014, 08:17 PM	#3536
JimmXinu Plugin Developer Posts: 7,011 Karma: 4604635 Join Date: Dec 2011 Location: Midwest USA Device: Kobo Clara Colour running KOReader	BS4 Alpha Version ...now with fixes for fanfiktion.de. Other details remain the same as two posts back. Last edited by JimmXinu; 12-05-2014 at 11:42 PM. Reason: Remove obsolete test versions - replaced by newer test or released version.

12-05-2014, 11:41 PM	#3539
JimmXinu Plugin Developer Posts: 7,011 Karma: 4604635 Join Date: Dec 2011 Location: Midwest USA Device: Kobo Clara Colour running KOReader	BS4 Alpha Version Now with previous changes plus multiple authors for storiesonline.net as per fathertyme's post. 'Universe' is still only searched for the first author. Note that the storiesonline.net adapter hasn't been updated to BS4. It's rather more complicated than typical and I don't read that site, so I don't have a stable of test stories to check it against. Last edited by JimmXinu; 12-09-2014 at 11:27 AM. Reason: Remove obsolete test versions - replaced by newer test or released version.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
[GUI Plugin] Count Pages	kiwidude	Plugins	1846	08-02-2025 10:44 PM
[GUI Plugin] Resize Cover	kiwidude	Plugins	100	07-10-2025 08:50 AM
[GUI Plugin] Find Duplicates	kiwidude	Plugins	1124	04-18-2025 09:19 AM
[GUI Plugin] Open With	kiwidude	Plugins	404	02-21-2025 05:42 AM
[GUI Plugin] Plugin Updater Deprecated	kiwidude	Plugins	159	06-19-2011 12:27 PM

12-03-2014, 09:50 AM	#3529
Tanjamuse Wizard Posts: 1,327 Karma: 5306 Join Date: Jan 2014 Device: none	It's anyone of them, but here you go: http://archiveofourown.org/works/2699654

12-03-2014, 10:01 AM	#3532
Tanjamuse Wizard Posts: 1,327 Karma: 5306 Join Date: Jan 2014 Device: none	Do I have to change it ever time or just the first time?

12-04-2014, 03:58 PM	#3535
JOJO1 Member Posts: 10 Karma: 10 Join Date: Jul 2013 Device: kindle fire and other android	Hi Jim, here is Jojo1 from Germany. The site FanFiktion.de has changed a little bit again. So the FF-Downloader-bs4 can't catch the stories. Please, can you help me again? Thanks for your help Jojo1

12-05-2014, 09:58 PM	#3538
fathertyme Enthusiast Posts: 44 Karma: 1000 Join Date: Jul 2014 Location: Planet Earth Device: Samsung S2	Not a major issue, but something I figured I'd mention just in case it hasn't come up before. I've noticed it a couple times before, but I actually have a link for you this time :P On Storiesonline, ffdl does not pick up the second author if more than one author is listed. example: http://storiesonline.net/s/10724/iss...-fiction-story don't know if this is fixable or not.. Would be nice to for archival purposes, but more of a gripe than a problem :P

12-06-2014, 02:26 AM	#3540
fathertyme Enthusiast Posts: 44 Karma: 1000 Join Date: Jul 2014 Location: Planet Earth Device: Samsung S2	At a quick glance, that looks like it worked. It picked up the secondary (original) author. The author links are set correctly. The encoding seems to match what was on the website, and I don't see any glaring flaws in the epub that was produced. If there are specific things you would like me to check on, let me know, and I'll see what I can do in the time permitting (around work schedules, decorating, etc...)