[GUI Plugin] FanFictionDownLoader

[JimmXinu]

Originally Posted by julianabr

I got some different errors when trying to update to 1.8.9 on my Mac.
....

It installs fine for me on Windows. I don't have a Mac to test, but the error messages suggest that the plugin zip file didn't download correctly.

I suggest trying to install it again, maybe by hand as per the instructions under How do I install a plugin manually?

[julianabr]

I did try installing manually, both the new version and my last working version. I also tried just copying the file directly into the Library folder where calibre plugins live. It copied, but did not activate.

I have a feeling it is the Mavericks update to OSX behaving badly about permissions to install things. Even though I'm signed in as an admin, Mac has always asked for the password again before installing things. It seems like mavericks is taking permissions to a stricter level, however usually it will offer the username/password if it needs permissions during an install. Now I'm kicking myself because I removed the old version and now I'm without anything.

If you want me to test anything on my macs, I would be happy to help. Your plugin is great and I'd love to contribute.

Do you know of any other tools ffnet hasn't shut down yet?

[JimmXinu]

Originally Posted by julianabr

I did try installing manually, both the new version and my last working version. I also tried just copying the file directly into the Library folder where calibre plugins live. It copied, but did not activate.

...

Do you know of any other tools ffnet hasn't shut down yet?

I would check the permissions on the plugin zip file and change them to be readable if they're not:

OSError: [Errno 13] Permission denied: '/Users/kindle/Library/Preferences/calibre/plugins/FanFictionDownLoader.zip'

I'd also check the contents of that zip file.

As for other tools, FFDL also has a CLI version (requires Python) and a web service.

[JimmXinu]

I don't know if it's always behaved this way, or if it's changed along the way, but when if I wait and let books be automatically converted to azw3 when Reading List is syncing my Kindle, it sends the metadata after every book now instead of just once for all of them.

So I've added an auto-convert feature to FFDL that, when checked, will automatically call calibre's Convert on update/download. The output format will be the one select in calibre's Preferences->Behavior.

Give it a try, see what you think.

UPDATE Feb 7, 2014 - Remove obsolete beta versions

[redscarlett]

Hi

Got a bit of a problem with anthology updates. It's cropped up a few times with a few different fics (I can't remember which unfortunately) in the past few months, but I eventually just re-downloaded the fic. Now, though, I just want to see if I can fix it!

The series that I'm struggling with is at url:http://archiveofourown.org/series/46314 and it downloaded fine into an anthology only a couple of weeks ago. I've updated it since the initial download too, and that had no problems.

I've got the latest versions of both calibre and FFDL, and the debug said:

calibre 1.21 isfrozen: True is64bit: False
Windows-7-6.1.7601-SP1 Windows ('32bit', 'WindowsPE')
32bit process running on 64bit windows
('Windows', '7', '6.1.7601')
Python 2.7.5
Windows: ('7', '6.1.7601', 'SP1', 'Multiprocessor Free')
Starting up...
FFDLEBUG:calibre_plugins.fanfictiondownloader_pl ugin.ffdl_plugin(155):Plugin F
anFictionDownLoader macmenuhack file_path:C:\Users\Sarah\AppData\Roaming\calibre
\plugins\fanfictiondownloader_macmenuhack.txt
macmenuhack file_path:C:\Users\Sarah\AppData\Roaming\calibre\p lugins\fanfictiond
ownloader_macmenuhack.txt
Started up in 5.69 seconds with 3172 books
FFDLEBUG:calibre_plugins.fanfictiondownloader_pl ugin.ffdl_plugin(564):tdir:
C:\Users\Sarah\AppData\Local\Temp\calibre_sueomw\f fdl_anthology_cmxws8

Can anyone help please?

[riothamus]

Originally Posted by JimmXinu

So I've added an auto-convert feature to FFDL

Give it a try, see what you think.

The auto-convert call seems to work fine. I turned it back off as I'm not sending to kindle right now. I haven't tested the metadata issue yet.

[JimmXinu]

Originally Posted by redscarlett

Got a bit of a problem with anthology updates. It's cropped up a few times with a few different fics (I can't remember which unfortunately) in the past few months, but I eventually just re-downloaded the fic. Now, though, I just want to see if I can fix it!

And what exactly is the problem that you've seen?

Originally Posted by redscarlett

The series that I'm struggling with is at url:http://archiveofourown.org/series/46314 and it downloaded fine into an anthology only a couple of weeks ago. I've updated it since the initial download too, and that had no problems.

I've got the latest versions of both calibre and FFDL, and the debug said:
...

If it downloaded fine, and it updated fine, what is it you're struggling with? It downloaded fine for me.

There are no errors in the debug output you posted. Just normal informational debug info.

[redscarlett]

Originally Posted by JimmXinu

And what exactly is the problem that you've seen?



If it downloaded fine, and it updated fine, what is it you're struggling with? It downloaded fine for me.

There are no errors in the debug output you posted. Just normal informational debug info.

Sorry, I thought I'd been clearer, but with hindsight, I wasn't. When I click for an update, an error springs up saying that it cannot update the anthology, because it isn't an FFDL anthology or there is no FFDL urls contained within.

I'm awful with computers, so the debug just goes over my head, but I just wanted to see if anything was given away by it as to why the anthology won't update.

[JimmXinu]

Originally Posted by redscarlett

Sorry, I thought I'd been clearer, but with hindsight, I wasn't. When I click for an update, an error springs up saying that it cannot update the anthology, because it isn't an FFDL anthology or there is no FFDL urls contained within.

Have you been converting, polishing, editing, tweaking, etc the anthology epubs? If you have, it probably disturbed the structure and metadata FFDL relies on to recognize an anthology.

If you have one of the epubs that exhibit the problem that I could look at, that would help.

[redscarlett]

Originally Posted by JimmXinu

Have you been converting, polishing, editing, tweaking, etc the anthology epubs? If you have, it probably disturbed the structure and metadata FFDL relies on to recognize an anthology.

If you have one of the epubs that exhibit the problem that I could look at, that would help.

I haven't touched it since FFDL downloaded it and merged it into an anthology, except 'generate cover' added. I haven't edited or polished, converted, etc it at all.

The only one I know of that is behaving like this at the moment is from this url:http://archiveofourown.org/series/46314 but if you prefer I'll pm you a copy of the epub I have.

[JimmXinu]

Originally Posted by redscarlett

I'll email it you now.

The file names inside that epub have all been changed--the same way calibre's epub->epub convert changes them. file0001.xhtml becomes something like file0001_u12.xhtml.

I might have been able to adjust for the file renames, but the convert also throws away metadata files that FFDL (EpubMerge called by FFDL technically) needs to 'unmerge' the anthology epub before updating each book inside it.

Maybe you ran convert to embed the cover image, not realizing that it would change more than that--that used to be the recommended way to embed covers. Now, however, you can embed the cover image using either the Polish tool or the Modify Epub plugin. They don't break anthology update.

If you have an ORIGINAL_EPUB format in that book, you could restore it and then anthology update will probably work.

[redscarlett]

Originally Posted by JimmXinu

The file names inside that epub have all been changed--the same way calibre's epub->epub convert changes them. file0001.xhtml becomes something like file0001_u12.xhtml.

I might have been able to adjust for the file renames, but the convert also throws away metadata files that FFDL (EpubMerge called by FFDL technically) needs to 'unmerge' the anthology epub before updating each book inside it.

Maybe you ran convert to embed the cover image, not realizing that it would change more than that--that used to be the recommended way to embed covers. Now, however, you can embed the cover image using either the Polish tool or the Modify Epub plugin. They don't break anthology update.

If you have an ORIGINAL_EPUB format in that book, you could restore it and then anthology update will probably work.

Yeah I do have the original epub - I'll do that, thank you!

edit: Ooops - it was the original epub I had for another fic :S never mind, I'll just re-download it. Thanks for the help!

[TrulyInnovative]

I'm having trouble with a particular story on Storiesonline.net: http://storiesonline.net/s/69562

Portions of the text including the cast of characters and the protagonist's thoughts (the very beginning of chapter 1, for example) do not show up on the epub.

[JimmXinu]

Originally Posted by TrulyInnovative

I'm having trouble with a particular story on Storiesonline.net: http://storiesonline.net/s/69562

Portions of the text including the cast of characters and the protagonist's thoughts (the very beginning of chapter 1, for example) do not show up on the epub.

davidfor wrote the adapter for that site, so I'd like to hear from him before doing a permanent solution.

I have attached a version that includes that content, but it might include other stuff that isn't wanted, too.

UPDATE Feb 7, 2014 - Remove obsolete beta versions

[davidfor]

Looking at the code, I can't remember exactly why I did that. I think I was removing something in the header or footer, but I'm not sure what now. Removing is correct. But, I noticed something else in my testing.

To get rid if the headings at top if the story, I was just stripping the heading tags. But, some use subheadings through the story, and those were also being removed. I'll fix this and post an update.