[GUI Plugin] FanFictionDownLoader

[lisahboone]

Calibre 1.39. No problem accessing through browser. I downloaded the other stories from Voracity2 ok...it is just the ones that are registered user/adult only rated ones as indicated. I do have my username/password for the site in personal.ini along with the adult tag:true...would that be messing it up?

[cryzed]

You have this exact line "is_adult:true" in your config? No, then it should be okay. Do what Jimm suggested in his last post and restart Calibre in debug mode, try to download the stories, let it fail and then attach the log file that will open after closing Calibe here to one of your posts.

[lisahboone]

debug log below - can you tell what the problem is

calibre Debug log
calibre 1.39 isfrozen: True is64bit: False
Windows-Vista-6.0.6001-SP1 Windows ('32bit', 'WindowsPE')
32bit process running on 64bit windows
('Windows', 'Vista', '6.0.6001')
Python 2.7.5
Windows: ('Vista', '6.0.6001', 'SP1', 'Multiprocessor Free')
Starting up...
FFDLEBUG:calibre_plugins.fanfictiondownloader_pl ugin.ffdl_plugin(156):Plugin FanFictionDownLoader

macmenuhack

file_path:C:\Users\owner\AppData\Roaming\calibre\p lugins\fanfictiondownloader_macmenuhack.txt
macmenuhack

file_path:C:\Users\owner\AppData\Roaming\calibre\p lugins\fanfictiondownloader_macmenuhack.txt
Started up in 42.76 seconds with 44501 books
FFDLEBUG:calibre_plugins.fanfictiondownloader_pl ugin.ffdl_plugin(726):FanFictionDownLoader v1.8.22
FFDLEBUG:calibre_plugins.fanfictiondownloader_pl ugin.ffdl_plugin(761):url:http://voracity2.e-

fic.com/viewstory.php?sid=59
FFDL:ERROR:calibre_plugins.fanfictiondownloader_pl ugin.dialogs(600):Exception: {u'comment':

u"'NoneType' object has no attribute '__getitem__'", u'begin': None, u'good': False, u'end': None,

u'author': [u'Unknown'], u'url': 'http://voracity2.e-fic.com/viewstory.php?sid=59', u'listorder': 0,

u'author_sort': [u'Unknown'], u'site': 'voracity2.e-fic.com', u'comments': u'', u'calibre_id': None, u'added':

False, u'title': u'Unknown'}:'NoneType' object has no attribute '__getitem__'
Traceback (most recent call last):
File "calibre_plugins.fanfictiondownloader_plugin.dialo gs", line 590, in do_loop
File "calibre_plugins.fanfictiondownloader_plugin.ffdl_ plugin", line 839, in prep_download_loop
File "calibre_plugins.fanfictiondownloader_plugin.fanfi cdownloader.adapters.base_adapter", line 258, in

getStoryMetadataOnly
File "calibre_plugins.fanfictiondownloader_plugin.fanfi cdownloader.adapters.adapter_voracity2eficcom",

line 108, in extractChapterUrlsAndMetadata
TypeError: 'NoneType' object has no attribute '__getitem__'
FFDLEBUG:calibre_plugins.fanfictiondownloader_pl ugin.ffdl_plugin(761):url:http://voracity2.e-

fic.com/viewstory.php?sid=56
FFDL:ERROR:calibre_plugins.fanfictiondownloader_pl ugin.dialogs(600):Exception: {u'comment':

u"'NoneType' object has no attribute '__getitem__'", u'begin': None, u'good': False, u'end': None,

u'author': [u'Unknown'], u'url': 'http://voracity2.e-fic.com/viewstory.php?sid=56', u'listorder': 1,

u'author_sort': [u'Unknown'], u'site': 'voracity2.e-fic.com', u'comments': u'', u'calibre_id': None, u'added':

False, u'title': u'Unknown'}:'NoneType' object has no attribute '__getitem__'
Traceback (most recent call last):
File "calibre_plugins.fanfictiondownloader_plugin.dialo gs", line 590, in do_loop
File "calibre_plugins.fanfictiondownloader_plugin.ffdl_ plugin", line 839, in prep_download_loop
File "calibre_plugins.fanfictiondownloader_plugin.fanfi cdownloader.adapters.base_adapter", line 258, in

getStoryMetadataOnly
File "calibre_plugins.fanfictiondownloader_plugin.fanfi cdownloader.adapters.adapter_voracity2eficcom",

line 108, in extractChapterUrlsAndMetadata
TypeError: 'NoneType' object has no attribute '__getitem__'
FFDLEBUG:calibre_plugins.fanfictiondownloader_pl ugin.ffdl_plugin(761):url:http://voracity2.e-

fic.com/viewstory.php?sid=55
FFDL:ERROR:calibre_plugins.fanfictiondownloader_pl ugin.dialogs(600):Exception: {u'comment':

u"'NoneType' object has no attribute '__getitem__'", u'begin': None, u'good': False, u'end': None,

u'author': [u'Unknown'], u'url': 'http://voracity2.e-fic.com/viewstory.php?sid=55', u'listorder': 2,

u'author_sort': [u'Unknown'], u'site': 'voracity2.e-fic.com', u'comments': u'', u'calibre_id': None, u'added':

False, u'title': u'Unknown'}:'NoneType' object has no attribute '__getitem__'
Traceback (most recent call last):
File "calibre_plugins.fanfictiondownloader_plugin.dialo gs", line 590, in do_loop
File "calibre_plugins.fanfictiondownloader_plugin.ffdl_ plugin", line 839, in prep_download_loop
File "calibre_plugins.fanfictiondownloader_plugin.fanfi cdownloader.adapters.base_adapter", line 258, in

getStoryMetadataOnly
File "calibre_plugins.fanfictiondownloader_plugin.fanfi cdownloader.adapters.adapter_voracity2eficcom",

line 108, in extractChapterUrlsAndMetadata
TypeError: 'NoneType' object has no attribute '__getitem__'
FFDLEBUG:calibre_plugins.fanfictiondownloader_pl ugin.ffdl_plugin(761):url:http://voracity2.e-

fic.com/viewstory.php?sid=52
FFDL:ERROR:calibre_plugins.fanfictiondownloader_pl ugin.dialogs(600):Exception: {u'comment':

u"'NoneType' object has no attribute '__getitem__'", u'begin': None, u'good': False, u'end': None,

u'author': [u'Unknown'], u'url': 'http://voracity2.e-fic.com/viewstory.php?sid=52', u'listorder': 3,

u'author_sort': [u'Unknown'], u'site': 'voracity2.e-fic.com', u'comments': u'', u'calibre_id': None, u'added':

False, u'title': u'Unknown'}:'NoneType' object has no attribute '__getitem__'
Traceback (most recent call last):
File "calibre_plugins.fanfictiondownloader_plugin.dialo gs", line 590, in do_loop
File "calibre_plugins.fanfictiondownloader_plugin.ffdl_ plugin", line 839, in prep_download_loop
File "calibre_plugins.fanfictiondownloader_plugin.fanfi cdownloader.adapters.base_adapter", line 258, in

getStoryMetadataOnly
File "calibre_plugins.fanfictiondownloader_plugin.fanfi cdownloader.adapters.adapter_voracity2eficcom",

line 108, in extractChapterUrlsAndMetadata
TypeError: 'NoneType' object has no attribute '__getitem__'
FFDLEBUG:calibre_plugins.fanfictiondownloader_pl ugin.ffdl_plugin(761):url:http://voracity2.e-

fic.com/viewstory.php?sid=48
FFDL:ERROR:calibre_plugins.fanfictiondownloader_pl ugin.dialogs(600):Exception: {u'comment':

u"'NoneType' object has no attribute '__getitem__'", u'begin': None, u'good': False, u'end': None,

u'author': [u'Unknown'], u'url': 'http://voracity2.e-fic.com/viewstory.php?sid=48', u'listorder': 4,

u'author_sort': [u'Unknown'], u'site': 'voracity2.e-fic.com', u'comments': u'', u'calibre_id': None, u'added':

False, u'title': u'Unknown'}:'NoneType' object has no attribute '__getitem__'
Traceback (most recent call last):
File "calibre_plugins.fanfictiondownloader_plugin.dialo gs", line 590, in do_loop
File "calibre_plugins.fanfictiondownloader_plugin.ffdl_ plugin", line 839, in prep_download_loop
File "calibre_plugins.fanfictiondownloader_plugin.fanfi cdownloader.adapters.base_adapter", line 258, in

getStoryMetadataOnly
File "calibre_plugins.fanfictiondownloader_plugin.fanfi cdownloader.adapters.adapter_voracity2eficcom",

line 108, in extractChapterUrlsAndMetadata
TypeError: 'NoneType' object has no attribute '__getitem__'
FFDLEBUG:calibre_plugins.fanfictiondownloader_pl ugin.ffdl_plugin(761):url:http://voracity2.e-

fic.com/viewstory.php?sid=50
FFDL:ERROR:calibre_plugins.fanfictiondownloader_pl ugin.dialogs(600):Exception: {u'comment':

u"'NoneType' object has no attribute '__getitem__'", u'begin': None, u'good': False, u'end': None,

u'author': [u'Unknown'], u'url': 'http://voracity2.e-fic.com/viewstory.php?sid=50', u'listorder': 5,

u'author_sort': [u'Unknown'], u'site': 'voracity2.e-fic.com', u'comments': u'', u'calibre_id': None, u'added':

False, u'title': u'Unknown'}:'NoneType' object has no attribute '__getitem__'
Traceback (most recent call last):
File "calibre_plugins.fanfictiondownloader_plugin.dialo gs", line 590, in do_loop
File "calibre_plugins.fanfictiondownloader_plugin.ffdl_ plugin", line 839, in prep_download_loop
File "calibre_plugins.fanfictiondownloader_plugin.fanfi cdownloader.adapters.base_adapter", line 258, in

getStoryMetadataOnly
File "calibre_plugins.fanfictiondownloader_plugin.fanfi cdownloader.adapters.adapter_voracity2eficcom",

line 108, in extractChapterUrlsAndMetadata
TypeError: 'NoneType' object has no attribute '__getitem__'
FFDLEBUG:calibre_plugins.fanfictiondownloader_pl ugin.ffdl_plugin(761):url:http://voracity2.e-

fic.com/viewstory.php?sid=46
FFDL:ERROR:calibre_plugins.fanfictiondownloader_pl ugin.dialogs(600):Exception: {u'comment':

u"'NoneType' object has no attribute '__getitem__'", u'begin': None, u'good': False, u'end': None,

u'author': [u'Unknown'], u'url': 'http://voracity2.e-fic.com/viewstory.php?sid=46', u'listorder': 6,

u'author_sort': [u'Unknown'], u'site': 'voracity2.e-fic.com', u'comments': u'', u'calibre_id': None, u'added':

False, u'title': u'Unknown'}:'NoneType' object has no attribute '__getitem__'
Traceback (most recent call last):
File "calibre_plugins.fanfictiondownloader_plugin.dialo gs", line 590, in do_loop
File "calibre_plugins.fanfictiondownloader_plugin.ffdl_ plugin", line 839, in prep_download_loop
File "calibre_plugins.fanfictiondownloader_plugin.fanfi cdownloader.adapters.base_adapter", line 258, in

getStoryMetadataOnly
File "calibre_plugins.fanfictiondownloader_plugin.fanfi cdownloader.adapters.adapter_voracity2eficcom",

line 108, in extractChapterUrlsAndMetadata
TypeError: 'NoneType' object has no attribute '__getitem__'
FFDLEBUG:calibre_plugins.fanfictiondownloader_pl ugin.ffdl_plugin(761):url:http://voracity2.e-

fic.com/viewstory.php?sid=44
FFDL:ERROR:calibre_plugins.fanfictiondownloader_pl ugin.dialogs(600):Exception: {u'comment':

u"'NoneType' object has no attribute '__getitem__'", u'begin': None, u'good': False, u'end': None,

u'author': [u'Unknown'], u'url': 'http://voracity2.e-fic.com/viewstory.php?sid=44', u'listorder': 7,

u'author_sort': [u'Unknown'], u'site': 'voracity2.e-fic.com', u'comments': u'', u'calibre_id': None, u'added':

False, u'title': u'Unknown'}:'NoneType' object has no attribute '__getitem__'
Traceback (most recent call last):
File "calibre_plugins.fanfictiondownloader_plugin.dialo gs", line 590, in do_loop
File "calibre_plugins.fanfictiondownloader_plugin.ffdl_ plugin", line 839, in prep_download_loop
File "calibre_plugins.fanfictiondownloader_plugin.fanfi cdownloader.adapters.base_adapter", line 258, in

getStoryMetadataOnly
File "calibre_plugins.fanfictiondownloader_plugin.fanfi cdownloader.adapters.adapter_voracity2eficcom",

line 108, in extractChapterUrlsAndMetadata
TypeError: 'NoneType' object has no attribute '__getitem__'

[cryzed]

That's why I said attach it as a log file, i.e. the text file. Don't just paste the whole thing directly into your post. If you could maybe edit your last post and paste it here and link us? And do me a favor please, go to this page (after you are logged in), right-click->view page source, copy everything and paste it on Pastebin too and link us.

EDIT: Alternatively, and this is a long shot, just try registering a new account and using the new account data in your configuration file.

[lisahboone]

http://pastebin.com/Rp1S1Lex [source file from story]
http://pastebin.com/9mBsvWqP [debug log]

[cryzed]

Well this is... you aren't Voracity by any chance? For some strange reason the author information is missing from your page. If you are in fact the author of these stories it should be fixed by creating a new normal user account and using that username and password. If this isn't the case at all please report back.

[lisahboone]

no i am not the author....

[cryzed]

Did you change the default skin? Please change the skin back to "Simple Elegance" under preferences and manually at the bottom of the page and then logout. Afterwards try again.

[lisahboone]

i don't know why but i did make a new user account and new password and the download worked after I changed my ini....

thanks for the suggestion and trying everything.

Thanks

[cryzed]

It was because you changed your theme. You need to have it set to the default "Simple Elegance" theme. You are welcome.

@Jimm
I could theoretically implement a feature that the adapter automatically changes the skin, but I don't really think it's necessary, the bug and the site are a bit too obscure for that ever to be needed. I'll leave a comment in the source and if it ever happens again I'll add it. (Also another reason why I just keep loving eFiction more and more)

Is there some method that I can override that gets called after the adapter has finished parsing and fetching all chapters completely?

EDIT: I just went ahead and implemented the whole skin thingy. I overrode the getStory method by the way.

[JimmXinu]

I've just told people to set to skin X in past. Does changing the skin effect what they see in the browser to?

[cryzed]

Yes, unfortunately the HTML markup changes with the skin, and I restore the original skin after downloading the stories.

[JimmXinu]

Originally Posted by cryzed

Yes, unfortunately the HTML markup changes with the skin, and I restore the original skin after downloading the stories.

FFDL can run multiple BG jobs at once downloading different stories. Won't changing the skin back and forth risk a race condition if one story finishes and changes the skin back?

[cryzed]

Yes, I forgot about that. So uh... I can roll back the change-skin functionality changes and maybe just throw an error when the required skin isn't set.

[JimmXinu]

I believe that one or two of the existing adapters have some code to handle more than one skin to a limited extent. But in general as I recall, I've just told users to switch back to the default skin. So an error would be better than usual.