[GUI Plugin] FanFicFare

[JimmXinu]

Originally Posted by tricklem

Just noticed that I am getting this error when updating my stories from ffpad.

sequence item 0: expected string, int found

And this one when I go to download a new story to my library. Is anyone else having this problem?
...
https://fictionpad.com/author/tufano79/stories/11113

Works for me. Try running calibre in debug mode and post the debug log.

It's also possible that the current test version may already fix your problem, if you haven't tried that.

[tricklem]

So Here is the log:

Spoiler:

calibre Debug log
calibre 2.30 isfrozen: True is64bit: False
Windows-7-6.1.7601-SP1 Windows ('32bit', 'WindowsPE')
32bit process running on 64bit windows
('Windows', '7', '6.1.7601')
Python 2.7.9
Windows: ('7', '6.1.7601', 'SP1', 'Multiprocessor Free')
Successfully initialized third party plugins: EpubMerge && Generate Cover && Find Duplicates && FanFicFare
Starting up...
macmenuhack file_path:C:\Users\Miller\AppData\Roaming\calibre\ plugins\fanfictiondownloader_macmenuhack.txt
FFFEBUG:calibre_plugins.fanficfare_plugin.fff_pl ugin(184):Plugin FanFicFare macmenuhack file_path:C:\Users\Miller\AppData\Roaming\calibre\ plugins\fanficfare_macmenuhack.txt
Started up in 16.81 seconds with 479 books
FFFEBUG:calibre_plugins.fanficfare_plugin.fff_pl ugin(828):FanFicFare v2.2.6
FFFEBUG:calibre_plugins.fanficfare_plugin.fff_pl ugin(864):url:https://fictionpad.com/author/RobzBeanie/stories/22461
FFFEBUG:calibre_plugins.fanficfare_plugin.fanfic fare.adapters.adapter_fictionpadcom(112):URL: https://fictionpad.com/author/RobzBeanie/stories/22461
FFFEBUG:calibre_plugins.fanficfare_plugin.fanfic fare.adapters.base_adapter(294):################## ###################
pagecache MISS: https://fictionpad.com/author/RobzBeanie/stories/22461
FFFEBUG:calibre_plugins.fanficfare_plugin.fanfic fare.adapters.adapter_fictionpadcom(93):Will now login to URL (http://fictionpad.com/signin) as (tricklem@hotmail.com)
FFFEBUG:calibre_plugins.fanficfare_plugin.fanfic fare.adapters.base_adapter(294):################## ###################
pagecache MISS: http://fictionpad.com/signin
FFFEBUG:calibre_plugins.fanficfare_plugin.fanfic fare.adapters.base_adapter(262):################## ###################
pagecache MISS: http://fictionpad.com/signin?authent...34&remember=1?
FFFEBUG:calibre_plugins.fanficfare_plugin.fanfic fare.adapters.base_adapter(294):################## ###################
pagecache MISS: https://fictionpad.com/author/RobzBeanie/stories/22461
FFFEBUG:calibre_plugins.fanficfare_plugin.fanfic fare.adapters.adapter_fictionpadcom(136):story:{u' followed_type': u'0', u'is_public_following': False, u'story_collections_count': 21, u'id': 22461, u'is_liked_by_current_user': False, u'first_published_at': u'2015-02-13T06:24:22Z', u'published_at': u'2015-06-06T03:47:03Z', u'is_authored_by_current_user': False, u'is_private_following': False, u'user_id': 2697, u'is_followed_by_current_user': False, u'likes': 13.0, u'draft_version_id': None, u'note_ids': [20448, 20361, 20168, 19994, 19806, 19665, 19465, 19169, 19024, 18934, 15530, 15529], u'collection_ids': [], u'current_user_furthest_reading_position_index': None, u'comments_count': 38, u'followers_count': 67, u'published_version_id': 49650, u'type': u'Story', u'current_user_furthest_reading_position_chapter_n umber': None, u'views_count': 185}
FFF:ERROR:calibre_plugins.fanficfare_plugin.dialog s(653):Exception: {u'author': [u'RobzBeanie'], u'pubdate': None, u'added': False, u'comment': u'sequence item 0: expected string, int found', u'good': False, u'begin': None, u'listorder': 0, u'comments': u'', u'title': u'The Man Next Door', u'all_metadata': {'author': u'RobzBeanie', 'dateCreated': u'2015-06-08 17:47:54', 'dislikes': '', 'formatext': '', 'storyUrl': u'https://fictionpad.com/author/RobzBeanie/stories/22461', 'lastupdate': u'Last Update Year/Month: 2015/06, Last Update: 2015/06/06', 'seriesHTML': '', 'version': u'FanFicFare v2.2.6', 'formatname': '', 'langcode': '', 'authorId': u'2697', 'seriesUrl': '', 'numChapters': u'11', 'ships': u'', 'datePublished': u'2015-06-06', 'extratags': u'FanFiction', 'warnings': u'', 'output_css': '', 'language': '', 'status': u'In-Progress', 'views': u'185', 'numWords': u'43,057', 'likes': u'13', 'authorHTML': u"<a class='authorlink' href='https://fictionpad.com/author/RobzBeanie/stories'>RobzBeanie</a>", 'followers': u'67', 'genre': u'Hurt/Comfort, Romance', 'authorUrl': u'https://fictionpad.com/author/RobzBeanie/stories', 'title': u'The Man Next Door', 'storyId': u'22461', 'site': u'fictionpad.com', 'characters': u'Bella Marie Swan, Edward Cullen', 'rating': u'18', 'category': u'Twilight', 'cover_image': '', 'comments': u'38', 'description': u'When Edward Cullen is released from prison, 18-year-old Bella becomes fascinated by her new next door neighbor. But is this strong young woman strong enough to handle his past? ** MAY TO DECEMBER ROMANCE CONTEST ENTRY **', 'siteabbrev': u'fpad', 'dateUpdated': u'2015-06-06', 'series': ''}, u'end': None, u'publisher': u'fictionpad.com', u'calibre_id': 2044, u'site': 'fictionpad.com', u'url': u'https://fictionpad.com/author/RobzBeanie/stories/22461', u'author_sort': u'RobzBeanie'}:sequence item 0: expected string, int found
Traceback (most recent call last):
File "calibre_plugins.fanficfare_plugin.dialogs", line 643, in do_loop
File "calibre_plugins.fanficfare_plugin.fff_plugin" , line 1026, in prep_download_loop
File "calibre_plugins.fanficfare_plugin.fanficfare.stor y", line 566, in dump_html_metadata
TypeError: sequence item 0: expected string, int found

[JimmXinu]

Originally Posted by tricklem

So Here is the log:

Yeah, that's already be fixed in the posted test version.

[JimmXinu]

Version 2.2.7 - 08 Jun 2015

• Fix add_genre_when_multi_category when genre is empty.
• Fix dump_html_metadata for non-string values.
• Change 'Fetch from Email' to get longest URL instead of normalized story URL. -- Change by cryzed.
• Update translations.

[eschwartz]

Probably the wrong place for it but I happen to be here... I am the Arch Linux package maintainer for the CLI version of FanFicFare.
I would like to release the new version, but you seem to have forgotten to tag this release.

Color me impatient -- I am in the habit of running on the bleeding (hourly) edge.

[tricklem]

Thanks Jimmyxinu. I was able to update fff this morning and the problem is gone. This place rocks!!

[JimmXinu]

Originally Posted by eschwartz

Probably the wrong place for it but I happen to be here... I am the Arch Linux package maintainer for the CLI version of FanFicFare.
I would like to release the new version, but you seem to have forgotten to tag this release.

Color me impatient -- I am in the habit of running on the bleeding (hourly) edge.

I assume you mean the Release tag in GitHub that I forgot to do. Added.

[eschwartz]

I sure did. Thanks -- package duly bumped.

[babygyrl]

I have not had problems with this plugin until this last update. I primarily use archiveofourown.org, and I use the "Make anthology from webpage" to convert an entire series of fics into one ebook. This morning, I updated the plugin, and tried to use the "Make anthology from webpage", and the urls that it pulled from the series page were not in the right order.

For reference, the series that I noticed this on was http://archiveofourown.org/series/218690, and FFF gave me the urls in this order:

http://archiveofourown.org/works/341...=true#comments
http://archiveofourown.org/works/273...=true#comments
http://archiveofourown.org/works/262...=true#comments
http://archiveofourown.org/works/361...=true#comments
http://archiveofourown.org/works/410...=true#comments

when the series page has them in this order:
http://archiveofourown.org/works/3616377
http://archiveofourown.org/works/2627696
http://archiveofourown.org/works/2734157
http://archiveofourown.org/works/3417404
http://archiveofourown.org/works/4103404


I would really like to have my series in the order that the author decided to put them in on the series page, so any help would be appreciated. Thank you.

[JimmXinu]

Originally Posted by babygyrl

I have not had problems with this plugin until this last update. I primarily use archiveofourown.org, and I use the "Make anthology from webpage" to convert an entire series of fics into one ebook. This morning, I updated the plugin, and tried to use the "Make anthology from webpage", and the urls that it pulled from the series page were not in the right order.
...

Ah. Oops. We didn't test "Change 'Fetch from Email' to get longest URL instead of normalized story URL" enough it seems.

Please try the posted test version and confirm that it fixes the problem for you.

[babygyrl]

Originally Posted by JimmXinu

Ah. Oops. We didn't test "Change 'Fetch from Email' to get longest URL instead of normalized story URL" enough it seems.

Please try the posted test version and confirm that it fixes the problem for you.

That seems to work. Thanks for the help.

[Elaine T]

The problem downloading from AO3 has reappeared, with four stories yesterday, and one today. I've pasted in the debug log for today's error below.

Hope it helps figure out what's going on. It's a nuisance.

Thanks

calibre Debug log
calibre 2.30 isfrozen: True is64bit: False
Windows-7-6.1.7601-SP1 Windows ('32bit', 'WindowsPE')
32bit process running on 64bit windows
('Windows', '7', '6.1.7601')
Python 2.7.9
Windows: ('7', '6.1.7601', 'SP1', 'Multiprocessor Free')
Successfully initialized third party plugins: DeDRM && FanFicFare && EpubMerge
Starting up...
FFFEBUG:calibre_plugins.fanficfare_plugin.fff_pl ugin(184):Plugin FanFicFare macmenuhack file_path:C:\Users\Elaine\AppData\Roaming\calibre\ plugins\fanficfare_macmenuhack.txt
macmenuhack file_path:C:\Users\Elaine\AppData\Roaming\calibre\ plugins\fanfictiondownloader_macmenuhack.txt
Started up in 22.26 seconds with 1376 books
FFFEBUG:calibre_plugins.fanficfare_plugin.fff_pl ugin(828):FanFicFare v2.2.6
FFFEBUG:calibre_plugins.fanficfare_plugin.fff_pl ugin(864):url:http://archiveofourown.org/works/300214
FFF:INFO:calibre_plugins.fanficfare_plugin.fanficf are.adapters.adapter_archiveofourownorg(142):url: http://archiveofourown.org/works/300214/navigate
FFF:INFO:calibre_plugins.fanficfare_plugin.fanficf are.adapters.adapter_archiveofourownorg(143):metau rl: http://archiveofourown.org/works/300214
FFFEBUG:calibre_plugins.fanficfare_plugin.fanfic fare.adapters.base_adapter(294):################## ###################
pagecache MISS: http://archiveofourown.org/works/300214/navigate
FFFEBUG:calibre_plugins.fanficfare_plugin.fanfic fare.adapters.base_adapter(294):################## ###################
pagecache MISS: http://archiveofourown.org/works/300214
FFF:WARNING:calibre_plugins.fanficfare_plugin.fanf icfare.adapters.base_adapter(336):Caught an exception reading URL: http://archiveofourown.org/works/300214 sleeptime(0) Exception IncompleteRead(0 bytes read, 2 more expected).
FFFEBUG:calibre_plugins.fanficfare_plugin.fanfic fare.adapters.base_adapter(294):################## ###################
pagecache MISS: http://archiveofourown.org/works/300214
FFF:WARNING:calibre_plugins.fanficfare_plugin.fanf icfare.adapters.base_adapter(336):Caught an exception reading URL: http://archiveofourown.org/works/300214 sleeptime(0.5) Exception IncompleteRead(0 bytes read, 2 more expected).
FFFEBUG:calibre_plugins.fanficfare_plugin.fanfic fare.adapters.base_adapter(294):################## ###################
pagecache MISS: http://archiveofourown.org/works/300214
FFF:WARNING:calibre_plugins.fanficfare_plugin.fanf icfare.adapters.base_adapter(336):Caught an exception reading URL: http://archiveofourown.org/works/300214 sleeptime(4) Exception IncompleteRead(0 bytes read, 2 more expected).
FFFEBUG:calibre_plugins.fanficfare_plugin.fanfic fare.adapters.base_adapter(294):################## ###################
pagecache MISS: http://archiveofourown.org/works/300214
FFF:WARNING:calibre_plugins.fanficfare_plugin.fanf icfare.adapters.base_adapter(336):Caught an exception reading URL: http://archiveofourown.org/works/300214 sleeptime(9) Exception IncompleteRead(0 bytes read, 2 more expected).
FFF:ERROR:calibre_plugins.fanficfare_plugin.fanfic fare.adapters.base_adapter(338):Giving up on http://archiveofourown.org/works/300214
FFF:ERROR:__init__.py(1193):IncompleteRead(0 bytes read, 2 more expected)
Traceback (most recent call last):
File "calibre_plugins.fanficfare_plugin.fanficfare.adap ters.base_adapter", line 328, in _fetchUrl
File "calibre_plugins.fanficfare_plugin.fanficfare.adap ters.base_adapter", line 299, in _fetchUrlRaw
File "urllib2.py", line 437, in open
File "calibre_plugins.fanficfare_plugin.fanficfare.gzip http", line 19, in http_response
File "socket.py", line 351, in read
File "httplib.py", line 549, in read
File "httplib.py", line 622, in _read_chunked
File "httplib.py", line 666, in _safe_read
IncompleteRead: IncompleteRead(0 bytes read, 2 more expected)
FFF:ERROR:calibre_plugins.fanficfare_plugin.dialog s(653):Exception: {u'author_sort': [u'Unknown'], u'url': u'http://archiveofourown.org/works/300214', u'site': 'archiveofourown.org', u'calibre_id': None, u'end': None, u'title': u'Unknown', u'comments': u'', u'listorder': 0, u'begin': None, u'good': False, u'comment': u'IncompleteRead(0 bytes read, 2 more expected)', u'added': False, u'pubdate': None, u'author': [u'Unknown']}:IncompleteRead(0 bytes read, 2 more expected)
Traceback (most recent call last):
File "calibre_plugins.fanficfare_plugin.dialogs", line 643, in do_loop
File "calibre_plugins.fanficfare_plugin.fff_plugin" , line 975, in prep_download_loop
File "calibre_plugins.fanficfare_plugin.fanficfare.adap ters.base_adapter", line 399, in getStoryMetadataOnly
File "calibre_plugins.fanficfare_plugin.fanficfare.adap ters.base_adapter", line 462, in doExtractChapterUrlsAndMetadata
File "calibre_plugins.fanficfare_plugin.fanficfare.adap ters.adapter_archiveofourownorg", line 147, in extractChapterUrlsAndMetadata
File "calibre_plugins.fanficfare_plugin.fanficfare.adap ters.base_adapter", line 340, in _fetchUrl
IncompleteRead: IncompleteRead(0 bytes read, 2 more expected)

[Elaine T]

I have a new question. When I was first typing in series names I had typos. Now I can't figure out how to get rid of the erroneous names. Is there a way to edit that list that pops up when I start typing in the series field, so I can delete the typo-ed series names?

Thanks

[JimmXinu]

Originally Posted by Elaine T

The problem downloading from AO3 has reappeared, with four stories yesterday, and one today. I've pasted in the debug log for today's error below.

calibre Debug log

FFF:ERROR:calibre_plugins.fanficfare_plugin.fanficfare.adapters.base_adapter(338):Giving up on http://archiveofourown.org/works/300214
FFF:ERROR:__init__.py(1193):IncompleteRead(0 bytes read, 2 more expected)

That sort of error is indicative of a network error (including any firewall software you may use), or a server error.

I don't think I can do anything about it in the plugin.

[JimmXinu]

Version 2.2.8 - 08 Jun 2015

• Preserve order of URLs fetched from page--especially important for anthologies.

I thought this un-obvious and important enough to do another release right away.