View Single Post
Old 01-04-2013, 05:14 PM   #1132
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 6,320
Karma: 3966249
Join Date: Dec 2011
Location: Midwest USA
Device: Kindle Paperwhite(10th)
Quote:
Originally Posted by FaceDeer View Post
These three are the only ones I know of with the null title problem: http://www.fimfiction.net/api/story.php?story=51241, http://www.fimfiction.net/api/story.php?story=52367 and http://www.fimfiction.net/api/story.php?story=65474. It's really rare but I kept careful track of them because if one of these gets included in a batch update the whole batch fails.
I thought you meant a null chapter title. No, this problem wasn't fixed before.

I'd started writing a whole rant about how if they can't fix their API, it's just going to stay broken, but that's hardly fair. There's lots of other sites that FFDL has to scrape more than one page to collect all the necessary data.
Quote:
Originally Posted by FaceDeer View Post
Oh, an unrelated question while on the subject of scraping pages and whatnot. FiMFiction stories sometimes have "sex" and "gore" tags on their description pages (http://www.fimfiction.net/story/74526/ and http://www.fimfiction.net/story/58005/ are examples). Does FFDL pick those up? I thought I'd hooked up all the metadata to custom columns but I've overlooked stuff like this before.
Since we're scraping anyway, sure, why not. Those are now appearing in the 'warning' metadata.

The attached version, I believe, addresses all of the issues so far raised.

Quote:
Originally Posted by FaceDeer View Post
Edit: Just tried it out on that test case from yesterday and it worked great, chapters are titled correctly. Thanks! I wish you'd put a "donate" link on your plugin, after all this hassle "thanks" seems like such a minor reward.
I don't put a donate link on FFDL because a) I didn't create the project originally (although I have added or rewritten pretty much the whole core over the last 2 years), b) it takes content from various websites and I don't want to give the appearance of asking for money for other people's content, and c) it's FanFictionDownLoader--we get away with fanfic because nobody's asking for money for it.

If you look on the Plugin Index and search for JimmXinu, you'll see that I do have 3 other plugins that I do have donation links for.

UPDATE Jan 05 2013 -- Remove obsolete beta versions

Last edited by JimmXinu; 01-05-2013 at 01:01 PM. Reason: Remove obsolete beta versions
JimmXinu is offline