Quote:
Originally Posted by rgibbo
<snip>
After scanning through the code for about 15 minutes, I managed to found the problem, it lies with how the tool gets the page data from the site as it sends out a user agent string to help identify it, it seems fanfiction has blocked the tool's user agent string so the tool can't download anything. I decided to change the user agent string which was FLAG/1.0 or similar to the something differentand it seems to be working again now.
Well that's the solution if anyone else wants it.
|
Sorry to disillusion you... but the UA string wasn't actually the issue at all. The problem was that the DNS server I was using had crashed (darn thing ran out of memory), which meant that the web service was unable to resolve the hostname for fanfiction.net (and therefore couldn't download the stories). I've restarted the DNS server, and everything now works perfectly again (Thanks heaps for bringing this to my attention
). This means that whatever issue you were having was unrelated, and specific to your particular setup.
What else did you change? As the UA for FLAG isn't blocked, changing it wouldn't have fixed anything.
Edit: Out of interest, how difficult was it to get this runing on Windows? I've used a fair few things that are specific to Linux/Unix systems (various posix functions, assuming that /tmp exists etc). Are you able to send me a diff?