Register Guidelines E-Books Today's Posts Search

Go Back   MobileRead Forums > E-Book Software > Calibre > Plugins

Notices

Reply
 
Thread Tools Search this Thread
Old 10-19-2025, 01:46 PM   #11386
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 7,113
Karma: 5005503
Join Date: Dec 2011
Location: Midwest USA
Device: Kobo Clara Colour running KOReader
Quote:
Originally Posted by kimboosan View Post
I've haunted this forum for a long time, always found the answers I needed. But finally signed up because I am seriously at my wits end:

I have over 100 "in-progress" stories in calibre I've imported from AO3 using FFF, and I've been updating fine until earlier this year. The "is_adult:true" and "alwys_login:true" fixes worked for a while. Now, I can't update anything. I am very much hoping I've just done something dumb that is easy to fix, but if that's the case, I can't figure it out.

Calibre 8.13
FFF v4.49.6 (beta, just installed hoping it would solve issue but nope)
Downloading from: Archiveofourown.org
The 403 error you are getting suggests you are being blocked. If you generated a bunch of traffic at once (like trying to update 100+ stories at one time?) it could happen.

I suggest you try:
  1. Turn off use_archiveofourown_gay (they might have different block lists)
  2. Set slow_down_sleep_time higher than the default 4
  3. Download in smaller batches if you do get it working

Failing that, you could try Browser Cache instead. See https://github.com/JimmXinu/FanFicFa...oblematicSites and https://github.com/JimmXinu/FanFicFa...erCacheFeature

And, as always, you can still download AO3's version of the epub from the site.
JimmXinu is offline   Reply With Quote
Old 10-19-2025, 01:54 PM   #11387
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 7,113
Karma: 5005503
Join Date: Dec 2011
Location: Midwest USA
Device: Kobo Clara Colour running KOReader
Quote:
Originally Posted by indecisivefan View Post
And when I turn off the ao3.gay setting in personal.ini, I'm getting an "Unhandled Exception" error for "KeyError: 'href' " instead.

Both errors are 'fixed' when I use "Download from URLs" instead of "From Page", but it's not ideal when I'm wanting to download a couple dozen bookmarks
I'm not seeing this. Can you provide example URL and a debug log?
JimmXinu is offline   Reply With Quote
Advert
Old 10-19-2025, 07:48 PM   #11388
kimboosan
Junior Member
kimboosan began at the beginning.
 
Posts: 3
Karma: 10
Join Date: Oct 2025
Device: calibre
Quote:
Originally Posted by JimmXinu View Post
The 403 error you are getting suggests you are being blocked. If you generated a bunch of traffic at once (like trying to update 100+ stories at one time?) it could happen.

I suggest you try:
  1. Turn off use_archiveofourown_gay (they might have different block lists)
  2. Set slow_down_sleep_time higher than the default 4
  3. Download in smaller batches if you do get it working

Failing that, you could try Browser Cache instead. See https://github.com/JimmXinu/FanFicFa...oblematicSites and https://github.com/JimmXinu/FanFicFa...erCacheFeature

And, as always, you can still download AO3's version of the epub from the site.
Update:

I removed use_archiveofourown_gay but nothing changed; I set slow_down_sleep_time to 6 but nothing changed; I tried small batches and one at a time, nothing changed.

Randomly, I commented out "always_login:true" and it worked, but only for unlocked fic (natch).

I mean, it's working, sorta. My question is, does this suggest that my user profile is blocked? Obviously not my IP since it worked without logging in. Is this something I should put in a ticket with AO3 for?
kimboosan is offline   Reply With Quote
Old 10-19-2025, 07:56 PM   #11389
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 7,113
Karma: 5005503
Join Date: Dec 2011
Location: Midwest USA
Device: Kobo Clara Colour running KOReader
Quote:
Originally Posted by kimboosan View Post
Randomly, I commented out "always_login:true" and it worked, but only for unlocked fic (natch).

I mean, it's working, sorta. My question is, does this suggest that my user profile is blocked? Obviously not my IP since it worked without logging in. Is this something I should put in a ticket with AO3 for?
Where you previously trying to download a large batch at once? Because if it's a traffic block, you can usually wait a few days (or weeks) and it will go back to normal.

I wouldn't bug AO3 about it. I'm always afraid that drawing attention to a downloader will result in more blocking, not less. No idea if it really would.
JimmXinu is offline   Reply With Quote
Old 10-19-2025, 08:04 PM   #11390
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 7,113
Karma: 5005503
Join Date: Dec 2011
Location: Midwest USA
Device: Kobo Clara Colour running KOReader
New Version Released

Version 4.50.0 - 2025-10-19
- OTW(AO3): Fix for site change breaking logged in detection. Closes #1263
- adapter_literotica: Site change, regex outdated. PR1261, thanks dbhmw!
- adapter_storiesonlinenet: Add check for SOL accounts in renewal warning period to verbosely explain to users why their downloads don't work. PR1262, thanks bpothier!
- base_otw_adapter: Fix for markedforlater site change
- OTW(AO3): Accept /chapter/999 URLs without /works/999 for #1258
- Fix tuple vs grouping vs list, closes #1254 (royalroad "'NoneType' object does not support item assignment")
- Spiritfanfiction login, closes #1247, thanks kilandra
- New site: althistory.com (NOT alternatehistory.com) for #1252

Released early due to AO3 site change.
JimmXinu is offline   Reply With Quote
Advert
Old 10-19-2025, 10:47 PM   #11391
indecisivefan
Junior Member
indecisivefan began at the beginning.
 
Posts: 3
Karma: 10
Join Date: Jun 2024
Device: none
Quote:
Originally Posted by JimmXinu View Post
I'm not seeing this. Can you provide example URL and a debug log?
Sure. It's the "URLs from Webpage" itself that's not working, as I've tried it on many different pages (my bookmarks, a collection, a series, etc.). Here is one URL that I confirmed did not work:
https://archiveofourown.org/tags/Original%20Work/works

And here's the error and debug log:

calibre, version 8.13.0
ERROR: Unhandled exception: <b>KeyError</b>:'href'

calibre 8.13 embedded-python: True
Windows-10-10.0.19044-SP0 Windows ('64bit', 'WindowsPE')
('Windows', '10', '10.0.19044')
Python 3.11.14
Windows: ('10', '10.0.19044', 'SP0', 'Multiprocessor Free')
Interface language: None
EXE path: C:\Program Files\Calibre2\calibre.exe
Successfully initialized third party plugins: DeDRM (10, 0, 3) && Count Pages (1, 14, 1) && EpubMerge (3, 2, 0) && FanFicFare (4, 49, 6) && Generate Cover (2, 3, 6)
Traceback (most recent call last):
File "calibre_plugins.fanficfare_plugin.fff_plugin" , line 712, in get_urls_from_page_menu
File "calibre_plugins.fanficfare_plugin.fff_plugin" , line 735, in get_urls_from_page
File "C:\Users\NAME\AppData\Roaming\calibre\plugins\Fan FicFare.zip\fanficfare\geturls.py", line 44, in get_urls_from_page
File "C:\Users\NAME\AppData\Roaming\calibre\plugins\Fan FicFare.zip\fanficfare\adapters\base_adapter.py", line 504, in get_urls_from_page
File "C:\Users\NAME\AppData\Roaming\calibre\plugins\Fan FicFare.zip\fanficfare\adapters\base_otw_adapter.p y", line 688, in get_series_from_page
File "C:\Users\NAME\AppData\Roaming\calibre\plugins\Fan FicFare.zip\fanficfare\adapters\base_otw_adapter.p y", line 688, in <listcomp>
File "bs4\element.py", line 1573, in __getitem__
KeyError: 'href'
Attached Files
File Type: txt calibre-debug-log.txt (6.1 KB, 0 views)
indecisivefan is offline   Reply With Quote
Old 10-19-2025, 11:16 PM   #11392
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 7,113
Karma: 5005503
Join Date: Dec 2011
Location: Midwest USA
Device: Kobo Clara Colour running KOReader
New Test Version Posted

2025-10-18
- OTW/AO3: Don't apply series page handling to non-series pages

For indecisivefan's issue.

I'm honestly not sure if AO3 changed, or this just never came up before. Given the logout tag changed...
JimmXinu is offline   Reply With Quote
Old Yesterday, 08:45 AM   #11393
kimboosan
Junior Member
kimboosan began at the beginning.
 
Posts: 3
Karma: 10
Join Date: Oct 2025
Device: calibre
Quote:
Originally Posted by JimmXinu View Post
Where you previously trying to download a large batch at once? Because if it's a traffic block, you can usually wait a few days (or weeks) and it will go back to normal.

I wouldn't bug AO3 about it. I'm always afraid that drawing attention to a downloader will result in more blocking, not less. No idea if it really would.
Good point. That said, I remembered I had an old account there so used that log-in info, got the same result, so it's not personal! LOL!

For documentation's sake: I tried to update 10 fic, and six of them worked fine while four, which are locked, did not (expected behavior). Then I tried 20 fic, and it failed completely even with unlocked fic (same 403 error). I went back and tried to update 1 unlocked fic and it failed (403 error).

Which makes me think this is server side with AO3 kicking out requests after a set number. However I don't see anyone else having this problem????

I'll try the browser cache approach and see what happens. Oh, for the good old days before the AO3 dos attacks and server changes...life was simpler then!!!
kimboosan is offline   Reply With Quote
Old Yesterday, 08:55 PM   #11394
taratears
Connoisseur
taratears began at the beginning.
 
Posts: 89
Karma: 10
Join Date: Aug 2013
Device: Kindle Fire HD
I'm using it to grab ao3 updates thru yahoo email, and it works, but requires login every time despite login info being in personal.ini with adult set to true.
Safe copy of personal.ini below.
Spoiler:


## This is an example of what your personal configuration might look
## like. Uncomment options by removing the '#' in front of them.

[defaults]
## [defaults] section applies to all formats and sites but may be
## overridden at several levels. See
## https://github.com/JimmXinu/FanFicFare/wiki/INI-File for more
## details.

## Some sites also require the user to confirm they are adult for
## adult content. Uncomment by removing '#' in front of is_adult.
#is_adult:true

## Don't like the numbers at the start of chapter titles on some
## sites? You can use strip_chapter_numbers to strip them off. Just
## want to make them all look the same? Strip them off, then add them
## back on with add_chapter_numbers. Don't like the way it strips
## numbers or adds them back? See chapter_title_strip_pattern and
## chapter_title_add_pattern in defaults.ini.
#strip_chapter_numbers:true
#add_chapter_numbers:true


[epub]
## Include images from img tags in the body and summary of stories.
## Images will be converted to jpg for size if possible. Images work
## in epub format only. To get mobi or other format with images,
## download as epub and use Calibre to convert.
## true by default, uncomment and set false to not include images.
#include_images:true

## If set false, the summary will have all html stripped for safety.
## Both this and include_images must be true to get images in the
## summary.
## true by default, uncomment and set false to not keep summary html.
#keep_summary_html:true

## If set true, and there isn't a specific cover image, the first
## image found in the story will be made the cover image. If
## keep_summary_html is true, images in the summary will be before any
## in chapters.
## true by default, uncomment and set false to turn off
#make_firstimage_cover:true


## Most common, I expect will be using this to save username/passwords
## for different sites. Here are a few examples. See defaults.ini
## for the full list.

[www.twilighted.net]
#username:XXXXXXXX
#password:XXXXXXXX
## default is false
#collect_series: true

[www.fimfiction.net]
#is_adult:true
#fail_on_password:XXXXXXXX

[www.tthfanfic.org]
#is_adult:true
## tth is a little unusual--it doesn't require user/pass, but the site
## keeps track of which chapters you've read and won't send another
## update until it thinks you're up to date. If you set
## username/password, FFF will login to download. Then the site
## thinks you're up to date.
#username:XXXXXXXX
#password:XXXXXXXX

[www.archiveofourown.org]
## This is a OTW-archive site.
## Some sites require login (or login for some rated stories) The
## program can prompt you, or you can save it in config. In
## commandline version, this should go in your personal.ini, not
## defaults.ini.
#username:XXXXXXXX
#password:XXXXXXXX
#is_adult:true

## This section will override anything in the system defaults or other
## sections here.
[overrides]
## default varies by site. Set true here to force all sites to
## collect series.
#collect_series: true

#slow_down_sleep_time:4

Last edited by theducks; Yesterday at 10:30 PM. Reason: SPOILER LOG files
taratears is offline   Reply With Quote
Old Today, 03:02 AM   #11395
ownedbycats
Custom User Title
ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.
 
ownedbycats's Avatar
 
Posts: 11,318
Karma: 79528341
Join Date: Oct 2018
Location: Canada
Device: Kobo Libra H2O, formerly Aura HD
Quote:
Originally Posted by JimmXinu View Post
New Test Version Posted

2025-10-18
- OTW/AO3: Don't apply series page handling to non-series pages

For indecisivefan's issue.

I'm honestly not sure if AO3 changed, or this just never came up before. Given the logout tag changed...
otwarchive might've changed something. Since beginning of month, I see changes AO3-7113, AO3-6471, AO3-5668.

Last edited by ownedbycats; Today at 03:06 AM.
ownedbycats is offline   Reply With Quote
Old Today, 09:23 AM   #11396
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 7,113
Karma: 5005503
Join Date: Dec 2011
Location: Midwest USA
Device: Kobo Clara Colour running KOReader
Quote:
Originally Posted by taratears View Post
I'm using it to grab ao3 updates thru yahoo email, and it works, but requires login every time despite login info being in personal.ini with adult set to true.
Safe copy of personal.ini below.
Code:
[www.archiveofourown.org]
## This is a OTW-archive site.
## Some sites require login (or login for some rated stories) The
## program can prompt you, or you can save it in config.  In
## commandline version, this should go in your personal.ini, not
## defaults.ini.
#username:XXXXXXXX
#password:XXXXXXXX
#is_adult:true
You have to remove the leading '#' from those lines to uncomment them. Note the color highlighting.
JimmXinu is offline   Reply With Quote
Reply

Tags
fanfiction


Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
[GUI Plugin] KindleUnpack - The Plugin DiapDealer Plugins 527 08-15-2025 01:36 PM
[GUI Plugin] Open With kiwidude Plugins 404 02-21-2025 05:42 AM
[GUI Plugin] Marvin XD Philantrop Plugins 126 01-29-2017 12:48 PM
[GUI Plugin] KiNotes -axel- Plugins 0 07-14-2013 06:39 PM
[GUI Plugin] Plugin Updater **Deprecated** kiwidude Plugins 159 06-19-2011 12:27 PM


All times are GMT -4. The time now is 02:50 PM.


MobileRead.com is a privately owned, operated and funded community.