|
|
#8806 | |
|
Plugin Developer
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 7,329
Karma: 5007213
Join Date: Dec 2011
Location: Midwest USA
Device: Kobo Clara Colour running KOReader
|
Quote:
I didn't have a ships column handy, but here's an equivalent example. Code:
{#chars:list_item(0,\,)}
|
|
|
|
|
|
|
#8807 |
|
Junior Member
![]() Posts: 9
Karma: 10
Join Date: Dec 2020
Device: calibre
|
AO3 seems to be having some issues again.
It has been giving me this error all day: "'NoneType' object has no attribute 'get_text'" both with adding or updating fanfic. Other sites are working fine still. |
|
|
|
| Advert | |
|
|
|
|
#8808 |
|
Connoisseur
![]() Posts: 97
Karma: 10
Join Date: Sep 2018
Device: iPad mini
|
This isn’t directly an FFF question, but it’s something I imagine people here might have also considered/ I’ve been cleaning up my fic library, and part of that was searching for updated (AO3) versions of pics that were hosted on individual sites/dead sites/livejournal. Some authors mystified me by having seemingly random uploads (aka some on one site, some on another, nor based on fandom), but that’s beside the point. What I had to do involved copying/pasting to search Ao3 for each fic individually. It led me to find cleaned-up versions of pics I copy-pasted into docs fifteen years ago, and follow creators I’d lost track of. Doing it for every FFN fic I have that might have been moved would be insane.
Ideally, it’d be possible to be told if an author I follow elsewhere moves their to a new site, but that’s a pipe dream. What I wondered was: Is there a program/tool that could take a list/string of data (author names) into a search page (AO3) and spit out results I could then vet? Better would be both title and author name—just title would be too likely to give false positives. basically, as anyone found a way to use data scrapping to follow their favorite fics? |
|
|
|
|
|
#8809 |
|
Plugin Developer
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 7,329
Karma: 5007213
Join Date: Dec 2011
Location: Midwest USA
Device: Kobo Clara Colour running KOReader
|
I'm not seeing that. Can you run in debug mode (under Calibre Preferences dropdown) and post the log?
|
|
|
|
|
|
#8810 |
|
Junior Member
![]() Posts: 2
Karma: 10
Join Date: Aug 2023
Device: none
|
I'm not the original poster but I'm also having the same issue with AO3. Here's the log. I did remove my computer name (hence the ____). Let me know if you need anything else. I did get a few to work but most have failed.
Using calibre Qt style: True ApplicationPaletteChange event received ApplicationPaletteChange event received ApplicationPaletteChange event received ApplicationPaletteChange event received ApplicationPaletteChange event received ApplicationPaletteChange event received ApplicationPaletteChange event received ApplicationPaletteChange event received ApplicationPaletteChange event received ApplicationPaletteChange event received ApplicationPaletteChange event received ApplicationPaletteChange event received ApplicationPaletteChange event received ApplicationPaletteChange event received FFF: DEBUG: 2023-08-22 22:23:16,090: calibre_plugins.fanficfare_plugin.fff_plugin(215): Plugin FanFicFare macmenuhack file_path:/Users/____/Library/Preferences/calibre/plugins/fanficfare_macmenuhack.txt calibre Debug log calibre 6.25 embedded-python: True macOS-12.6.7-x86_64-i386-64bit Darwin ('64bit', '') ('Darwin', '21.6.0', 'Darwin Kernel Version 21.6.0: Thu Jun 8 23:57:12 PDT 2023; root:xnu-8020.240.18.701.6~1/RELEASE_X86_64') Python 3.10.1 OSX: ('12.6.7', ('', '', ''), 'x86_64') Interface language: None Successfully initialized third party plugins: FanFicFare (4, 26, 1) calibre 6.25 embedded-python: True macOS-12.6.7-x86_64-i386-64bit Darwin ('64bit', '') ('Darwin', '21.6.0', 'Darwin Kernel Version 21.6.0: Thu Jun 8 23:57:12 PDT 2023; root:xnu-8020.240.18.701.6~1/RELEASE_X86_64') Python 3.10.1 OSX: ('12.6.7', ('', '', ''), 'x86_64') Interface language: None Successfully initialized third party plugins: FanFicFare (4, 26, 1) QPA platform: cocoa devicePixelRatio: 2.0 logicalDpi: 72.0 x 72.0 physicalDpi: 110.50000165954353 x 110.50000165954353 [0.00] Starting up... [0.02] Showing splash screen... [0.22] splash screen shown [0.22] Initializing db... [0.29] db initialized [0.29] Constructing main UI... [1.88] main UI initialized... [1.88] Hiding splash screen Starting QuickView FFF: DEBUG: 2023-08-22 22:23:23,090: calibre_plugins.fanficfare_plugin.dialogs(493): self.extraoptions['anthology_url']:NOT FOUND FFF: DEBUG: 2023-08-22 22:23:23,095: calibre_plugins.fanficfare_plugin.fff_plugin(1125) : FanFicFare v4.26.1 FFF: DEBUG: 2023-08-22 22:23:23,221: configurable.py(1072): use_browser_cache: FFF: DEBUG: 2023-08-22 22:23:23,222: configurable.py(1092): use_basic_cache:true FFF: INFO: 2023-08-22 22:23:23,223: adapter_archiveofourownorg.py(164): url: https://archiveofourown.org/works/44640877/navigate FFF: INFO: 2023-08-22 22:23:23,223: adapter_archiveofourownorg.py(165): metaurl: https://archiveofourown.org/works/44640877 FFF: DEBUG: 2023-08-22 22:23:23,223: cache_basic.py(116): ========== MISS (GET) BasicCache https://archiveofourown.org/works/44640877/navigate FFF: DEBUG: 2023-08-22 22:23:23,223: fetcher_requests.py(114): ---------- REQ (GET) RequestsFetcher https://archiveofourown.org/works/44640877/navigate FFF: DEBUG: 2023-08-22 22:23:23,458: fetcher_requests.py(127): response code:200 FFF: DEBUG: 2023-08-22 22:23:23,458: decorators.py(112): fromcache:False FFF: DEBUG: 2023-08-22 22:23:23,459: decorators.py(123): random sleep(1.00-3.00):1.76 FFF: DEBUG: 2023-08-22 22:23:25,221: requestable.py(55): Encoding:utf8 FFF: DEBUG: 2023-08-22 22:23:25,222: cache_basic.py(116): ========== MISS (GET) BasicCache https://archiveofourown.org/works/44640877 FFF: DEBUG: 2023-08-22 22:23:25,223: fetcher_requests.py(114): ---------- REQ (GET) RequestsFetcher https://archiveofourown.org/works/44640877 FFF: DEBUG: 2023-08-22 22:23:25,362: fetcher_requests.py(127): response code:200 FFF: DEBUG: 2023-08-22 22:23:25,362: decorators.py(112): fromcache:False FFF: DEBUG: 2023-08-22 22:23:25,362: decorators.py(123): random sleep(1.00-3.00):1.18 FFF: DEBUG: 2023-08-22 22:23:26,545: requestable.py(55): Encoding:utf8 FFF: ERROR: 2023-08-22 22:23:26,702: calibre_plugins.fanficfare_plugin.dialogs(725): Exception: {'title': 'Unknown', 'author_sort': ['Unknown'], 'author': ['Unknown'], 'comments': '', 'good': False, 'status': 'Error', 'showerror': True, 'calibre_id': None, 'begin': None, 'end': None, 'comment': "'NoneType' object has no attribute 'get_text'", 'url': 'https://archiveofourown.org/works/44640877', 'site': 'archiveofourown.org', 'series': '', 'added': False, 'pubdate': None, 'publisher': None, 'uniqueurl': 'https://archiveofourown.org/works/44640877[None-None]', 'listorder': 0, 'collision': 'Update EPUB if New Chapters'}:'NoneType' object has no attribute 'get_text' Traceback (most recent call last): File "calibre_plugins.fanficfare_plugin.dialogs", line 712, in do_loop self.foreach_function(book) File "calibre_plugins.fanficfare_plugin.fff_plugin" , line 1331, in prep_download_loop story = self.get_story_metadata_only(adapter) File "calibre_plugins.fanficfare_plugin.fff_plugin" , line 1211, in get_story_metadata_only adapter.getStoryMetadataOnly(get_cover=False) File "/Users/____/Library/Preferences/calibre/plugins/FanFicFare.zip/fanficfare/adapters/base_adapter.py", line 327, in getStoryMetadataOnly self.doExtractChapterUrlsAndMetadata(get_cover=get _cover) File "/Users/____/Library/Preferences/calibre/plugins/FanFicFare.zip/fanficfare/adapters/base_adapter.py", line 431, in doExtractChapterUrlsAndMetadata return self.extractChapterUrlsAndMetadata() File "/Users/____/Library/Preferences/calibre/plugins/FanFicFare.zip/fanficfare/adapters/adapter_archiveofourownorg.py", line 268, in extractChapterUrlsAndMetadata m = re.match(r'(?P<author>.*) \[archived by ?(?P<archivist>.*)\]',stripHTML(byline)) File "/Users/____/Library/Preferences/calibre/plugins/FanFicFare.zip/fanficfare/htmlcleanup.py", line 71, in stripHTML retval = soup.get_text(strip=True) AttributeError: 'NoneType' object has no attribute 'get_text' |
|
|
|
| Advert | |
|
|
|
|
#8811 |
|
Junior Member
![]() Posts: 9
Karma: 10
Join Date: Dec 2020
Device: calibre
|
Spoiler:
Last edited by theducks; 08-23-2023 at 12:00 PM. Reason: Please Spoiler Log files |
|
|
|
|
|
#8812 |
|
Plugin Developer
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 7,329
Karma: 5007213
Join Date: Dec 2011
Location: Midwest USA
Device: Kobo Clara Colour running KOReader
|
lttwngkvis's log suggests that the <h3 class="byline"> tag is missing, but I don't see that error with the same story.
Elphaeba's log doesn't show the actual error, just the reporting of it. You perhaps trimmed it too much? Or took the job log instead of the debug log? Regardless, I don't see it with this story, either. It's possible AO3 has made a site change that is slowly rolling out. I would suspect a skin issue with non-Default site skin, but I don't see either configured to login. I'll post a test version that works around lttwngkvis's issue tomorrow, but I'd like to hear if more people are seeing this. |
|
|
|
|
|
#8813 |
|
Custom User Title
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 11,634
Karma: 81412473
Join Date: Oct 2018
Location: Canada
Device: Kobo Libra H2O, formerly Aura HD
|
@lttwngkvis - If none of them are NSFW, posting links of the stories that successed and failed might help figure out if there's something in common.
I'm running an update of multiple fics and all of them worked. |
|
|
|
|
|
#8814 |
|
Junior Member
![]() Posts: 9
Karma: 10
Join Date: Dec 2020
Device: calibre
|
Seems to be doing it only on certain stories for me as well.
I've never done the debug log before this is the log that popped up after i closed calibre with computer info removed. First fic worked 2nd did not. Spoiler:
|
|
|
|
|
|
#8815 | |
|
Custom User Title
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 11,634
Karma: 81412473
Join Date: Oct 2018
Location: Canada
Device: Kobo Libra H2O, formerly Aura HD
|
Quote:
https://otwarchive.atlassian.net/jir...solvedrecently https://otwarchive.atlassian.net/jir...pdatedrecently |
|
|
|
|
|
|
#8816 |
|
Plugin Developer
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 7,329
Karma: 5007213
Join Date: Dec 2011
Location: Midwest USA
Device: Kobo Clara Colour running KOReader
|
New Test Version Posted
2023-08-23 - AO3: Don't assume byline always present. Elphaeba's debug log (thanks) matches lttwngkvis's log. I've posted test versions that address that change. The code in question is for the use_archived_author setting and previously assumed "<h3 class='bylines'" was always present. |
|
|
|
|
|
#8817 |
|
Junior Member
![]() Posts: 9
Karma: 10
Join Date: Dec 2020
Device: calibre
|
It now at least attempts to update\new story it and states bad update with same error. Before it instantly went to stating an error that nothing needed\could be updated.
Spoiler:
|
|
|
|
|
|
#8818 | |
|
Junior Member
![]() Posts: 9
Karma: 10
Join Date: Dec 2022
Device: none
|
Hi, I keep receiving this error whenever i try to update.
Quote:
|
|
|
|
|
|
|
#8819 |
|
Plugin Developer
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 7,329
Karma: 5007213
Join Date: Dec 2011
Location: Midwest USA
Device: Kobo Clara Colour running KOReader
|
New Test Version Posted
2023-08-23 - AO3: Don't assume byline always present. - AO3: Don't assume chapter userstuff module always present. It's always so much fun trying to fix problems I don't see...
|
|
|
|
|
|
#8820 | |
|
Junior Member
![]() Posts: 9
Karma: 10
Join Date: Dec 2022
Device: none
|
Hi, I notice people are also getting the same error as me and you asked for their log. I'm still trying to understand calibre, so i didn't know how to use the debug mode but I finally figured it out. Here's my log:
Quote:
|
|
|
|
|
![]() |
| Tags |
| fanfiction |
|
Similar Threads
|
||||
| Thread | Thread Starter | Forum | Replies | Last Post |
| [GUI Plugin] Open With | kiwidude | Plugins | 405 | 02-09-2026 07:54 AM |
| [GUI Plugin] KindleUnpack - The Plugin | DiapDealer | Plugins | 529 | 01-28-2026 10:32 AM |
| [GUI Plugin] Marvin XD | Philantrop | Plugins | 126 | 01-29-2017 12:48 PM |
| [GUI Plugin] KiNotes | -axel- | Plugins | 0 | 07-14-2013 06:39 PM |
| [GUI Plugin] Plugin Updater **Deprecated** | kiwidude | Plugins | 159 | 06-19-2011 12:27 PM |