[GUI Plugin] Goodreads Sync

[twh07]

Hey guys, I'm also having the issue with the 202 response.

This sucks. I just finally got everything set up and working great, then they break the API.

Originally Posted by kiwidude

There is nothing I can do about it from a code perspective.

According to Google's AI response, you can solve AWS WAF challenges using a headless browser, but I haven't actually verified this myself, and I'm not sure how feasible it would be.

Here's the AI example code:

import asyncio
from playwright.async_api import async_playwright
from playwright_stealth import stealth_async

async def solve_aws_challenge():
    async with async_playwright() as p:
        # Launch browser with custom arguments to appear human
        browser = await p.chromium.launch(headless=True)
        context = await browser.new_context(
            user_agent="Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/120.0.0.0 Safari/537.36"
        )
        page = await context.new_page()
        
        # Apply stealth to mask automation signatures
        await stealth_async(page)
        
        # Navigate to the protected page; wait for the WAF script to execute
        print("Navigating and solving background JS challenge...")
        await page.goto("https://your-protected-website.com", wait_until="networkidle")
        
        # Retrieve the generated cookie
        cookies = await context.cookies()
        waf_token = next((c['value'] for c in cookies if c['name'] == 'aws-waf-token'), None)
        
        if waf_token:
            print(f"Success! Found token: {waf_token}")
            # Use this token in standard HTTP libraries like requests or httpx
        else:
            print("Challenge failed or interactive CAPTCHA required.")
            
        await browser.close()

asyncio.run(solve_aws_challenge())

[DisabledReader]

For clarity; I have extremely poor eyesight, so performing even basic functions on my PC can be difficult.

I use F9 to link to Goodreads and F10 to select the edition.
These now work intermittently. I don't always get the 202 error but sometimes I do.
Is there a way I can manually add the Goodreads book URL through the plugin when the error occurs?
I know I can paste the URL when I don't get the error message.

Thank you.

UPDATE: It seems I can avoid the 202 error if I use the 'Switch Edition' button on the bottom left of the 'Link to Goodreads' screen. I don't know why the two methods of getting to the 'Switch Edition' screen are different. If I call it directly from the plugin I usually get the error.

[damien18]

Searching for a book on Goodreads via the plugin's "Search for Goodreads book" dialog appears to be broken, returning no results, regardless of the book. I was able to get valid search results by changing "search[query]" to "q" in the URL that is launched by the dialog when its "Search Goodreads.com" button is clicked.

I made that change in two places in the plugin's dialogs.py file, and reloaded the plugin from file, and that has fixed the issue for me. Kiwidude, could this change be included in the next release of the plugin?

[kiwidude]

Release Notes:
https://github.com/kiwidude68/calibr...ds_sync-1.17.5

Fixed issues around Goodreads supporting quarter and half stars and syncing. Will now round to the nearest supported value in calibre (at best half stars if you have a custom rating column). Plus updated translations.

[kiwidude]

Originally Posted by damien18

Searching for a book on Goodreads via the plugin's "Search for Goodreads book" dialog appears to be broken, returning no results, regardless of the book. I was able to get valid search results by changing "search[query]" to "q" in the URL that is launched by the dialog when its "Search Goodreads.com" button is clicked.

I made that change in two places in the plugin's dialogs.py file, and reloaded the plugin from file, and that has fixed the issue for me. Kiwidude, could this change be included in the next release of the plugin?

Sorry just spotted this, will update in a new release shortly.

[kiwidude]

Release Notes:
https://github.com/kiwidude68/calibr...ds_sync-1.17.6

Just like buses - wait forever then two come along at once. Fixes the search Goodreads query url.

For all the "202" related error posts above for both linking books and syncing - I don't know what to tell you other than "it works for me" trying it today. Maybe Goodreads were tinkering, maybe there were infrastructure issues at the time, maybe your traffic was flagged for some reason. Regardless there isn't much I can do about it, so I will just focus on the problems I can fix.

[kiwidude]

Originally Posted by DisabledReader

For clarity; I have extremely poor eyesight, so performing even basic functions on my PC can be difficult.

I use F9 to link to Goodreads and F10 to select the edition.
These now work intermittently. I don't always get the 202 error but sometimes I do.
Is there a way I can manually add the Goodreads book URL through the plugin when the error occurs?
I know I can paste the URL when I don't get the error message.

Thank you.

UPDATE: It seems I can avoid the 202 error if I use the 'Switch Edition' button on the bottom left of the 'Link to Goodreads' screen. I don't know why the two methods of getting to the 'Switch Edition' screen are different. If I call it directly from the plugin I usually get the error.

I can understand your confusion on the two different ways into that dialog, it is a bit of a strange UI choice - and I wrote it (many years ago).

One approach if you need to manually paste a good reads identifier is to simply just grab the numeric value and update it in the normal Edit Metadata dialog in the identifiers field with goodreads:123. It isn't the most user friendly part of calibre to edit with a one line field that could contain many identifiers, but it works.

If I understand your request you are wanting to have the equivalent of the "Paste url" right click that is on the right click of that dialog. Having not experienced the 202 errors I don't know what is happening - does the dialog not show in that circumstance? My normal approach is to bring up the dialog, when it fails to find the match I want I then just drag/drop the URL from my browser onto that dialog (as an alternative to the right click paste URL). Since there are so many options using that dialog to manually find a match I don't really see the need to also add a dedicated paste URL feature to the plugin, but I could be misunderstanding what is being asked for...

[DisabledReader]

@kiwidude
I have adjusted my method of acquiring the identifiers I want when the plugin gets an error. Being partially blind, I have to do things in a methodical way.
As you said earlier, the plugin does seem to be working more times than not recently, so please don't trouble yourself with trying to understand my badly worded request.

Thank you.

[Rellwood]

Wondering about updating reading progress, it's not syncing from Goodreads to my library but uploading from my library to Goodreads? Would be nice if it grabbed the info from Goodreads, but I don't know if it could be scraped or not.