|
help on Heise CT recipe
Hi There,
the Heise CT recipe works so far, after I modified slightly the login part, as it was outdated.
Anyway, I could see that all Articles are ending after one page, and the rest of the Article is no longer there.
I could see that if I use a normal Browser, there is no Paging and no JavaScript used for the article text itself.
When I comment out the remove tags part I could see that the pages really looks like not completely downloaded.
Not sure what I can do. I tried to include browser_type = 'webengine' to check if may the bot check is blocking it, but including this parameter I get the following error:
AttributeError: 'WebEngineBrowser' object has no attribute 'select_form'
Any help would be appreciated,
MP
|