MobileRead Forums - View Single Post - Beautiful soup findAll doesn't seem to work

cryzed · 07-27-2012, 10:45 AM

Okay, I've never used the recipe feature of Calibre before, the only thing I know is that it works outside of Calibre. I did what I suggested to you and wrote the section HTML to a file and checked its contents:

PHP Code:


			
<h1 class="fly-title">Business</h1>

<article>

<h2><a href="/node/21537920" class="package-link">Virgin territory</a></h2>

</article>

I've got no clue why there's only one article in the scraped section, possibly some Calibre specific stripping of tags, an error during parsing due to outdated modules (BeautifulSoup instead of bs4), I'm sorry, maybe ask someone more familiar with the Calibre specific scraping.

07-27-2012, 10:45 AM	#6
cryzed Evangelist Posts: 408 Karma: 1050547 Join Date: Mar 2011 Device: Kindle Oasis 2	Okay, I've never used the recipe feature of Calibre before, the only thing I know is that it works outside of Calibre. I did what I suggested to you and wrote the section HTML to a file and checked its contents: PHP Code: `<h1 class="fly-title">Business</h1> <article> <h2><a href="/node/21537920" class="package-link">Virgin territory</a></h2> </article>` I've got no clue why there's only one article in the scraped section, possibly some Calibre specific stripping of tags, an error during parsing due to outdated modules (BeautifulSoup instead of bs4), I'm sorry, maybe ask someone more familiar with the Calibre specific scraping.