View Single Post
Old 04-27-2011, 04:43 PM   #3
hiperlink
Enthusiast
hiperlink began at the beginning.
 
Posts: 45
Karma: 10
Join Date: Dec 2010
Device: Kindle 3 Wifi only
for your answer!

I'll try out the solution for the first question tomorow at my devdesk.

But for the second, there's a little misunderstanding: the site I want to create a feed has a feed, but that's rather unuseable: most of the times there are duplicate items and it has only the 10 articles of wich usually at least 4 is duplicate, e.g.:
  • article 1
  • article 2
  • article 1
  • article 3
  • article 4
  • article 3
  • article 1
...
So I don't want to use it (yeah I know I can filter out the duplicates). The site has sections (e.g. Sport, Technology: it's a local newspaper site).
The sections has all the articles related to their sections, like

<h1>article 1</h1>
<p>2011-04-27</p>
(snippet)
<h1>article 2</h1>
<p>2011-04-27</p>
(snippet)
<h1>article 3</h1>
<p>2011-04-27</p>
(snippet)
<h1>article 4</h1>
<p>2011-04-27</p>
(snippet)
<h1>article 5</h1>
<p>2011-04-27</p>
(snippet)
<link to next page>

And on the next page:
<h1>article 6</h1>
<p>2011-04-27</p>
(snippet)
<h1>article 7</h1>
<p>2011-04-27</p>
(snippet)
<h1>article 8</h1>
<p>2011-04-27</p>
(snippet)
<h1>article 9</h1>
<p>2011-04-26</p>
(snippet)
<h1>article 10</h1>
<p>2011-04-26</p>
(snippet)
<link to next page>

Now what I want is to generate a custom feed for todays all articles, for which I have to open the index page of the section, then click the link to next page(s) until I can find and add articles to the feed with todays date.

I can parse the index page, and create the feed for it, but how to get to the next page?

Thanks in advance!
hiperlink is offline   Reply With Quote