thank you.
sometimes, when i get caught up in something, i for get to explain my self.
if you take a look
here you will see a list of 30 articles. to see the rest of the articles, you need to go to the bottom of the page and press the next button. then you get an other page with 30 articles. and so on.
i used tamper data to find what that button does. it submits a long request with a lot of parameters, but as far as i can see, the only one that matters is "rsSearchRes_pgNo" and you give it the page number you want.
how can i incorporate that in my code?
also, when i am done with this, i want to turn this recipe in to real python code so i can deal with the pdf articles. how hard do you think that might be? (i tried to get started on that, ran in to some trouble and posted a question on stack overflow. all i got was a nasty response that didnt answer the question)