Override the populate_article_metadata method. Here you have access
to the webpage of the article. At this point, you can use the
BeautifulSoup API to parse for metadata like title, author, and date.
Use the tag_to_string method to convert the html elements containing
text to a string. Finally, append the metadata along with the article
text to the csv file.
|