Mediapart recipe doesn't work anymore - Page 2

pyjamarama · 04-10-2022, 04:12 AM

hi dear all,
i am new to calibre, and i tried using the latest github recipe to fetch mediapart news (this on https://github.com/kovidgoyal/calibr...diapart.recipe) in the custom fetch news menu, but it just won't work.
is there any update i missed?
thank you for your help !

MoloBolo · 04-28-2022, 12:06 PM

I'm a bit late but in case you're still here, the website changed (again) so the recipe needs to be updated. I don't think it was since my last post and I personally can't do it so you can try or wait in case someone else does.

I use "feedbro" and "ePub Creator" extensions to download the daily articles.

loic2000 · 05-07-2022, 12:10 PM

Sorry for the late reply. I finally had time to look into this and a major problem is that Mediapart changed the way they structured articles data on their webpage. It would take a lot of time to change the recipe to adapt it to the current version of the website.
And even if I change the recipe, the same may occur again in a couple of months.

I will contact Mediapart and ask them if they can provide a more reliable way to access their article data (through a restAPI) so I could write a robust version of the recipe.

At the same time, do not hesitate to contact Mediapart and ask them also if they could provide their article under an API so we could have a more robust recipe.

I will let you know here when I hear from them.

MoloBolo · 05-12-2022, 03:30 PM

Thanks !!

hmag · 07-31-2022, 12:12 PM

Hi all,
I tried to update the recipe (which now works fine - at least for me) but I can't have the authors properly shown in the epub, whereas they seems OK in the "feeds" object...
Maybe I'll publish anyway the changes to github even without the authors...
Regards,
Hervé

schnorrer · 08-08-2022, 05:45 AM

Quote:

Originally Posted by hmag

Hi all,
I tried to update the recipe (which now works fine - at least for me) but I can't have the authors properly shown in the epub, whereas they seems OK in the "feeds" object...
Maybe I'll publish anyway the changes to github even without the authors...
Regards,
Hervé

Merci beaucoup pour le boulot, grâce à vous les bonnes habitudes reprennent !

UniversalRead · 08-08-2022, 06:31 AM

Quote:

Originally Posted by hmag

Hi all,
I tried to update the recipe (which now works fine - at least for me) but I can't have the authors properly shown in the epub, whereas they seems OK in the "feeds" object...
Maybe I'll publish anyway the changes to github even without the authors...
Regards,
Hervé

Thank you so much ! Although Mediapart's original app is really well made, I prefer my e-reader for long sessions of reading, and you made it possible again. Hope that it will last though ...

schnorrer · 08-27-2022, 04:16 AM

Quote:

Originally Posted by UniversalRead

Thank you so much ! Although Mediapart's original app is really well made, I prefer my e-reader for long sessions of reading, and you made it possible again. Hope that it will last though ...

... It didn't. Damn.

Hervé (hmag) or anybody who understands what breaks the recipe again, I'd be happy to write and support them with accurate info that we e-readers should share with them. so they realize Calibre associated with e-readers is one, if not the best way to enjoy their written content, and that they should not break recipes without providing alternatives, and even provide a smooth way to export to epub themselves...

I was just getting used to read it like a good old daily quality newspaper

pyjamarama · 11-16-2022, 02:53 AM

Quote:

Originally Posted by MoloBolo

I'm a bit late but in case you're still here, the website changed (again) so the recipe needs to be updated. I don't think it was since my last post and I personally can't do it so you can try or wait in case someone else does.

I use "feedbro" and "ePub Creator" extensions to download the daily articles.

hey I tried feedbro for mediapart subscription based articles but it keeps loadin-d only the extracts although i gave username/psw ...

how do you manage to have full mediapart artcles ?

thank you for your help !

SergioS · 03-20-2023, 08:10 PM

Hi there, Does anyone has a recipe that allows downloading news from Mediapart please? I have tried more than an hour to figure out what can be done, as a beginner, and all is foreign to me. Despite I put in my account and password, an error message pops up, it says "InputFormatPlugin: Recipe Input running
Downloading recipe urn: builtin:mediapart
Trying to get latest version of recipe: mediapart
Using user agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/80.0.3987.87 Safari/537.36
Traceback (most recent call last):
File "runpy.py", line 196, in _run_module_as_main
File "runpy.py", line 86, in _run_code
File "site.py", line 41, in <module>
File "site.py", line 37, in main
File "calibre/utils/ipc/worker.py", line 215, in main
File "calibre/gui2/convert/gui_conversion.py", line 31, in gui_convert_recipe
File "calibre/gui2/convert/gui_conversion.py", line 25, in gui_convert
File "calibre/ebooks/conversion/plumber.py", line 1108, in run
File "calibre/customize/conversion.py", line 242, in __call__
File "calibre/ebooks/conversion/plugins/recipe_input.py", line 138, in convert
File "calibre/web/feeds/news.py", line 1056, in download
File "calibre/web/feeds/news.py", line 1233, in build_index
File "<string>", line 76, in parse_feeds
File "<string>", line 230, in my_parse_index
File "<string>", line 135, in get_articles
AttributeError: 'NoneType' object has no attribute 'find' "
Thank you !

unkn0wn · 03-21-2023, 03:03 AM

I want you to test this with your login id and password.

I just removed parse_feeds and replaced it with google feeds links.

SergioS · 03-21-2023, 06:26 AM

Hi there, Thanks so much for helping! I have encountered one last stumbling block before testing : am I supposed to put my login id and password inside your script? I saw these lines related to the credentials in the script file, but I am not sure how to do that (I tried replacing 'name' and "self.username" with my own email, for example, but it did not work). Really appreciate for your help!

br = BasicNewsRecipe.get_browser(self)
if self.username is not None and self.password is not None:
br.open('https://www.mediapart.fr/login')
br.select_form(predicate=is_form_login)
br['name'] = self.username
br['password'] = self.password
br.submit()
return br

Quote:

Originally Posted by unkn0wn

I want you to test this with your login id and password.

I just removed parse_feeds and replaced it with google feeds links.

unkn0wn · 03-21-2023, 07:04 AM

hmm.. you can also do it that way, just put details in between quotes

br['name'] = 'sergio@some.com'
br['password'] = 'abcdef'

or you can load this recipe, and then choose fetch news and choose the added recipe and add login details there.

SergioS · 03-21-2023, 09:40 AM

Thank you! Now the login and password are successfully inputed, so a epub file is put together by the recipe. However, only the titles of articles are pulled, so their texts are absent. For example, a page under its title says, <<This article was downloaded by calibre from https://news.google.com/rss/articles/CBMicWh0dHBzOi8vd3d3Lm1lZGlhcGFydC5mci9qb3VybmFsL2 ludGVybmF0aW9uYWwvMjAwMzIzL2VuLWlyYWstbGEtYm9tYmUt cmV0YXJkZW1lbnQtZGVzLWVuZmFudHMtYXBhdHJpZGVzLWRlLW RhZWNo0gEA?oc=5>>. Do you think you can take a look it this again please? Thank you so much again!

unkn0wn · 03-21-2023, 11:52 AM

I think the method i told above was wrong.

I made subscription as optional to test it.
So after you load recipe into calibre (remove the present recipe and load it again) and save it, go to fetch news and choose the mediapart recipe in custom source and enter your Account details there and try fetching recipe again.

if self.username is not None and self.password is not None:
Due to this part the method i told before wont work.

07-31-2022, 12:12 PM	#20
hmag Junior Member Posts: 1 Karma: 20 Join Date: Jul 2022 Device: none	Pb with authors Hi all, I tried to update the recipe (which now works fine - at least for me) but I can't have the authors properly shown in the epub, whereas they seems OK in the "feeds" object... Maybe I'll publish anyway the changes to github even without the authors... Regards, Hervé

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Subscribing in Mediapart [new] recipe don't work	j33p	Recipes	1	09-14-2020 09:14 AM
PRS-T1 Recovery Mode doesn't work anymore	bookp	Sony Reader Dev Corner	2	07-13-2012 06:13 PM
Connect to itunes for Calibre doesn't work anymore	Marquis	Apple Devices	9	02-18-2012 07:21 PM
DIE ZEIT Premium recipe doesn't work anymore	Moik	Recipes	1	07-16-2011 01:46 PM
Downloading a cover doesn't work anymore?	JGB	Calibre	13	12-05-2008 01:40 PM

04-10-2022, 04:12 AM	#16
pyjamarama Junior Member Posts: 2 Karma: 10 Join Date: Apr 2022 Device: kobo libra	hi dear all, i am new to calibre, and i tried using the latest github recipe to fetch mediapart news (this on https://github.com/kovidgoyal/calibr...diapart.recipe) in the custom fetch news menu, but it just won't work. is there any update i missed? thank you for your help !

04-28-2022, 12:06 PM	#17
MoloBolo Junior Member Posts: 8 Karma: 10 Join Date: Nov 2021 Device: Kobo Libra H20	I'm a bit late but in case you're still here, the website changed (again) so the recipe needs to be updated. I don't think it was since my last post and I personally can't do it so you can try or wait in case someone else does. I use "feedbro" and "ePub Creator" extensions to download the daily articles.

05-07-2022, 12:10 PM	#18
loic2000 Junior Member Posts: 4 Karma: 16 Join Date: Dec 2020 Device: Kindle 10th Generation	Sorry for the late reply. I finally had time to look into this and a major problem is that Mediapart changed the way they structured articles data on their webpage. It would take a lot of time to change the recipe to adapt it to the current version of the website. And even if I change the recipe, the same may occur again in a couple of months. I will contact Mediapart and ask them if they can provide a more reliable way to access their article data (through a restAPI) so I could write a robust version of the recipe. At the same time, do not hesitate to contact Mediapart and ask them also if they could provide their article under an API so we could have a more robust recipe. I will let you know here when I hear from them.

05-12-2022, 03:30 PM	#19
MoloBolo Junior Member Posts: 8 Karma: 10 Join Date: Nov 2021 Device: Kobo Libra H20	Thanks !!

03-20-2023, 08:10 PM	#25
SergioS Junior Member Posts: 4 Karma: 10 Join Date: Mar 2023 Device: KOBO Forma	Hi there, Does anyone has a recipe that allows downloading news from Mediapart please? I have tried more than an hour to figure out what can be done, as a beginner, and all is foreign to me. Despite I put in my account and password, an error message pops up, it says "InputFormatPlugin: Recipe Input running Downloading recipe urn: builtin:mediapart Trying to get latest version of recipe: mediapart Using user agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/80.0.3987.87 Safari/537.36 Traceback (most recent call last): File "runpy.py", line 196, in _run_module_as_main File "runpy.py", line 86, in _run_code File "site.py", line 41, in <module> File "site.py", line 37, in main File "calibre/utils/ipc/worker.py", line 215, in main File "calibre/gui2/convert/gui_conversion.py", line 31, in gui_convert_recipe File "calibre/gui2/convert/gui_conversion.py", line 25, in gui_convert File "calibre/ebooks/conversion/plumber.py", line 1108, in run File "calibre/customize/conversion.py", line 242, in __call__ File "calibre/ebooks/conversion/plugins/recipe_input.py", line 138, in convert File "calibre/web/feeds/news.py", line 1056, in download File "calibre/web/feeds/news.py", line 1233, in build_index File "<string>", line 76, in parse_feeds File "<string>", line 230, in my_parse_index File "<string>", line 135, in get_articles AttributeError: 'NoneType' object has no attribute 'find' " Thank you !

03-21-2023, 07:04 AM	#28
unkn0wn Evangelist Posts: 445 Karma: 82686 Join Date: May 2021 Device: kindle	hmm.. you can also do it that way, just put details in between quotes br['name'] = 'sergio@some.com' br['password'] = 'abcdef' or you can load this recipe, and then choose fetch news and choose the added recipe and add login details there.

03-21-2023, 09:40 AM	#29
SergioS Junior Member Posts: 4 Karma: 10 Join Date: Mar 2023 Device: KOBO Forma	Thank you! Now the login and password are successfully inputed, so a epub file is put together by the recipe. However, only the titles of articles are pulled, so their texts are absent. For example, a page under its title says, <<This article was downloaded by calibre from https://news.google.com/rss/articles/CBMicWh0dHBzOi8vd3d3Lm1lZGlhcGFydC5mci9qb3VybmFsL2 ludGVybmF0aW9uYWwvMjAwMzIzL2VuLWlyYWstbGEtYm9tYmUt cmV0YXJkZW1lbnQtZGVzLWVuZmFudHMtYXBhdHJpZGVzLWRlLW RhZWNo0gEA?oc=5>>. Do you think you can take a look it this again please? Thank you so much again!

03-21-2023, 11:52 AM	#30
unkn0wn Evangelist Posts: 445 Karma: 82686 Join Date: May 2021 Device: kindle	I think the method i told above was wrong. I made subscription as optional to test it. So after you load recipe into calibre (remove the present recipe and load it again) and save it, go to fetch news and choose the mediapart recipe in custom source and enter your Account details there and try fetching recipe again. if self.username is not None and self.password is not None: Due to this part the method i told before wont work.

Advert

Advert