request a recipe-bloomberg - Page 2

unkn0wn · 10-30-2022, 05:24 AM

this weeks businessweek has only one article and its not needed to load from json.

Update.. small changes.

also increasing delay to 2 or 3 seconds might work.. some people with super fast internet might be facing issues! I dont see any problems from my side.

Also I forgot to remove masthead of businesssweek in bloomberg feed based recipe.

fengli · 10-30-2022, 06:46 AM

Quote:

Originally Posted by unkn0wn

this weeks businessweek has only one article and its not needed to load from json.

Update.. small changes.

also increasing delay to 2 or 3 seconds might work.. some people with super fast internet might be facing issues! I dont see any problems from my side.

Also I forgot to remove masthead of businesssweek in bloomberg feed based recipe.

Amazing, the capture was successful, can't thank too much

unkn0wn · 11-23-2022, 02:14 AM

bloomberg and other minor updates.. still in my custom recipes.

fengli · 11-24-2022, 04:55 AM

Big Brother is awesome, kudos!

hongho71 · 02-03-2023, 11:09 PM

Bloomberg recipe failing. Any updates? Thanks!

unkn0wn · 02-04-2023, 01:05 AM

looks like all google feeds are going to a redirecting page and then further redirects to the actual link.. if javascript is disabled it doesn't redirect to the desired page.

it explains the other post with all those google feed links.

UPADTED

hongho71 · 02-04-2023, 12:15 PM

Tried the updated Bloomberg.recipe. Used VPN. The first time I tried it, it only captured 20% of the articles. Changed VPN address and it captured 80% of the articles. So, it looks like it is IP dependent or you need to space out the time between download periods. Thanks!

hongho71 · 03-10-2023, 12:14 AM

Articles fail to download after 7% progress. Switching VPN address doesn't seem to help. Anything else can be done to get all the articles?

unkn0wn · 03-10-2023, 02:50 AM

maybe you removed "delay" in the recipe, try again using built in recipe.

With the delay set to 1.5 it usually takes some 15 minutes to fetch all articles.

If you are already using the built in recipe and facing this, maybe try again by increasing delay to 2 seconds.

Edit: I just tested the built in recipe. It took some 20+ minutes to load all articles, using Singapore as VPN location.

hongho71 · 03-15-2023, 10:41 PM

Used the built in recipe as suggested. My finding is that it is VPN address dependent. Certain VPN addresses, it only downloads a few articles and starts failing to retrieve the rest of the articles. Another VPN address, it downloads all the articles. I also messed around with the delay and it didn't make any difference for me. Only changing the VPN address works. I have one VPN address that works great so far.

unkn0wn · 03-16-2023, 09:30 AM

Quote:

Originally Posted by hongho71

Used the built in recipe as suggested. My finding is that it is VPN address dependent. Certain VPN addresses, it only downloads a few articles and starts failing to retrieve the rest of the articles. Another VPN address, it downloads all the articles. I also messed around with the delay and it didn't make any difference for me. Only changing the VPN address works. I have one VPN address that works great so far.

you can actually download from your own ip address without the need for VPN. I was able to fetch this everyday, for a week without any problem from my own ip.

VPN is only required if your ip is blocked for some reason. If you remove delay, your ip will immediately be blocked for the rest of the day or two.

I think you can also use your mobile internet (usb tether or hotspot) as ip addresses are randomly assigned and keeps changing.

mkgtu · 05-01-2023, 10:19 PM

Failing to download any articles.
Got it to work one day last week, but nothing since.
Tried it today using a VPN and it worked once (for 16 articles plus a bunch failed), Tried several more times with no VPN, and again with different VPN addresses (New York, Manchester UK) and all those failed.

So it seems pretty hit and miss at best.

I need t use my own IP because I have 5 other feeds that download automatically early every morning and are emailed to my Kindle, along with many others that monthly/weekly. So I'd hate to have to turn the VPN on every night just for the morning downloads - and never remember to turn it off! Don't know how the VPN would affect other feeds. Not sure if I'd have to keep changing the VPN just for Bloomberg.

So I guess I'm out of luck unless it can be more consistent.

unkn0wn · 05-03-2023, 02:15 AM

maybe the VPN you are using is detected [I use IP Vanish, with Singapore or India]. They have these IP's flagged, this usually happens with streaming services but idk.

Anyhow I just checked again without VPN & all articles are loading. Maybe don't automate the recipe, Just do it manually use your mobile hotspot or USB tethering whenever you are with the device.

Quote:

Originally Posted by mkgtu

Tried it today using a VPN and it worked once (for 16 articles plus a bunch failed), Tried several more times with no VPN, and again with different VPN addresses (New York, Manchester UK) and all those failed.

The Bloomberg recipe I just tried usually has some 70 articles everyday and all of them fetched. (the recipe is setup to skips video links though)

You can automate the Bloomberg Businessweek without VPN as it needs working only once a week and the articles are <20.

I'd suggest you to increase the delay to 2 seconds (maybe its a location issue, in my country 1.5 works) and try with mobile hotspot (if you want to switch IP just switch to airplane mode and back).

This is a part of my log, you can see the article numbered and all.

Spoiler:

03-10-2023, 02:50 AM	#24
unkn0wn Evangelist Posts: 444 Karma: 82686 Join Date: May 2021 Device: kindle	maybe you removed "delay" in the recipe, try again using built in recipe. With the delay set to 1.5 it usually takes some 15 minutes to fetch all articles. If you are already using the built in recipe and facing this, maybe try again by increasing delay to 2 seconds. Edit: I just tested the built in recipe. It took some 20+ minutes to load all articles, using Singapore as VPN location. Last edited by unkn0wn; 03-10-2023 at 03:05 AM.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Bloomberg Recipe - Only Renders First Article	papermadeblues	Recipes	2	02-04-2023 01:00 AM
Request - Bloomberg.com Recipe	SunLight	Recipes	5	10-07-2015 09:02 PM
Recipe request for bloomberg.com	djdag	Recipes	0	06-24-2011 02:14 PM
Recipe request please	aessedai44	Recipes	2	10-06-2010 01:07 AM
Request for recipe	exdream	Calibre	3	04-24-2010 10:13 AM

11-24-2022, 04:55 AM	#19
fengli Connoisseur Posts: 80 Karma: 10 Join Date: Aug 2022 Device: PC	Big Brother is awesome, kudos!

02-03-2023, 11:09 PM	#20
hongho71 Enthusiast Posts: 36 Karma: 10 Join Date: Feb 2015 Device: Kindle Paperwhite	Bloomberg recipe failing. Any updates? Thanks!

02-04-2023, 12:15 PM	#22
hongho71 Enthusiast Posts: 36 Karma: 10 Join Date: Feb 2015 Device: Kindle Paperwhite	Tried the updated Bloomberg.recipe. Used VPN. The first time I tried it, it only captured 20% of the articles. Changed VPN address and it captured 80% of the articles. So, it looks like it is IP dependent or you need to space out the time between download periods. Thanks!

03-10-2023, 12:14 AM	#23
hongho71 Enthusiast Posts: 36 Karma: 10 Join Date: Feb 2015 Device: Kindle Paperwhite	Articles fail to download after 7% progress. Switching VPN address doesn't seem to help. Anything else can be done to get all the articles?

03-15-2023, 10:41 PM	#25
hongho71 Enthusiast Posts: 36 Karma: 10 Join Date: Feb 2015 Device: Kindle Paperwhite	Used the built in recipe as suggested. My finding is that it is VPN address dependent. Certain VPN addresses, it only downloads a few articles and starts failing to retrieve the rest of the articles. Another VPN address, it downloads all the articles. I also messed around with the delay and it didn't make any difference for me. Only changing the VPN address works. I have one VPN address that works great so far.

05-01-2023, 10:19 PM	#27
mkgtu Zealot Posts: 129 Karma: 33000 Join Date: Feb 2010 Device: Currently:Voyage, Oasis 3, Kindle mobile apps, andKindle Fire	Failing to download any articles. Got it to work one day last week, but nothing since. Tried it today using a VPN and it worked once (for 16 articles plus a bunch failed), Tried several more times with no VPN, and again with different VPN addresses (New York, Manchester UK) and all those failed. So it seems pretty hit and miss at best. I need t use my own IP because I have 5 other feeds that download automatically early every morning and are emailed to my Kindle, along with many others that monthly/weekly. So I'd hate to have to turn the VPN on every night just for the morning downloads - and never remember to turn it off! Don't know how the VPN would affect other feeds. Not sure if I'd have to keep changing the VPN just for Bloomberg. So I guess I'm out of luck unless it can be more consistent.