Yahoo Finance stops working #136

seg-on · 2024-10-28T19:49:00Z

Hi,
It seems that after updating HA to 2024.10.4, Yahoo Finance stops working.
I've tried rebooting HA, rebooting PC but it doesn't help.

iprak · 2024-10-29T10:13:09Z

I need more info.

You can also enable debug level logging to capture more data

  logs:
    custom_components.yahoofinance: debug

seg-on · 2024-10-29T10:34:51Z

Hi,
you mean this?

2024-10-29 10:20:23.636 ERROR (MainThread) [custom_components.yahoofinance.coordinator] Timed out getting crumb. 
2024-10-29 10:20:23.637 WARNING (MainThread) [custom_components.yahoofinance] Unable to get crumb, re-trying in 15 seconds
2024-10-29 10:20:53.640 ERROR (MainThread) [custom_components.yahoofinance.coordinator] Timed out getting crumb. 
2024-10-29 10:20:53.641 WARNING (MainThread) [custom_components.yahoofinance] Unable to get crumb, re-trying in 15 seconds
2024-10-29 10:21:23.645 ERROR (MainThread) [custom_components.yahoofinance.coordinator] Timed out getting crumb. 
2024-10-29 10:21:23.645 WARNING (MainThread) [custom_components.yahoofinance] Unable to get crumb, re-trying in 15 seconds
2024-10-29 10:21:53.649 ERROR (MainThread) [custom_components.yahoofinance.coordinator] Timed out getting crumb. 
2024-10-29 10:21:53.649 WARNING (MainThread) [custom_components.yahoofinance] Unable to get crumb, re-trying in 15 seconds
2024-10-29 10:22:23.654 ERROR (MainThread) [custom_components.yahoofinance.coordinator] Timed out getting crumb. 
2024-10-29 10:22:23.654 WARNING (MainThread) [custom_components.yahoofinance] Unable to get crumb, re-trying in 15 seconds
2024-10-29 10:22:53.659 ERROR (MainThread) [custom_components.yahoofinance.coordinator] Timed out getting crumb. 
2024-10-29 10:22:53.660 WARNING (MainThread) [custom_components.yahoofinance] Unable to get crumb, re-trying in 15 seconds
2024-10-29 10:23:23.662 ERROR (MainThread) [custom_components.yahoofinance.coordinator] Timed out getting crumb. 
2024-10-29 10:23:23.663 WARNING (MainThread) [custom_components.yahoofinance] Unable to get crumb, re-trying in 15 seconds
2024-10-29 10:23:53.665 ERROR (MainThread) [custom_components.yahoofinance.coordinator] Timed out getting crumb. 
2024-10-29 10:23:53.665 WARNING (MainThread) [custom_components.yahoofinance] Unable to get crumb, re-trying in 15 seconds
2024-10-29 10:24:23.669 ERROR (MainThread) [custom_components.yahoofinance.coordinator] Timed out getting crumb. 
2024-10-29 10:24:23.669 WARNING (MainThread) [custom_components.yahoofinance] Unable to get crumb, re-trying in 15 seconds
2024-10-29 10:24:38.671 DEBUG (MainThread) [custom_components.yahoofinance.coordinator] Navigating to base Yahoo page

iprak · 2024-10-29T12:41:17Z

Yes, this has happened when the Yahoo website returns different data. Usually due to GDPR consent. What is your location and the url of the Yahoo website (if opened in a browser) ?

seg-on · 2024-10-29T14:18:49Z

Yes, I'm from Slovakia (part of EU). I don't understand what you mean by Yahoo website URL? When I type finance.yahoo.com I get https://finance.yahoo.com/.

iprak · 2024-10-29T18:36:42Z

This is most likely due to something specific in Yahoo content for that region. Seem other folks from EU region have encountered this (#125). The extension tries to automatically accept the GDPR consent and maybe that is not working. Not sure at this point. This should not be related to 2024.10.4 release.

seg-on · 2024-10-29T20:53:30Z

It is strange, but now at 18:11 it has started to work.
I'll be watching that.

vellanix · 2024-10-30T07:35:22Z

Also here (Italy) doesnt work from yesterday afternoon.

Same error: Unable to get crumb

rummepa · 2024-10-30T09:17:56Z

same thing here in Belgium:

Logger: custom_components.yahoofinance
Source: custom_components/yahoofinance/init.py:241
integration: Yahoo Finance (documentation, issues)
First occurred: October 29, 2024 at 21:03:19 (3155 occurrences)
Last logged: 10:17:09
Unable to get crumb, re-trying in 15 seconds

jan-jeroen · 2024-10-30T21:44:25Z

Same here in the Netherlands since last weekend. Unable to get crumb.

iprak · 2024-10-31T02:33:41Z

The release 1.2.11 should help.

jan-jeroen · 2024-10-31T06:23:11Z

The release 1.2.11 should help.

Confirmed! Many thanks

seg-on · 2024-10-31T19:54:55Z

I'm sad. I updated to this version and after that it stopped working :(

iprak · 2024-10-31T20:11:31Z

Can you share debug log?

seg-on · 2024-10-31T20:45:21Z

here you are:

2024-10-31 20:39:45.002 WARNING (MainThread) [custom_components.yahoofinance.coordinator] Error obtaining data, retrying in 20 seconds
2024-10-31 20:40:15.002 ERROR (MainThread) [custom_components.yahoofinance.coordinator] Timed out getting data from https://query1.finance.yahoo.com/v7/finance/quote?symbols=EURUSD=X,GC=F,ES=F,MNQ=F,^VIX,CL=F,TTF=F,^GSPC,^NDX,SXR8.DE,BTC-USD,BTC-EUR,XMR-EUR&crumb=FKbLQWwD20B
2024-10-31 20:40:15.002 WARNING (MainThread) [custom_components.yahoofinance.coordinator] Error obtaining data, retrying in 20 seconds
2024-10-31 20:40:45.002 ERROR (MainThread) [custom_components.yahoofinance.coordinator] Timed out getting data from https://query1.finance.yahoo.com/v7/finance/quote?symbols=EURUSD=X,GC=F,ES=F,MNQ=F,^VIX,CL=F,TTF=F,^GSPC,^NDX,SXR8.DE,BTC-USD,BTC-EUR,XMR-EUR&crumb=FKbLQWwD20B
2024-10-31 20:40:45.003 WARNING (MainThread) [custom_components.yahoofinance.coordinator] Error obtaining data, retrying in 20 seconds
2024-10-31 20:41:15.002 ERROR (MainThread) [custom_components.yahoofinance.coordinator] Timed out getting data from https://query1.finance.yahoo.com/v7/finance/quote?symbols=EURUSD=X,GC=F,ES=F,MNQ=F,^VIX,CL=F,TTF=F,^GSPC,^NDX,SXR8.DE,BTC-USD,BTC-EUR,XMR-EUR&crumb=FKbLQWwD20B
2024-10-31 20:41:15.002 WARNING (MainThread) [custom_components.yahoofinance.coordinator] Error obtaining data, retrying in 20 seconds
2024-10-31 20:41:45.002 ERROR (MainThread) [custom_components.yahoofinance.coordinator] Timed out getting data from https://query1.finance.yahoo.com/v7/finance/quote?symbols=EURUSD=X,GC=F,ES=F,MNQ=F,^VIX,CL=F,TTF=F,^GSPC,^NDX,SXR8.DE,BTC-USD,BTC-EUR,XMR-EUR&crumb=FKbLQWwD20B
2024-10-31 20:41:45.002 WARNING (MainThread) [custom_components.yahoofinance.coordinator] Error obtaining data, retrying in 20 seconds
2024-10-31 20:42:15.002 ERROR (MainThread) [custom_components.yahoofinance.coordinator] Timed out getting data from https://query1.finance.yahoo.com/v7/finance/quote?symbols=EURUSD=X,GC=F,ES=F,MNQ=F,^VIX,CL=F,TTF=F,^GSPC,^NDX,SXR8.DE,BTC-USD,BTC-EUR,XMR-EUR&crumb=FKbLQWwD20B
2024-10-31 20:42:15.003 WARNING (MainThread) [custom_components.yahoofinance.coordinator] Error obtaining data, retrying in 20 seconds
2024-10-31 20:42:45.002 ERROR (MainThread) [custom_components.yahoofinance.coordinator] Timed out getting data from https://query1.finance.yahoo.com/v7/finance/quote?symbols=EURUSD=X,GC=F,ES=F,MNQ=F,^VIX,CL=F,TTF=F,^GSPC,^NDX,SXR8.DE,BTC-USD,BTC-EUR,XMR-EUR&crumb=FKbLQWwD20B
2024-10-31 20:42:45.003 WARNING (MainThread) [custom_components.yahoofinance.coordinator] Error obtaining data, retrying in 20 seconds
2024-10-31 20:42:47.202 ERROR (MainThread) [custom_components.weatherdotcom.coordinator] Error fetching Weather.com data: TimeoutError()
2024-10-31 20:43:05.001 DEBUG (MainThread) [custom_components.yahoofinance.coordinator] Requesting data from 'https://query1.finance.yahoo.com/v7/finance/quote?symbols=EURUSD=X,GC=F,ES=F,MNQ=F,^VIX,CL=F,TTF=F,^GSPC,^NDX,SXR8.DE,BTC-USD,BTC-EUR,XMR-EUR&crumb=FKbLQWwD20B'

iprak · 2024-10-31T23:54:26Z

@seg-on I think you have some other problem. The log indicates similar failure for weatherdotcom.coordinator data fetch.

Everything seems to check out from my end when using VPN to fake European source.

jan-jeroen · 2024-11-01T13:06:03Z

My problem is back since yesterday, the new version worked for about a day.

2024-11-01 14:04:18.872 WARNING (MainThread) [custom_components.yahoofinance] Unable to get crumb, re-trying in 15 seconds
2024-11-01 14:04:33.966 WARNING (MainThread) [custom_components.yahoofinance] Unable to get crumb, re-trying in 15 seconds
2024-11-01 14:04:49.072 WARNING (MainThread) [custom_components.yahoofinance] Unable to get crumb, re-trying in 15 seconds

iprak · 2024-11-02T01:51:42Z

I am not hopeful of addressing this issue. I am not able to replicate this over VPN. But I have pushed out another release with more logging.

jan-jeroen · 2024-11-02T09:03:33Z

Installed your new release. This is what I get:

2024-11-02 10:01:41.962 ERROR (MainThread) [custom_components.yahoofinance.coordinator] Crumb request responded with status=404
2024-11-02 10:01:41.963 WARNING (MainThread) [custom_components.yahoofinance] Unable to get crumb, re-trying in 15 seconds
2024-11-02 10:01:57.137 ERROR (MainThread) [custom_components.yahoofinance.coordinator] Crumb request responded with status=404
2024-11-02 10:01:57.138 WARNING (MainThread) [custom_components.yahoofinance] Unable to get crumb, re-trying in 15 seconds

seg-on · 2024-11-02T13:04:56Z

Yahoo Finance ver: 1.2.12

2024-11-02 13:03:30.003 ERROR (MainThread) [custom_components.yahoofinance.coordinator] Timed out getting data from https://query1.finance.yahoo.com/v7/finance/quote?symbols=EURUSD=X,GC=F,ES=F,MNQ=F,^VIX,CL=F,TTF=F,^GSPC,^NDX,SXR8.DE,BTC-USD,BTC-EUR,XMR-EUR&crumb=N1QwNF/tiD5
2024-11-02 13:03:30.004 WARNING (MainThread) [custom_components.yahoofinance.coordinator] Error obtaining data, retrying in 20 seconds

iprak · 2024-11-02T14:41:06Z

I have attempted one more fix. It has been trouble some to even replicate this issue which could be due to how my VPN connection is directing traffic or perhaps I am getting the same remote address.

Sorry but I won't be able to look into this. One can however fork the project and implement/support this elsewhere.

It was not my intention for the integration to be completely usable outside US. It would be difficult to continuously bypass GDPS restrictions to account for changes. This will also definitely make it not acceptable as a core integration in HomeAssistant which is what I eventually want it to be.

seg-on · 2024-11-06T21:51:41Z

Hi @iprak,
I found out that API v6 is working for me (I am using a AppScript in Google Sheets that use this API to get stock data).
Can you look if there is the big difference between V7 you are using and V6? If it is not possible to port to V6?
https://query2.finance.yahoo.com/v6/finance/options/
https://query2.finance.yahoo.com/v6/finance/options/aapl

iprak · 2024-11-07T01:35:03Z

The Yahoo end points are undocumented, this integration is based on my trial an error. v7 url is what is used when accessing finance.yahoo.com from US location, so I cannot tell how is v6 different. One would think that v7 is newer.

I get 404 when using v6
Received status 404 (Not Found HTTP 404 Not Found) for https://query1.finance.yahoo.com/v6/finance/quote?symbols=ISTNX,GBPUSD=X,IDFCBANK.BO,BABA,^SSMI,EMIM.L,AAPL,USDINR=X,ADYEN.AS&crumb=hLovZgIrG10

Something like this happened in May 2023 (#96) where v6 version was successful temporarily. You can locally change to use v6 but I won't be able to make that part of the integration.

nexusis7 · 2024-11-19T15:19:50Z

This has stopped working this mornin.

2024-11-19 10:03:30.129 ERROR (MainThread) [custom_components.yahoofinance.coordinator] Received status 401 (Unauthorized User is unable to access this feature - https://bit.ly/yahoo-finance-api-feedback

Says API has been disabled

website gives the following message

{"finance":{"result":null,"error":{"code":"Unauthorized","description":"User is unable to access this feature - https://bit.ly/yahoo-finance-api-feedback"}}}

applegeeks · 2024-11-19T23:26:24Z

This has stopped working this mornin.

2024-11-19 10:03:30.129 ERROR (MainThread) [custom_components.yahoofinance.coordinator] Received status 401 (Unauthorized User is unable to access this feature - https://bit.ly/yahoo-finance-api-feedback

Says API has been disabled

website gives the following message

{"finance":{"result":null,"error":{"code":"Unauthorized","description":"User is unable to access this feature - https://bit.ly/yahoo-finance-api-feedback"}}}

seems to be up and running again.

nexusis7 · 2024-11-19T23:47:17Z

yes can confirm it’s working again

iprak · 2024-11-20T00:13:46Z

This seems to be more of a Yahoo end point issue. What country is this?

nexusis7 · 2024-11-20T00:30:46Z

I’m in Canada.

iprak · 2024-11-20T00:42:22Z

I will give it a test using VPN.

applegeeks · 2024-11-20T01:10:32Z

I’m in Canada.

Australia here.

vPotusFlotus · 2024-11-20T14:09:49Z

This has stopped working this mornin.

2024-11-19 10:03:30.129 ERROR (MainThread) [custom_components.yahoofinance.coordinator] Received status 401 (Unauthorized User is unable to access this feature - https://bit.ly/yahoo-finance-api-feedback

Says API has been disabled

website gives the following message

{"finance":{"result":null,"error":{"code":"Unauthorized","description":"User is unable to access this feature - https://bit.ly/yahoo-finance-api-feedback"}}}

I receive the same error as stated above (from Belgium). Seems that API Access to Yahoo Finance Quotes might be disabled?

Seems they potentially want to make it a paid service:

At least that's what the URL states from the Error Message: https://bit.ly/yahoo-finance-api-feedback

spacelama · 2024-12-04T12:01:30Z

Might be an idea to change the wording on the readme away from "This integration will most only work in US mainland. GDPR requirements seems to be causing requests to fail". If it is a GDPR problem, it's more likely it'll work everywhere but Europe, as opposed to only working in the US.

It is currently working in Australia. But I briefly rolled back to 1.2.10 when it appeared it wasn't working (actually a config I broke at the same time), then noticed the wording indicating a change and problem in 1.2.12, thus indicating to me that I'd have more luck with the version I had from my backups.

iprak mentioned this issue Oct 31, 2024

Better handling of gdpr #137

Merged

arrikhan mentioned this issue Nov 20, 2024

API-level access to Yahoo Finance quotes data has been disabled #146

Open

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Yahoo Finance stops working #136

Yahoo Finance stops working #136

seg-on commented Oct 28, 2024

iprak commented Oct 29, 2024

seg-on commented Oct 29, 2024

iprak commented Oct 29, 2024

seg-on commented Oct 29, 2024

iprak commented Oct 29, 2024

seg-on commented Oct 29, 2024

vellanix commented Oct 30, 2024

rummepa commented Oct 30, 2024

jan-jeroen commented Oct 30, 2024 •

edited

Loading

iprak commented Oct 31, 2024

jan-jeroen commented Oct 31, 2024

seg-on commented Oct 31, 2024

iprak commented Oct 31, 2024

seg-on commented Oct 31, 2024

iprak commented Oct 31, 2024

jan-jeroen commented Nov 1, 2024

iprak commented Nov 2, 2024

jan-jeroen commented Nov 2, 2024

seg-on commented Nov 2, 2024

iprak commented Nov 2, 2024

seg-on commented Nov 6, 2024

iprak commented Nov 7, 2024 •

edited

Loading

nexusis7 commented Nov 19, 2024

applegeeks commented Nov 19, 2024

nexusis7 commented Nov 19, 2024

iprak commented Nov 20, 2024

nexusis7 commented Nov 20, 2024

iprak commented Nov 20, 2024

applegeeks commented Nov 20, 2024

vPotusFlotus commented Nov 20, 2024 •

edited

Loading

spacelama commented Dec 4, 2024

Yahoo Finance stops working #136

Yahoo Finance stops working #136

Comments

seg-on commented Oct 28, 2024

iprak commented Oct 29, 2024

seg-on commented Oct 29, 2024

iprak commented Oct 29, 2024

seg-on commented Oct 29, 2024

iprak commented Oct 29, 2024

seg-on commented Oct 29, 2024

vellanix commented Oct 30, 2024

rummepa commented Oct 30, 2024

jan-jeroen commented Oct 30, 2024 • edited Loading

iprak commented Oct 31, 2024

jan-jeroen commented Oct 31, 2024

seg-on commented Oct 31, 2024

iprak commented Oct 31, 2024

seg-on commented Oct 31, 2024

iprak commented Oct 31, 2024

jan-jeroen commented Nov 1, 2024

iprak commented Nov 2, 2024

jan-jeroen commented Nov 2, 2024

seg-on commented Nov 2, 2024

iprak commented Nov 2, 2024

seg-on commented Nov 6, 2024

iprak commented Nov 7, 2024 • edited Loading

nexusis7 commented Nov 19, 2024

applegeeks commented Nov 19, 2024

nexusis7 commented Nov 19, 2024

iprak commented Nov 20, 2024

nexusis7 commented Nov 20, 2024

iprak commented Nov 20, 2024

applegeeks commented Nov 20, 2024

vPotusFlotus commented Nov 20, 2024 • edited Loading

spacelama commented Dec 4, 2024

jan-jeroen commented Oct 30, 2024 •

edited

Loading

iprak commented Nov 7, 2024 •

edited

Loading

vPotusFlotus commented Nov 20, 2024 •

edited

Loading