Add Sentry logs to all backend components

[peterdudfield]

Detailed Description

It would be great to have sentry logs in all back end components

Context

• good to have logs all going to one palce

Possible Implementation

SImilar to the api

https://github.com/openclimatefix/pv-site-api/blob/main/pv_site_api/main.py#L89C1-L93C2

def traces_sampler(sampling_context):
    """
    Filter tracing for sentry logs.

    Examine provided context data (including parent decision, if any)
    along with anything in the global namespace to compute the sample rate
    or sampling decision for this transaction
    """

    if os.getenv("ENVIRONMENT") == "local":
        return 0.0
    elif "error" in sampling_context["transaction_context"]["name"]:
        # These are important - take a big sample
        return 1.0
    elif sampling_context["parent_sampled"] is True:
        # These aren't something worth tracking - drop all transactions like this
        return 0.0
    else:
        # Default sample rate
        return 0.05

sentry_sdk.init(
    dsn=os.getenv("SENTRY_DSN"),
    environment=os.getenv("ENVIRONMENT", "local"),
    traces_sampler=traces_sampler,
)

this bit of code needs to sit at the start of the main app, and sentry_sdk be added to the requirements file

• add SENTRY_DSN into infrastructure code, and ENVIRONMENT

component	code ready	dev	pro
GSP Consumer	yes 1.1.19	yes	yes
NWP Consumer	yes 0.5.28	yes
Satellite Consumer	yes	2.12.8 yes	yes
uk-pvnet-app	yes	yes 2.4.1 Not working
pvnet app DA	yes	yes 2.4.1 Not working
National xg	yes	1.0.38 yes	yes
forecast sites	yes 1.0.10	yes	yes
blend	yes	yes 1.0.2	yes
Metrics	yes 1.2.21	yes	yes
UK GPS api	yes	yes	yes
UK sites api	yes	yes	yes
India api	yes 1.0.41	yes	yes
india ruvnl consumer 0.1.12	yes	yes	yes
india forecast	yes TODO add version and name	yes	yes
india satellite	yes 2.12.8	yes	yes
india nwp	yes 0.5.28	yes
PVConsumer	yes	yes 2.1.0

[peterdudfield]

@braddf I've put this here, as other people might be able to contribute to this

[peterdudfield]

Ive tested the above code in the india-forecast-app, so it can be rolled out to other repos now

[Plomo-02]

hello, can I be assigned to this issue?

[Plomo-02]

@peterdudfield can I have more info about the sentry_sdk version repos need?

[peterdudfield]

what do you mean version?

https://github.com/openclimatefix/india-forecast-app/pull/75/files this is a good example of what would be great to do to the other repos

[peterdudfield]

for GSPConumer - openclimatefix/GSPConsumer#76

[peterdudfield]

openclimatefix/Satip#280

[peterdudfield]

Here's a good example - openclimatefix/uk-pvnet-app#125

[peterdudfield]

A nice simple way to do this is (this should be put in the main app)

import sentry_sdk
import os

sentry_sdk.init(
    dsn=os.getenv("SENTRY_DSN", ""),
    environment=f'{os.getenv("ENVIRONMENT", "local")}',
    traces_sample_rate=1.0,
    profiles_sample_rate=1.0,
)
sentry_sdk.set_tag("app_name", APP_NAME)
sentry_sdk.set_tag("version", VERSION)

[peterdudfield]

Currently deployed on uk-pvnet-app on development, but errors not showing up in sentry. Weird