profile config for LOG_FORMAT and LOG_LEVEL

[dbrtly]

Is this your first time submitting a feature request?

• I have read the expectations for open source contributors
• I have searched the existing issues, and I could not find an existing issue for this feature
• I am requesting a straightforward extension of existing dbt functionality, rather than a Big Idea better suited to a discussion

Describe the feature

We can set log level and format with extra command line arguments.

To reduce the verbosity, I’d like to set them once in profiles.yml

Describe alternatives you've considered

Adding them to every command.

Who will this benefit?

Users who want more efficient, production-grade logging.

my-warehouse-db:
  target: dev
  outputs:
    dev:
      config:
        log_format: json
        log_level: warn

Or

my-warehouse-db:
  target: dev
  outputs:
    dev:
      config:
        log:
          format: json
          level: warn

and then no need for:

dbt --log-format json --log-level warn run

Are you interested in contributing this feature?

If you can point me in the direction, I’ll give it a shot

Anything else?

No response

[dbeatty10]

Thanks for opening @dbrtly!

This is actually already possible -- you'd just do this in your profiles.yml:

Important

These are being deprecated from profiles.yml and moving to dbt_project.yml starting in in dbt-core 1.8.

See dbt-labs/docs.getdbt.com#4814 for in-progress documentation updates

# profiles.yml

config:
  log_format: json
  log_level: info

  # # or these configs which apply ONLY to the log file
  # log_format_file: json
  # log_level_file: info

my-warehouse-db:
  target: dev
  outputs:
    dev:
    # ...

Environment variables

You can also use any of these environment variables instead of profiles.yml or their associated CLI flags (--log-format, --log-format-file, --log-level , --log-level-file):

• DBT_LOG_FORMAT
• DBT_LOG_FORMAT_FILE
• DBT_LOG_LEVEL
• DBT_LOG_LEVEL_FILE

Summary

Since this is already possible we're going to close this in favor of these documentation updates:

• Table of global configs (user configs, env var, and cli flag) docs.getdbt.com#4366
• config: in profiles.yml -> flags: in dbt_project.yml docs.getdbt.com#4709

[dbrtly]

Thanks for clarifying. This functionality was unclear to me by reading the documentation alone.

[dbeatty10]

Thanks for clarifying. This functionality was unclear to me by reading the documentation alone.

Sure thing, @dbrtly 👍

We'll try to make some updates to the documentation so that the different options are more clear.