Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

BQ Table does not support CustomTimeout #2642

Open
emfdavid opened this issue Nov 16, 2024 · 2 comments
Open

BQ Table does not support CustomTimeout #2642

emfdavid opened this issue Nov 16, 2024 · 2 comments
Labels
awaiting-upstream The issue cannot be resolved without action in another repository (may be owned by Pulumi). blocked The issue cannot be resolved without 3rd party action. kind/enhancement Improvements or new features

Comments

@emfdavid
Copy link

Describe what happened

When creating biglake tables over large collections the create table operation can timeout

  gcp:bigquery:Table (ami_predicted):
    error:   sdk-v2/provider2.go:520: sdk.helper_schema: Post "https://bigquery.googleapis.com/bigquery/v2/projects/.../tables?alt=json&prettyPrint=false": net/http: request canceled (Client.Timeout exceeded while awaiting headers): [email protected]
    error: 1 error occurred:
    	* Post "https://bigquery.googleapis.com/bigquery/v2/projects/.../tables?alt=json&prettyPrint=false": net/http: request canceled (Client.Timeout exceeded while awaiting headers)

I tried adding the CustomTimeout property to the resource but it doesn't support it.

 gcp:bigquery:Table (ami_predicted):
    warning: Resource does not support customTimeouts, ignoring: create=30m0s

Is this something that can be addd to all GCP sdk calls?

Sample program

No readily reproducible dataset...

Log output

  gcp:bigquery:Table (ami_predicted):
    error:   sdk-v2/provider2.go:520: sdk.helper_schema: Post "https://bigquery.googleapis.com/bigquery/v2/projects/.../tables?alt=json&prettyPrint=false": net/http: request canceled (Client.Timeout exceeded while awaiting headers): [email protected]
    error: 1 error occurred:
    	* Post "https://bigquery.googleapis.com/bigquery/v2/projects/.../tables?alt=json&prettyPrint=false": net/http: request canceled (Client.Timeout exceeded while awaiting headers)
 gcp:bigquery:Table (ami_predicted):
    warning: Resource does not support customTimeouts, ignoring: create=30m0s

Affected Resource(s)

gcp:bigquery:Table

Output of pulumi about

$ pulumi about
CLI
Version 3.127.0
Go Version go1.22.5
Go Compiler gc

Plugins
KIND NAME VERSION
resource command 0.11.1
resource gcp 8.9.1
resource grafana 0.5.1
resource kubernetes 4.17.1
resource postgresql 3.11.3
language python unknown
resource random 4.16.3
resource synced-folder 0.11.1

Host
OS ubuntu
Version 22.04
Arch x86_64

This project is written in python: executable='/home/builder/.cache/bazel/_bazel_builder/99bd544777c52d5a0d8a66ea3b05626a/execroot/ritta/bazel-out/k8-dbg/bin/infra/pulumi/pulumi.runfiles/python3_10_x86_64-unknown-linux-gnu/bin/python3' version='3.10.9'

Backend
Name builderdev.dev-emfdavid.us-central1-a.c.ppl-gem.internal
URL gs://camus-infra-pulumistate/fpms
User builder
Organizations
Token type personal

Dependencies:
NAME VERSION
absl-py 2.1.0
dnspython 2.6.1
gcsfs 2024.10.0
google-api-python-client 2.121.0
google-cloud-asset 3.26.1
google-cloud-bigquery 3.21.0
google-cloud-bigtable 2.23.1
google-cloud-compute 1.18.0
google-cloud-pubsub 2.21.1
google-cloud-secret-manager 2.20.0
grafanalib 0.7.1
influxdb 5.3.2
Jinja2 3.1.4
kubernetes 24.2.0
Pint 0.24.3
pip 22.3.1
prometheus_client 0.20.0
psycopg2-binary 2.9.9
pulumi_command 0.11.1
pulumi_gcp 8.9.1
pulumi_kubernetes 4.17.1
pulumi_policy 1.13.0
pulumi_postgresql 3.11.3
pulumi_random 4.16.3
pulumi_synced_folder 0.11.1
pulumiverse_grafana 0.5.1
PySnooper 1.2.0
PySocks 1.7.1
python-json-logger 2.0.7
python-socks 2.5.1
Shapely 1.8.5.post1
stringcase 1.2.0

Additional context

Happy to contribute, but I am reluctant to build timeout support by hand for BQ table if this should be added system wide for all GCP sdk operations.

Contributing

Vote on this issue by adding a 👍 reaction.
To contribute a fix for this issue, leave a comment (and link to your pull request, if you've opened one already).

@emfdavid emfdavid added kind/bug Some behavior is incorrect or out of spec needs-triage Needs attention from the triage team labels Nov 16, 2024
@iwahbe iwahbe added kind/enhancement Improvements or new features awaiting-upstream The issue cannot be resolved without action in another repository (may be owned by Pulumi). blocked The issue cannot be resolved without 3rd party action. and removed kind/bug Some behavior is incorrect or out of spec needs-triage Needs attention from the triage team labels Nov 18, 2024
@iwahbe
Copy link
Member

iwahbe commented Nov 18, 2024

Hi @emfdavid. Thanks for raising an issue.

This is tracked upstream in hashicorp/terraform-provider-google#3954. I opened hashicorp/terraform-provider-google#20367 to track the specific resource.

@emfdavid
Copy link
Author

Thank you @iwahbe

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
awaiting-upstream The issue cannot be resolved without action in another repository (may be owned by Pulumi). blocked The issue cannot be resolved without 3rd party action. kind/enhancement Improvements or new features
Projects
None yet
Development

No branches or pull requests

2 participants