You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I started to use, 3.6.1 version and "WriteThroughputBudget" is working. But i am experiencing a different issue, that the spark job is running very long and writing only records in 100 or even less per second at the end of the job(identified by querying the cosmos container manually with time interveal). Which is kind of drags the spark job to run very longer. Even though there are available RUs, the spark job is writing data verly slowly. This is not the case when the "WriteThroughputBudget" is not put in the configuration.
Below is the Screen shot of how the RUs usage and request to cosmosdb drops and drags at the end of job.
The text was updated successfully, but these errors were encountered:
I started to use, 3.6.1 version and "WriteThroughputBudget" is working. But i am experiencing a different issue, that the spark job is running very long and writing only records in 100 or even less per second at the end of the job(identified by querying the cosmos container manually with time interveal). Which is kind of drags the spark job to run very longer. Even though there are available RUs, the spark job is writing data verly slowly. This is not the case when the "WriteThroughputBudget" is not put in the configuration.
Below is the Screen shot of how the RUs usage and request to cosmosdb drops and drags at the end of job.
The text was updated successfully, but these errors were encountered: