[Blog Post] Scaling a Dataflow streaming workload (#29619)

* Scaling streaming workload, article skeleton * first version with content * Update website/www/site/content/en/blog/scaling-streaming-workload.md Co-authored-by: Rebecca Szper <[email protected]> * Apply suggestions from code review Co-authored-by: Rebecca Szper <[email protected]> * Apply suggestions from code review Co-authored-by: Rebecca Szper <[email protected]> * more fixes from review --------- Co-authored-by: Rebecca Szper <[email protected]>
apache · Jan 3, 2024 · fe1627d · fe1627d
1 parent 2d7586b
commit fe1627d
Show file tree

Hide file tree

Showing 29 changed files with 291 additions and 0 deletions.
diff --git a/website/www/site/content/en/blog/scaling-streaming-workload.md b/website/www/site/content/en/blog/scaling-streaming-workload.md
diff --git a/website/www/site/static/images/blog/scaling-streaming-workload/0-intro.png b/website/www/site/static/images/blog/scaling-streaming-workload/0-intro.png
diff --git a/website/www/site/static/images/blog/scaling-streaming-workload/0-pipeline.png b/website/www/site/static/images/blog/scaling-streaming-workload/0-pipeline.png
diff --git a/website/www/site/static/images/blog/scaling-streaming-workload/1-default-ps.png b/website/www/site/static/images/blog/scaling-streaming-workload/1-default-ps.png
diff --git a/...www/site/static/images/blog/scaling-streaming-workload/1-default-throughput.png b/...www/site/static/images/blog/scaling-streaming-workload/1-default-throughput.png
diff --git a/website/www/site/static/images/blog/scaling-streaming-workload/2-skeys-ps.png b/website/www/site/static/images/blog/scaling-streaming-workload/2-skeys-ps.png
diff --git a/...e/www/site/static/images/blog/scaling-streaming-workload/2-skeys-throughput.png b/...e/www/site/static/images/blog/scaling-streaming-workload/2-skeys-throughput.png
diff --git a/...ww/site/static/images/blog/scaling-streaming-workload/3-autoshard-autoscale.png b/...ww/site/static/images/blog/scaling-streaming-workload/3-autoshard-autoscale.png
diff --git a/.../site/static/images/blog/scaling-streaming-workload/3-autoshard-parallelism.png b/.../site/static/images/blog/scaling-streaming-workload/3-autoshard-parallelism.png
diff --git a/...ite/static/images/blog/scaling-streaming-workload/3-autoshard-throughput-tr.png b/...ite/static/images/blog/scaling-streaming-workload/3-autoshard-throughput-tr.png
diff --git a/...www/site/static/images/blog/scaling-streaming-workload/3-autoshard-tr-input.png b/...www/site/static/images/blog/scaling-streaming-workload/3-autoshard-tr-input.png
diff --git a/...ww/site/static/images/blog/scaling-streaming-workload/3-autoshard-tr-output.png b/...ww/site/static/images/blog/scaling-streaming-workload/3-autoshard-tr-output.png
diff --git a/.../site/static/images/blog/scaling-streaming-workload/3-autoshard-tr-overhead.png b/.../site/static/images/blog/scaling-streaming-workload/3-autoshard-tr-overhead.png
diff --git a/.../site/static/images/blog/scaling-streaming-workload/4-format-transformation.png b/.../site/static/images/blog/scaling-streaming-workload/4-format-transformation.png
diff --git a/...te/www/site/static/images/blog/scaling-streaming-workload/4-ingestion-scale.png b/...te/www/site/static/images/blog/scaling-streaming-workload/4-ingestion-scale.png
diff --git a/website/www/site/static/images/blog/scaling-streaming-workload/4-throughput.png b/website/www/site/static/images/blog/scaling-streaming-workload/4-throughput.png
diff --git a/...w/site/static/images/blog/scaling-streaming-workload/5-format-trasformation.png b/...w/site/static/images/blog/scaling-streaming-workload/5-format-trasformation.png
diff --git a/...te/www/site/static/images/blog/scaling-streaming-workload/5-ingestion-scale.png b/...te/www/site/static/images/blog/scaling-streaming-workload/5-ingestion-scale.png
diff --git a/website/www/site/static/images/blog/scaling-streaming-workload/5-input-size.png b/website/www/site/static/images/blog/scaling-streaming-workload/5-input-size.png
diff --git a/website/www/site/static/images/blog/scaling-streaming-workload/5-output-size.png b/website/www/site/static/images/blog/scaling-streaming-workload/5-output-size.png
diff --git a/.../site/static/images/blog/scaling-streaming-workload/6-format-transformation.png b/.../site/static/images/blog/scaling-streaming-workload/6-format-transformation.png
diff --git a/...te/www/site/static/images/blog/scaling-streaming-workload/6-ingestion-scale.png b/...te/www/site/static/images/blog/scaling-streaming-workload/6-ingestion-scale.png
diff --git a/website/www/site/static/images/blog/scaling-streaming-workload/6-latencies.png b/website/www/site/static/images/blog/scaling-streaming-workload/6-latencies.png
diff --git a/website/www/site/static/images/blog/scaling-streaming-workload/7-current-input.png b/website/www/site/static/images/blog/scaling-streaming-workload/7-current-input.png
diff --git a/.../site/static/images/blog/scaling-streaming-workload/7-current-shuffle-total.png b/.../site/static/images/blog/scaling-streaming-workload/7-current-shuffle-total.png
diff --git a/website/www/site/static/images/blog/scaling-streaming-workload/7-latency.png b/website/www/site/static/images/blog/scaling-streaming-workload/7-latency.png
diff --git a/...ww/site/static/images/blog/scaling-streaming-workload/7-previous-data-input.png b/...ww/site/static/images/blog/scaling-streaming-workload/7-previous-data-input.png
diff --git a/...site/static/images/blog/scaling-streaming-workload/7-previous-shuffle-total.png b/...site/static/images/blog/scaling-streaming-workload/7-previous-shuffle-total.png
diff --git a/website/www/site/static/images/blog/scaling-streaming-workload/7-resources.png b/website/www/site/static/images/blog/scaling-streaming-workload/7-resources.png