Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

docs: Update and improve stackablectl documentation #101

Merged
merged 64 commits into from
Sep 21, 2023
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
64 commits
Select commit Hold shift + click to select a range
36948cb
Initial commit
Techassi Aug 18, 2023
eafe6c7
Add demos partial
Techassi Aug 21, 2023
1836bc1
Split up xtask commands
Techassi Aug 21, 2023
a0eb19a
Add doc auto gen xtask
Techassi Aug 23, 2023
859a204
Adjust module nav
Techassi Aug 23, 2023
0b3067d
Adjust operator cmd output, fix typo
Techassi Aug 24, 2023
a8acdf1
Update operator doc page
Techassi Aug 24, 2023
6bc2490
Merge branch 'main' into docs/stackablectl
Techassi Aug 24, 2023
397a8bd
Continue release doc page
Techassi Aug 24, 2023
8e2100f
Revert to `rustls-tls`
Techassi Aug 25, 2023
c74b6b1
Continue stackablectl demos doc migration
Techassi Aug 28, 2023
0fae22e
Copy earthquake demo docs
Techassi Aug 29, 2023
921db89
Copy logging demo page
Techassi Aug 29, 2023
fa48147
Copy waterlavel demo docs
Techassi Aug 29, 2023
63a0b33
Move demo images to sub folder
Techassi Aug 29, 2023
fed1c3b
Add anomaly detection demo docs
Techassi Aug 29, 2023
8fd2395
Copy trino iceberg demo docs
Techassi Aug 29, 2023
fab6630
Copy trino taxi data demo docs
Techassi Aug 29, 2023
0c09062
Update docs auto generation
Techassi Aug 29, 2023
312f22c
Add stackablectl base command docs
Techassi Aug 29, 2023
8463a7f
Update image paths
Techassi Aug 29, 2023
05ff607
Add customization docs
Techassi Aug 29, 2023
6efe9fe
Add quickstart
Techassi Aug 29, 2023
85056bf
Add minor adjustments
Techassi Aug 29, 2023
87a9583
Style adjustment for start page
Techassi Aug 30, 2023
651c9f2
Add quickstart and installation page to nav
Techassi Aug 30, 2023
e4a5dd7
Adjust style for demo command page
Techassi Aug 30, 2023
6432050
Adjust style for operator command page
Techassi Aug 30, 2023
b714c51
Adjust style for release command page
Techassi Aug 30, 2023
40c4cea
Adjust style for airflow-scheduled-job page
Techassi Aug 30, 2023
34ff749
Update introduction for operator command
Techassi Sep 4, 2023
dbc1399
Start styling adjustments for demo data-lakehouse
Techassi Sep 4, 2023
c767388
Continue adjustments on data-lakehouse demo
Techassi Sep 4, 2023
aebec5e
Finish data-lakehouse demo adjustments
Techassi Sep 4, 2023
eda809d
Add instance hint partial
Techassi Sep 4, 2023
6ac0591
Adjust hbase-cycling-data demo
Techassi Sep 4, 2023
115f04e
Adjust jupyterhub demo
Techassi Sep 4, 2023
60ede90
Adjust logging demo
Techassi Sep 4, 2023
edd09bd
Start adjustments for nifi earthquake demo
Techassi Sep 4, 2023
796670b
Adjust spark anomaly detection docs
Techassi Sep 5, 2023
281fe9a
Adjust add demo customization docs
Techassi Sep 5, 2023
941c6c4
Adjust add stack customization docs
Techassi Sep 5, 2023
bc812fb
Adjust add release customization docs
Techassi Sep 5, 2023
9c42106
Finish nifi earthquake demo adjustments
Techassi Sep 5, 2023
60b88b3
Start nifi water level demo adjustments
Techassi Sep 5, 2023
b5423a9
Finish nifi water level adjustments
Techassi Sep 5, 2023
5e765ad
Start trino iceberg adjustments
Techassi Sep 5, 2023
cb5e083
Finish trino iceber demo adjustments
Techassi Sep 6, 2023
fad664f
Adjust trino taxi data demo docs
Techassi Sep 6, 2023
f95ed50
Add installation docs
Techassi Sep 6, 2023
db434f5
Adjust quick start guide
Techassi Sep 6, 2023
0193f18
fix: nav
sbernauer Sep 11, 2023
66ea0eb
docs: Remove demo docs, as they are moved to https://github.com/stack…
sbernauer Sep 12, 2023
18d8d94
callout
sbernauer Sep 12, 2023
ccb7f17
docs
sbernauer Sep 12, 2023
d5415b6
Add minor formatting
Techassi Sep 12, 2023
b92117a
Merge branch 'main' into docs/stackablectl
Techassi Sep 13, 2023
b17e76b
Update broken xrefs
Techassi Sep 14, 2023
91eb831
Fix xrefs, remove unused section
Techassi Sep 18, 2023
4420516
Update xrefs on stackablectl start page
Techassi Sep 18, 2023
db0d8b5
Update demo links
Techassi Sep 18, 2023
75d07e2
Update fish completion instructions
Techassi Sep 19, 2023
269d3b9
Add page aliases
Techassi Sep 21, 2023
6dd55ef
Merge branch 'main' into docs/stackablectl
Techassi Sep 21, 2023
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 2 additions & 0 deletions Cargo.lock

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

4 changes: 3 additions & 1 deletion Cargo.toml
Original file line number Diff line number Diff line change
Expand Up @@ -29,10 +29,12 @@ k8s-openapi = { version = "0.19", default-features = false, features = ["v1_27"]
kube = { version = "0.85", default-features = false, features = ["client", "rustls-tls"] }
lazy_static = "1.4"
nu-ansi-term = "0.49"
once_cell = "1.18"
phf = "0.11"
phf_codegen = "0.11"
rand = "0.8"
reqwest = { version = "0.11.16", default-features = false, features = ["rustls-tls"] }
regex = "1.9"
reqwest = { version = "0.11", default-features = false, features = ["rustls-tls"] }
semver = "1.0"
serde = { version = "1.0", features = ["derive"] }
serde_json = "1.0"
Expand Down
6 changes: 5 additions & 1 deletion docs/antora.yml
Original file line number Diff line number Diff line change
@@ -1,3 +1,7 @@
---
name: home
name: management
title: SDP Management
version: "nightly"
nav:
- modules/cockpit/nav.adoc
- modules/stackablectl/nav.adoc
4 changes: 4 additions & 0 deletions docs/modules/ROOT/pages/index.adoc
Original file line number Diff line number Diff line change
@@ -0,0 +1,4 @@
= Management Tools for the Stackable Data Platform

* xref:cockpit:index.adoc[]
* xref:stackablectl:index.adoc[]
2 changes: 2 additions & 0 deletions docs/modules/cockpit/nav.adoc
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
* xref:index.adoc[Cockpit]
** xref:installation.adoc[Installation]
2 changes: 1 addition & 1 deletion docs/modules/cockpit/pages/index.adoc
Original file line number Diff line number Diff line change
Expand Up @@ -2,5 +2,5 @@

This is a visual dashboard to monitor and control Stackable Data Platform clusters.

NOTE: The Stackable Cockpit is currently an early preview, and is not yet a
IMPORTANT: The Stackable Cockpit is currently an early preview, and is not yet a
fully supported component of the Stackable Data Platform.
3 changes: 2 additions & 1 deletion docs/modules/cockpit/pages/installation.adoc
Original file line number Diff line number Diff line change
Expand Up @@ -11,7 +11,8 @@ You will need:
* Helm
* htpasswd (from Apache HTTPD)

Resource sizing depends on cluster type(s), usage and scope, but as a starting point we recommend a minimum of the following resources for this service:
Resource sizing depends on cluster type(s), usage and scope, but as a starting point we recommend a minimum of the
following resources for this service:

* 0.2 cores (e.g. i5 or similar)
* 256MB RAM
Expand Down
1 change: 0 additions & 1 deletion docs/modules/cockpit/partials/nav.adoc

This file was deleted.

Binary file added docs/modules/stackablectl/images/layers.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
16 changes: 16 additions & 0 deletions docs/modules/stackablectl/nav.adoc
Original file line number Diff line number Diff line change
@@ -0,0 +1,16 @@
* xref:index.adoc[stackablectl]
** xref:installation.adoc[Installation]
** xref:quickstart.adoc[Quickstart]
** xref:commands/index.adoc[Commands]
*** xref:commands/cache.adoc[cache]
*** xref:commands/completions.adoc[completions]
*** xref:commands/demo.adoc[demo]
*** xref:commands/operator.adoc[operator]
*** xref:commands/release.adoc[release]
*** xref:commands/stack.adoc[stack]
*** xref:commands/stacklets.adoc[stacklets]
** xref:customization/index.adoc[]
*** xref:customization/add-demo.adoc[]
*** xref:customization/add-stack.adoc[]
*** xref:customization/add-release.adoc[]
// *** xref:customization/working-with-feature-branches.adoc[]
85 changes: 85 additions & 0 deletions docs/modules/stackablectl/pages/commands/cache.adoc
Original file line number Diff line number Diff line change
@@ -0,0 +1,85 @@
= stackablectl cache

fhennig marked this conversation as resolved.
Show resolved Hide resolved
// Autogenerated by cargo xtask gen-docs. DO NOT CHANGE MANUALLY!
[source,console]
----
$ stackablectl cache
Interact with locally cached files

Usage: cache [OPTIONS] <COMMAND>

Commands:
list List cached files
clean Clean cached files
help Print this message or the help of the given subcommand(s)

Options:
-l, --log-level <LOG_LEVEL>
Log level this application uses

--no-cache
Do not cache the remote (default) demo, stack and release files

Cached files are saved at '$XDG_CACHE_HOME/stackablectl', which is usually
'$HOME/.cache/stackablectl' when not explicitly set.

--offline
Do not request any remote files via the network

-h, --help
Print help (see a summary with '-h')

-V, --version
Print version

File options:
-d, --demo-file <DEMO_FILE>
Provide one or more additional (custom) demo file(s)

Demos are loaded in the following order: Remote (default) demo file, custom
demo files provided via the 'STACKABLE_DEMO_FILES' environment variable, and
lastly demo files provided via the '-d/--demo-file' argument(s). If there are
demos with the same name, the last demo definition will be used.

Use "stackablectl [OPTIONS] <COMMAND> -d path/to/demos1.yaml -d path/to/demos2.yaml"
to provide multiple additional demo files.

-s, --stack-file <STACK_FILE>
Provide one or more additional (custom) stack file(s)

Stacks are loaded in the following order: Remote (default) stack file, custom
stack files provided via the 'STACKABLE_STACK_FILES' environment variable, and
lastly demo files provided via the '-s/--stack-file' argument(s). If there are
stacks with the same name, the last stack definition will be used.

Use "stackablectl [OPTIONS] <COMMAND> -s path/to/stacks1.yaml -s path/to/stacks2.yaml"
to provide multiple additional stack files.

-r, --release-file <RELEASE_FILE>
Provide one or more additional (custom) release file(s)

Releases are loaded in the following order: Remote (default) release file,
custom release files provided via the 'STACKABLE_RELEASE_FILES' environment
variable, and lastly release files provided via the '-r/--release-file'
argument(s). If there are releases with the same name, the last release
definition will be used.

Use "stackablectl [OPTIONS] <COMMAND> -r path/to/releases1.yaml -r path/to/releases2.yaml"
to provide multiple additional release files.

Helm repository options:
--helm-repo-stable <URL>
Provide a custom Helm stable repository URL

[default: https://repo.stackable.tech/repository/helm-stable/]

--helm-repo-test <URL>
Provide a custom Helm test repository URL

[default: https://repo.stackable.tech/repository/helm-test/]

--helm-repo-dev <URL>
Provide a custom Helm dev repository URL

[default: https://repo.stackable.tech/repository/helm-dev/]
----
86 changes: 86 additions & 0 deletions docs/modules/stackablectl/pages/commands/completions.adoc
Original file line number Diff line number Diff line change
@@ -0,0 +1,86 @@
= stackablectl completions

fhennig marked this conversation as resolved.
Show resolved Hide resolved
// Autogenerated by cargo xtask gen-docs. DO NOT CHANGE MANUALLY!
[source,console]
----
$ stackablectl completions
Generate shell completions for this tool

Usage: completions [OPTIONS] <COMMAND>

Commands:
bash Generate shell completions for Bash
fish Generate shell completions for Fish
zsh Generate shell completions for ZSH
help Print this message or the help of the given subcommand(s)

Options:
-l, --log-level <LOG_LEVEL>
Log level this application uses

--no-cache
Do not cache the remote (default) demo, stack and release files

Cached files are saved at '$XDG_CACHE_HOME/stackablectl', which is usually
'$HOME/.cache/stackablectl' when not explicitly set.

--offline
Do not request any remote files via the network

-h, --help
Print help (see a summary with '-h')

-V, --version
Print version

File options:
-d, --demo-file <DEMO_FILE>
Provide one or more additional (custom) demo file(s)

Demos are loaded in the following order: Remote (default) demo file, custom
demo files provided via the 'STACKABLE_DEMO_FILES' environment variable, and
lastly demo files provided via the '-d/--demo-file' argument(s). If there are
demos with the same name, the last demo definition will be used.

Use "stackablectl [OPTIONS] <COMMAND> -d path/to/demos1.yaml -d path/to/demos2.yaml"
to provide multiple additional demo files.

-s, --stack-file <STACK_FILE>
Provide one or more additional (custom) stack file(s)

Stacks are loaded in the following order: Remote (default) stack file, custom
stack files provided via the 'STACKABLE_STACK_FILES' environment variable, and
lastly demo files provided via the '-s/--stack-file' argument(s). If there are
stacks with the same name, the last stack definition will be used.

Use "stackablectl [OPTIONS] <COMMAND> -s path/to/stacks1.yaml -s path/to/stacks2.yaml"
to provide multiple additional stack files.

-r, --release-file <RELEASE_FILE>
Provide one or more additional (custom) release file(s)

Releases are loaded in the following order: Remote (default) release file,
custom release files provided via the 'STACKABLE_RELEASE_FILES' environment
variable, and lastly release files provided via the '-r/--release-file'
argument(s). If there are releases with the same name, the last release
definition will be used.

Use "stackablectl [OPTIONS] <COMMAND> -r path/to/releases1.yaml -r path/to/releases2.yaml"
to provide multiple additional release files.

Helm repository options:
--helm-repo-stable <URL>
Provide a custom Helm stable repository URL

[default: https://repo.stackable.tech/repository/helm-stable/]

--helm-repo-test <URL>
Provide a custom Helm test repository URL

[default: https://repo.stackable.tech/repository/helm-test/]

--helm-repo-dev <URL>
Provide a custom Helm dev repository URL

[default: https://repo.stackable.tech/repository/helm-dev/]
----
Loading