Skip to content

Commit

Permalink
update docs
Browse files Browse the repository at this point in the history
  • Loading branch information
victorchall committed Jun 9, 2024
1 parent da60499 commit b3a8a53
Show file tree
Hide file tree
Showing 2 changed files with 13 additions and 1 deletion.
2 changes: 1 addition & 1 deletion doc/ADVANCED_TWEAKING.md
Original file line number Diff line number Diff line change
Expand Up @@ -320,7 +320,7 @@ While the calculation makes sense in how it compensates for inteval and total tr

If you use `ema_strength_target` the actual calculated `ema_decay_rate` used will be printed in your logs, and you should pay attention to this value and use it to inform your future decisions on EMA tuning.

[Experimental results](https://discord.com/channels/1026983422431862825/1150790432897388556) for EMA on Discord.
[Experimental results](https://discord.com/channels/1026983422431862825/1150790432897388556) for general use of EMA on Discord.

## AdaCoor optimizer

Expand Down
12 changes: 12 additions & 0 deletions doc/CAPTION_COG.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,15 @@
# Synthetic Captioning

Script now works with the following:

--model "THUDM/cogvlm-chat-hf"

--model "THUDM/cogvlm2-llama3-chat-19B"

--model "xtuner/llava-llama-3-8b-v1_1-transformers"

--model "THUDM/glm-4v-9b"

# CogVLM captioning

CogVLM ([code](https://github.com/THUDM/CogVLM)) ([model](https://huggingface.co/THUDM/cogvlm-chat-hf)) is, so far (Q1 2024), the best model for automatically generating captions.
Expand Down

0 comments on commit b3a8a53

Please sign in to comment.