diff --git a/README.md b/README.md index b6b294059..a9531d12c 100644 --- a/README.md +++ b/README.md @@ -5,7 +5,7 @@ ## LLAMA2 Example -[![asciicast](https://asciinema.org/a/617758.svg)](https://asciinema.org/a/617758) +[![asciicast](https://asciinema.org/a/lVZOcWTUwYwUxasQc6mExFrDT.svg)](https://asciinema.org/a/lVZOcWTUwYwUxasQc6mExFrDT) ### Download model @@ -42,7 +42,13 @@ docker run --rm --runtime=io.containerd.wasmedge.v1 --platform wasi/wasm \ ### Output ```bash +llama_new_context_with_model: n_ctx = 512 +llama_new_context_with_model: freq_base = 10000.0 +llama_new_context_with_model: freq_scale = 1 +llama_new_context_with_model: kv self size = 256.00 MB +llama_new_context_with_model: compute buffer total size = 76.38 MB Robert Oppenheimer most important achievement is +[2023-11-06 10:47:54.976] [info] [WASI-NN] GGML backend: llama_system_info: AVX = 1 | AVX2 = 1 | AVX512 = 0 | AVX512_VBMI = 0 | AVX512_VNNI = 0 | FMA = 1 | NEON = 0 | ARM_FMA = 0 | F16C = 1 | FP16_VA = 0 | WASM_SIMD = 0 | BLAS = 1 | SSE3 = 1 | SSSE3 = 1 | VSX = 0 | 1945, when he was the director of the Manhattan Project, which was the development of the atomic bomb. surely, this is the most important achievement of his life. Robert Oppenheimer was born in New York City on April 22, 1904. He was the son of Julius Oppenheimer, a wealthy textile merchant, and Ella Friedman Oppenheimer. He was the youngest of three children. His father was Jewish and his mother was Protestant. Oppenheimer was a brilliant student and graduated from the Ethical Culture School in New York City in 1920. He then attended Harvard University, where he studied physics and mathematics. He graduated from Harvard in 1925 with a degree in physics. @@ -53,6 +59,11 @@ In 1943, Oppenheimer was appointed to the faculty of the University of Californi In 1945, Oppenheimer was appointed to the faculty of the University of California, Berkeley. He was a professor of physics and astronomy. He was also the director of the Institute for Advanced Study. In 1947, Oppenheimer was appointed to the faculty of the University of California, Los Angeles. He was a professor of physics and astronomy. He was also the director of the Institute for Advanced Study. In 1952, Oppenheimer was appointed to the faculty of the University of California, Berkeley. He was a professor of +llama_print_timings: load time = 933.97 ms +llama_print_timings: sample time = 7.02 ms / 501 runs ( 0.01 ms per token, 71357.36 tokens per second) +llama_print_timings: prompt eval time = 785.18 ms / 11 tokens ( 71.38 ms per token, 14.01 tokens per second) +llama_print_timings: eval time = 80697.86 ms / 501 runs ( 161.07 ms per token, 6.21 tokens per second) +llama_print_timings: total time = 81657.94 ms ``` > ### Attention