Skip to content

Commit 3182443

Browse files
authored
Update README.md (#3368)
1 parent 55c2f6b commit 3182443

File tree

1 file changed

+10
-11
lines changed
  • examples/usecases/llm_diffusion_serving_app

1 file changed

+10
-11
lines changed

examples/usecases/llm_diffusion_serving_app/README.md

+10-11
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,3 @@
1-
21
## Multi-Image Generation Streamlit App: Chaining Llama & Stable Diffusion using TorchServe, torch.compile & OpenVINO
32

43
This Multi-Image Generation Streamlit app is designed to generate multiple images based on a provided text prompt. Instead of using Stable Diffusion directly, this app chains Llama and Stable Diffusion to enhance the image generation process. Here’s how it works:
@@ -7,7 +6,7 @@ This Multi-Image Generation Streamlit app is designed to generate multiple image
76
- For performance optimization, the models are compiled using [torch.compile using OpenVINO backend.](https://docs.openvino.ai/2024/openvino-workflow/torch-compile.html)
87
- The application leverages [TorchServe](https://pytorch.org/serve/) for efficient model serving and management.
98

10-
![Multi-Image Generation App Workflow](./docker/img/workflow-1.png)
9+
![Multi-Image Generation App Workflow](https://raw.githubusercontent.com/pytorch/serve/master/examples/usecases/llm_diffusion_serving_app/docker/img/workflow-1.png)
1110

1211
## Quick Start Guide
1312

@@ -83,12 +82,12 @@ Note: You can replace the model identifiers (MODEL_NAME_LLM, MODEL_NAME_SD) as n
8382
</details>
8483

8584
## What to expect
86-
After launching the Docker container using the `docker run ..` command displayed after successful build, you can access two separate Streamlit applications:
85+
After launching the Docker container using the `docker run ..` command displayed after a successful build, you can access two separate Streamlit applications:
8786
1. TorchServe Server App (running at http://localhost:8084) to start/stop TorchServe, load/register models, scale up/down workers.
8887
2. Client App (running at http://localhost:8085) where you can enter prompt for Image generation.
8988

90-
> Note: You could also run a quick benchmark comparing performance of Stable Diffusion with Eager, torch.compile with inductor and openvino.
91-
> Review the `docker run ..` command displayed after successful build for benchmarking
89+
> Note: You could also run a quick benchmark comparing the performance of Stable Diffusion with Eager, torch.compile with inductor and openvino.
90+
> Review the `docker run ..` command displayed after a successful build for benchmarking
9291
9392
#### Sample Output of Starting the App:
9493

@@ -140,7 +139,7 @@ Collecting usage statistics. To deactivate, set browser.gatherUsageStats to fals
140139
</details>
141140

142141
#### Sample Output of Stable Diffusion Benchmarking:
143-
To run Stable Diffusion benchmarking, use the `sd-benchmark.py`. See details below for sample.
142+
To run Stable Diffusion benchmarking, use the `sd-benchmark.py`. See details below for a sample console output.
144143

145144
<details>
146145

@@ -199,7 +198,7 @@ Results saved at /home/model-server/model-store/ which is a Docker container mou
199198
</details>
200199

201200
#### Sample Output of Stable Diffusion Benchmarking with Profiling:
202-
To run Stable Diffusion benchmarking with profiling, use `--run_profiling` or `-rp`. See details below for sample. Sample profiling benchmarking output files are available in [assets/benchmark_results_20241123_044407/](./assets/benchmark_results_20241123_044407/)
201+
To run Stable Diffusion benchmarking with profiling, use `--run_profiling` or `-rp`. See details below for a sample console output. Sample profiling benchmarking output files are available in [assets/benchmark_results_20241123_044407/](https://github.com/pytorch/serve/tree/master/examples/usecases/llm_diffusion_serving_app/assets/benchmark_results_20241123_044407)
203202

204203
<details>
205204

@@ -264,18 +263,18 @@ Results saved at /home/model-server/model-store/ which is a Docker container mou
264263
## Multi-Image Generation App UI
265264

266265
### App Workflow
267-
![Multi-Image Generation App Workflow Gif](./docker/img/multi-image-gen-app.gif)
266+
![Multi-Image Generation App Workflow Gif](https://raw.githubusercontent.com/pytorch/serve/master/examples/usecases/llm_diffusion_serving_app/docker/img/multi-image-gen-app.gif)
268267

269268
### App Screenshots
270269

271270
<details>
272271

273272
| Server App Screenshot 1 | Server App Screenshot 2 | Server App Screenshot 3 |
274273
| --- | --- | --- |
275-
| <img src="./docker/img/server-app-screen-1.png" width="400"> | <img src="./docker/img/server-app-screen-2.png" width="400"> | <img src="./docker/img/server-app-screen-3.png" width="400"> |
274+
| <img src="https://raw.githubusercontent.com/pytorch/serve/master/examples/usecases/llm_diffusion_serving_app/docker/img/server-app-screen-1.png" width="400"> | <img src="https://raw.githubusercontent.com/pytorch/serve/master/examples/usecases/llm_diffusion_serving_app/docker/img/server-app-screen-2.png" width="400"> | <img src="https://raw.githubusercontent.com/pytorch/serve/master/examples/usecases/llm_diffusion_serving_app/docker/img/server-app-screen-3.png" width="400"> |
276275

277276
| Client App Screenshot 1 | Client App Screenshot 2 | Client App Screenshot 3 |
278277
| --- | --- | --- |
279-
| <img src="./docker/img/client-app-screen-1.png" width="400"> | <img src="./docker/img/client-app-screen-2.png" width="400"> | <img src="./docker/img/client-app-screen-3.png" width="400"> |
278+
| <img src="https://raw.githubusercontent.com/pytorch/serve/master/examples/usecases/llm_diffusion_serving_app/docker/img/client-app-screen-1.png" width="400"> | <img src="https://raw.githubusercontent.com/pytorch/serve/master/examples/usecases/llm_diffusion_serving_app/docker/img/client-app-screen-2.png" width="400"> | <img src="https://raw.githubusercontent.com/pytorch/serve/master/examples/usecases/llm_diffusion_serving_app/docker/img/client-app-screen-3.png" width="400"> |
280279

281-
</details>
280+
</details>

0 commit comments

Comments
 (0)