File tree 1 file changed +3
-14
lines changed
examples/cpp/aot_inductor/resnet
1 file changed +3
-14
lines changed Original file line number Diff line number Diff line change @@ -25,15 +25,13 @@ handler:
25
25
mapping : " index_to_name.json"
26
26
` ` `
27
27
28
- ### Generate MAR file
29
-
30
- Now lets generate the mar file
28
+ ### Generate MModel Artifacts Folder
31
29
32
30
` ` ` bash
33
31
torch-model-archiver --model-name resnetcppaot --version 1.0 --handler ../../../../cpp/_build/test/resources/examples/aot_inductor/resnet_handler/libresnet_handler:ResnetCppHandler --runtime LSP --extra-files index_to_name.json,../../../../cpp/_build/test/resources/examples/aot_inductor/resnet_handler/resnet50_pt2.so --config-file model-config.yaml --archive-format no-archive
34
32
```
35
33
36
- Create model store directory and move the mar file
34
+ Create model store directory and move the folder ` resnetcppaot `
37
35
38
36
```
39
37
mkdir model_store
@@ -45,18 +43,9 @@ mv resnetcppaot model_store/
45
43
Start torchserve using the following command
46
44
47
45
```
48
- torchserve --ncs --model-store model_store/
49
- ```
50
-
51
- Register the model using the following command
52
-
46
+ torchserve --ncs --model-store model_store/ --models resnetcppaot
53
47
```
54
- curl -v -X POST "http://localhost:8081/models?initial_workers=1&url=resnetcppaot&batch_size=2&max_batch_delay=5000"
55
48
56
- {
57
- "status": "Model \"resnetcppaot\" Version: 1.0 registered with 1 initial workers"
58
- }
59
- ```
60
49
61
50
Infer the model using the following command
62
51
You can’t perform that action at this time.
0 commit comments