You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardexpand all lines: SECURITY.md
+19-8
Original file line number
Diff line number
Diff line change
@@ -20,22 +20,33 @@ TorchServe as much as possible relies on automated tools to do security scanning
20
20
1. HTTP - `8080`, `8081`, `8082`
21
21
2. gRPC - `7070`, `7071`
22
22
23
-
These ports are accessible to `localhost` by default. The address can be configured by following the [guide](https://pytorch.org/serve/configuration.html#configure-torchserve-listening-address-and-port)
24
-
TorchServe does not prevent users from configuring the address to be `0.0.0.0`. Please be aware of the security risks if you use `0.0.0.0`
25
-
2. TorchServe's Docker image is configured to expose the ports `8080`, `8081`, `8082`, `7070`, `7071` to the host by [default](https://github.com/pytorch/serve/blob/master/docker/Dockerfile). When these ports are mapped to the host, make sure to use `localhost` or a specific ip address.
23
+
These ports are accessible to `localhost` by default. The addresses can be configured by following the guides for
24
+
[HTTP](https://github.com/pytorch/serve/blob/master/docs/configuration.md#configure-torchserve-listening-address-and-port) and
TorchServe does not prevent users from configuring the address to be any value, including the wildcard address `0.0.0.0`.
27
+
Please be aware of the security risks of configuring the address to be `0.0.0.0`, this will give all addresses(including publicly accessible addresses, if any)
28
+
on the host, access to the TorchServer endpoints listening on the ports shown above.
29
+
2. TorchServe's Docker image is configured to expose the ports `8080`, `8081`, `8082`, `7070`, `7071` to the host by [default](https://github.com/pytorch/serve/blob/master/docker/Dockerfile). When starting the container,
30
+
make sure to map the ports exposed by the container to `localhost` ports or a specific IP address as shown in this [security guideline](https://github.com/pytorch/serve/blob/master/docker/README.md#security-guideline).
26
31
27
32
3. Be sure to validate the authenticity of the `.mar` file being used with TorchServe.
28
-
1. A `.mar` file being downloaded from the internet from an untrustworthy source may have malicious code, compromising the integrity of your application
29
-
2. TorchServe executes arbitrary python code packaged in the `mar` file. Make sure that you've either audited that the code you're using is safe and/or is from a source that you trust
30
-
4. By default TorchServe allows you to register models from all URLs. Make sure to set `allowed_urls` parameter in config.properties to restrict this. You can find more details in the [configuration guide](https://pytorch.org/serve/configuration.html#other-properties)
31
-
-`use_env_allowed_urls=true` is required in config.properties to read `allowed_urls` from environment variable
33
+
1. A `.mar` file being downloaded from the internet from an untrustworthy source may have malicious code, compromising the integrity of your application.
34
+
2. TorchServe executes arbitrary python code packaged in the `mar` file. Make sure that you've either audited that the code you're using is safe and/or is from a source that you trust.
35
+
3. Torchserve supports custom [plugins](https://github.com/pytorch/serve/tree/master/plugins) and [handlers](https://github.com/pytorch/serve/blob/master/docs/custom_service.md).
36
+
These can be utilized to extend TorchServe functionality to perform runtime security scanning using tools such as:
4. Running Torchserve inside a container environment and loading an untrusted `.mar` file does not guarantee isolation from a security perspective.
41
+
4. By default TorchServe allows you to register models from all URLs. Make sure to set `allowed_urls` parameter in config.properties to restrict this. You can find more details in the [configuration guide](https://pytorch.org/serve/configuration.html#other-properties).
42
+
-`use_env_allowed_urls=true` is required in config.properties to read `allowed_urls` from environment variable.
32
43
5. Enable SSL:
33
44
34
45
TorchServe supports two ways to configure SSL:
35
46
1. Using a keystore
36
47
2. Using private-key/certificate files
37
48
38
-
You can find more details in the [configuration guide](https://pytorch.org/serve/configuration.html#enable-ssl)
49
+
You can find more details in the [configuration guide](https://pytorch.org/serve/configuration.html#enable-ssl).
39
50
6. Prepare your model against bad inputs and prompt injections. Some recommendations:
40
51
1. Pre-analysis: check how the model performs by default when exposed to prompt injection (e.g. using [fuzzing for prompt injection](https://github.com/FonduAI/awesome-prompt-injection?tab=readme-ov-file#tools)).
41
52
2. Input Sanitation: Before feeding data to the model, sanitize inputs rigorously. This involves techniques such as:
0 commit comments