Skip to content

Commit 2d72872

Browse files
sbordetsbordet
committed
Merged branch 'jetty-12.0.x' into 'jetty-12.1.x'.
Signed-off-by: Simone Bordet <[email protected]>
2 parents ceca92c + dd31feb commit 2d72872

File tree

19 files changed

+617
-193
lines changed

19 files changed

+617
-193
lines changed

‎documentation/jetty/modules/code/examples/src/main/java/org/eclipse/jetty/docs/programming/server/http/HTTPServerDocs.java

+2-2
Original file line numberDiff line numberDiff line change
@@ -1532,8 +1532,8 @@ public boolean handle(Request request, Response response, Callback callback)
15321532
// Set the max number of concurrent requests,
15331533
// for example in relation to the thread pool.
15341534
qosHandler.setMaxRequestCount(maxThreads / 2);
1535-
// A suspended request may stay suspended for at most 15 seconds.
1536-
qosHandler.setMaxSuspend(Duration.ofSeconds(15));
1535+
// A suspended request may stay suspended for at most 5 seconds.
1536+
qosHandler.setMaxSuspend(Duration.ofSeconds(5));
15371537
server.setHandler(qosHandler);
15381538

15391539
// Provide quality of service to the shop

‎documentation/jetty/modules/operations-guide/pages/modules/standard.adoc

+33
Original file line numberDiff line numberDiff line change
@@ -343,6 +343,17 @@ However, we the RMI server is configured to bind to `localhost`, i.e. `127.0.0.1
343343

344344
If the system property `java.rmi.server.hostname` is not specified, the RMI client will try to connect to `127.0.1.1` (because that's what in the RMI stub) and fail because nothing is listening on that address.
345345

346+
[[qos]]
347+
== Module `qos`
348+
349+
The `qos` module installs the `QoSHandler` at the root of the `Handler` tree; the `QoSHandler` applies limits to the number of concurrent requests, as explained in xref:programming-guide:server/http.adoc#handler-use-qos[this section].
350+
351+
The module properties are:
352+
353+
----
354+
include::{jetty-home}/modules/qos.mod[tags=documentation]
355+
----
356+
346357
[[requestlog]]
347358
== Module `requestlog`
348359

@@ -560,6 +571,17 @@ The module properties to configure the Jetty server scheduler are:
560571
include::{jetty-home}/modules/server.mod[tags=documentation-scheduler-config]
561572
----
562573

574+
[[size-limit]]
575+
== Module `size-limit`
576+
577+
The `size-limit` module installs the `SizeLimitHandler` at the root of the `Handler` tree; the `SizeLimitHandler` applies limits to the request content and the response content, as explained in xref:programming-guide:server/http.adoc#handler-use-size-limit[this section].
578+
579+
The module properties are:
580+
581+
----
582+
include::{jetty-home}/modules/size-limit.mod[tags=documentation]
583+
----
584+
563585
[[ssl]]
564586
== Module `ssl`
565587

@@ -717,6 +739,17 @@ include::{jetty-home}/modules/test-keystore.mod[]
717739
Note how properties `jetty.sslContext.keyStorePath` and `jetty.sslContext.keyStorePassword` are configured, only if not already set (via the `?=` operator), directly in the module file, rather than in a `+*.ini+` file.
718740
This is done to avoid that these properties accidentally overwrite a real KeyStore configuration.
719741

742+
[[thread-limit]]
743+
== Module `thread-limit`
744+
745+
The `thread-limit` module installs the `ThreadLimitHandler` at the root of the `Handler` tree; the `ThreadLimitHandler` applies limits to the number of concurrent threads per remote IP address, as explained in xref:programming-guide:server/http.adoc#handler-use-thread-limit[this section].
746+
747+
The module properties are:
748+
749+
----
750+
include::{jetty-home}/modules/thread-limit.mod[tags=documentation]
751+
----
752+
720753
[[threadpool]]
721754
== Module `threadpool`
722755

‎documentation/jetty/modules/programming-guide/pages/server/http.adoc

+59-3
Original file line numberDiff line numberDiff line change
@@ -814,6 +814,44 @@ include::code:example$src/main/java/org/eclipse/jetty/docs/programming/server/ht
814814
If the resource is not found, `ResourceHandler` will not return `true` from the `handle(\...)` method, so what happens next depends on the `Handler` tree structure.
815815
See also <<handler-use-default,how to use>> `DefaultHandler`.
816816

817+
[[handler-use-conditional]]
818+
==== ConditionalHandler
819+
820+
`ConditionalHandler` is an abstract `Handler` that matches conditions about the request, and allows subclasses to handle the request differently depending on whether the conditions have been met or not.
821+
822+
You may subclass `ConditionalHandler.Abstract` and override these methods:
823+
824+
* `boolean onConditionsMet(Request, Response, Callback)`, to handle the request when the conditions are met.
825+
* `boolean onConditionsNotMet(Request, Response, Callback)`, to handle the request when the conditions are not met.
826+
827+
Alternatively, you can use the following `ConditionalHandler` subclasses that implement common behaviors:
828+
829+
* `ConditionalHandler.ElseNext`:
830+
** When conditions are met, you have to write the implementation.
831+
** When conditions are not met, the handling of the request is forwarded to the next `Handler`.
832+
* `ConditionalHandler.Reject`:
833+
** When conditions are met, a response is written with a configurable, non-2xx, HTTP status code.
834+
** When conditions are not met, the handling of the request is forwarded to the next `Handler`.
835+
* `ConditionalHandler.SkipNext`:
836+
** When conditions are met, the handling of the request is forwarded to the next-next `Handler`, skipping the next `Handler`.
837+
** When conditions are not met, the handling of the request is forwarded to the next `Handler`.
838+
* `ConditionalHandler.DontHandle`:
839+
** When conditions are met, the request is not handled.
840+
** When conditions are not met, the handling of the request is forwarded to the next `Handler`.
841+
842+
Conditions can be specified using an include/exclude mechanism, where a condition match if it is not excluded, and either it is included or the include set is empty.
843+
844+
For example, you can specify to match only the specific HTTP request method `DELETE` by adding it to the include set; or you can specify to match all HTTP request methods apart `TRACE` by adding it to the exclude set.
845+
846+
`ConditionalHandler` allows you to specify conditions for the following request properties:
847+
848+
* The request HTTP method.
849+
* The request link:{javadoc-url}/org/eclipse/jetty/server/Request.html#getPathInContext(org.eclipse.jetty.server.Request)[path in context], that is the request URI relative to the context path.
850+
* The request remote address.
851+
* Custom predicates that receive the request to match a custom condition.
852+
853+
Notable subclasses of `ConditionalHandler` are, for example, <<handler-use-qos,`QoSHandler`>> and <<handler-use-thread-limit,`ThreadLimitHandler`>>.
854+
817855
[[handler-use-gzip]]
818856
==== GzipHandler
819857

@@ -905,7 +943,7 @@ Server
905943
└── ContextHandler N
906944
----
907945

908-
[[handler-use-sizelimit]]
946+
[[handler-use-size-limit]]
909947
==== SizeLimitHandler
910948

911949
`SizeLimitHandler` tracks the sizes of request content and response content, and fails the request processing with an HTTP status code of https://www.rfc-editor.org/rfc/rfc9110.html#name-413-content-too-large[`413 Content Too Large`].
@@ -1038,9 +1076,13 @@ Refer to the `EventsHandler` link:{javadoc-url}/org/eclipse/jetty/server/handler
10381076
[[handler-use-qos]]
10391077
==== QoSHandler
10401078

1041-
`QoSHandler` allows web applications to limit the number of concurrent requests, therefore implementing a quality of service (QoS) mechanism for end users.
1079+
`QoSHandler` allows web applications to limit the number of _active_ concurrent requests, that is requests that are currently being handled by a thread, and therefore are not waiting asynchronously, for example reading request content or writing response content.
1080+
1081+
`QoSHandler` extends xref:handler-use-conditional[`ConditionalHandler`], so you may be able to restrict what `QoSHandler` does to only requests that match the conditions (for example, only to `POST` requests, or only for certain request URIs, etc.)
10421082

10431083
Web applications may need to access resources with limited capacity, for example a relational database accessed through a JDBC connection pool.
1084+
Limiting the number of active concurrent requests helps to control the load on the server, so that it does not become overloaded and possibly unresponsive.
1085+
In turn, this improves the quality of service (QoS) for end users of the web application, because either their request is being handled actively by the server, or it is rejected sooner (after a configurable timeout in `QoSHandler`) rather than later (after a possibly longer idle timeout).
10441086

10451087
Consider the case where each HTTP request results in a JDBC query, and the capacity of the database is of 400 queries/s.
10461088
Allowing more than 400 HTTP requests/s into the system, for example 500 requests/s, results in 100 requests blocking waiting for a JDBC connection _for every second_.
@@ -1049,7 +1091,7 @@ When no more threads are available, additional requests will queue up as tasks i
10491091
This situation affects the whole server, so one bad behaving web application may affect other well behaving web applications.
10501092
From the end user perspective the quality of service is terrible, because requests will take a lot of time to be served and eventually time out.
10511093

1052-
In cases of load spikes, caused for example by popular events (weather or social events), usage bursts (Black Friday sales), or even denial of service attacks, it is desirable to give priority to certain requests rather than others.
1094+
In cases of load spikes, caused for example by popular events (weather or social events), usage bursts (Black Friday sales), or even denial-of-service attacks, it is desirable to give priority to certain requests rather than others.
10531095
For example, in an e-commerce site requests that lead to the checkout and to the payments should have higher priorities than requests to browse the products.
10541096
Another example is to prioritize requests for certain users such as paying users or administrative users.
10551097

@@ -1236,6 +1278,20 @@ This allows web applications that use blocking API calls such as `HttpServletReq
12361278
For other types of request content, `EagerContentHandler` reads and retains request content bytes up to a configurable amount, and then invokes the next `Handler`, without any further processing of the request content bytes.
12371279
This allows web applications that use blocking API calls such as `HttpServletRequest.getInputStream()` to avoid blocking in most cases (if the request is smaller than what has been configured in `EagerContentHandler`).
12381280

1281+
[[handler-use-thread-limit]]
1282+
==== ThreadLimitHandler
1283+
1284+
`ThreadLimitHandler` tracks remote IP addresses and limits the number of concurrent requests (and therefore threads) for each remote IP address to protect against denial-of-service attacks.
1285+
1286+
`ThreadLimitHandler` extends xref:handler-use-conditional[`ConditionalHandler`], so you may be able to restrict what `ThreadLimitHandler` does to only requests that match the conditions (for example, only to `POST` requests, or only for certain request URIs, etc.)
1287+
1288+
The remote IP address can be derived from the network, or from the `Forwarded` (or the now obsolete `X-Forwarded-For`) HTTP header.
1289+
The `Forwarded` header is typically present in requests that have been forwarded to Jetty by a reverse proxy such as HAProxy, Nginx, Apache, etc.
1290+
1291+
// TODO: mention the DoSHandler in Jetty 12.1.x.
1292+
1293+
Note that `ThreadLimitHandler` is different from xref:handler-use-qos[`QoSHandler`] in that it limits the number of concurrent requests per remote IP address, while `QoSHandler` limits the total number of concurrent requests.
1294+
12391295
[[handler-use-servlet]]
12401296
=== Servlet API Handlers
12411297

‎jetty-core/jetty-server/src/main/config/etc/jetty-eager-content.xml

+42
Original file line numberDiff line numberDiff line change
@@ -55,6 +55,48 @@
5555
</Item>
5656
</Array>
5757
</Arg>
58+
<Call name="includeMethod">
59+
<Arg>
60+
<Call class="org.eclipse.jetty.util.StringUtil" name="csvSplit">
61+
<Arg><Property name="jetty.threadlimit.include.method" default="" /></Arg>
62+
</Call>
63+
</Arg>
64+
</Call>
65+
<Call name="excludeMethod">
66+
<Arg>
67+
<Call class="org.eclipse.jetty.util.StringUtil" name="csvSplit">
68+
<Arg><Property name="jetty.threadlimit.exclude.method" default="" /></Arg>
69+
</Call>
70+
</Arg>
71+
</Call>
72+
<Call name="includePath">
73+
<Arg>
74+
<Call class="org.eclipse.jetty.util.StringUtil" name="csvSplit">
75+
<Arg><Property name="jetty.threadlimit.include.path" default="" /></Arg>
76+
</Call>
77+
</Arg>
78+
</Call>
79+
<Call name="excludePath">
80+
<Arg>
81+
<Call class="org.eclipse.jetty.util.StringUtil" name="csvSplit">
82+
<Arg><Property name="jetty.threadlimit.exclude.path" default="" /></Arg>
83+
</Call>
84+
</Arg>
85+
</Call>
86+
<Call name="includeInetAddressPattern">
87+
<Arg>
88+
<Call class="org.eclipse.jetty.util.StringUtil" name="csvSplit">
89+
<Arg><Property name="jetty.threadlimit.include.inet" default="" /></Arg>
90+
</Call>
91+
</Arg>
92+
</Call>
93+
<Call name="excludeInetAddressPattern">
94+
<Arg>
95+
<Call class="org.eclipse.jetty.util.StringUtil" name="csvSplit">
96+
<Arg><Property name="jetty.threadlimit.exclude.inet" default="" /></Arg>
97+
</Call>
98+
</Arg>
99+
</Call>
58100
</New>
59101
</Arg>
60102
</Call>

‎jetty-core/jetty-server/src/main/config/etc/jetty-qos.xml

+62
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,62 @@
1+
<?xml version="1.0"?>
2+
<!DOCTYPE Configure PUBLIC "-//Jetty//Configure//EN" "https://jetty.org/configure_10_0.dtd">
3+
4+
<Configure id="Server" class="org.eclipse.jetty.server.Server">
5+
<Call name="insertHandler">
6+
<Arg>
7+
<New class="org.eclipse.jetty.server.handler.QoSHandler">
8+
<Set name="maxRequestCount" property="jetty.qos.maxRequestCount" />
9+
<Set name="maxSuspendedRequestCount" property="jetty.qos.maxSuspendedRequestCount" />
10+
<Set name="maxSuspend">
11+
<Call class="java.time.Duration" name="ofMillis">
12+
<Arg type="long">
13+
<Property name="jetty.qos.maxSuspendDuration" default="0" />
14+
</Arg>
15+
</Call>
16+
</Set>
17+
<Call name="includeMethod">
18+
<Arg>
19+
<Call class="org.eclipse.jetty.util.StringUtil" name="csvSplit">
20+
<Arg><Property name="jetty.qos.include.method" default="" /></Arg>
21+
</Call>
22+
</Arg>
23+
</Call>
24+
<Call name="excludeMethod">
25+
<Arg>
26+
<Call class="org.eclipse.jetty.util.StringUtil" name="csvSplit">
27+
<Arg><Property name="jetty.qos.exclude.method" default="" /></Arg>
28+
</Call>
29+
</Arg>
30+
</Call>
31+
<Call name="includePath">
32+
<Arg>
33+
<Call class="org.eclipse.jetty.util.StringUtil" name="csvSplit">
34+
<Arg><Property name="jetty.qos.include.path" default="" /></Arg>
35+
</Call>
36+
</Arg>
37+
</Call>
38+
<Call name="excludePath">
39+
<Arg>
40+
<Call class="org.eclipse.jetty.util.StringUtil" name="csvSplit">
41+
<Arg><Property name="jetty.qos.exclude.path" default="" /></Arg>
42+
</Call>
43+
</Arg>
44+
</Call>
45+
<Call name="includeInetAddressPattern">
46+
<Arg>
47+
<Call class="org.eclipse.jetty.util.StringUtil" name="csvSplit">
48+
<Arg><Property name="jetty.qos.include.inet" default="" /></Arg>
49+
</Call>
50+
</Arg>
51+
</Call>
52+
<Call name="excludeInetAddressPattern">
53+
<Arg>
54+
<Call class="org.eclipse.jetty.util.StringUtil" name="csvSplit">
55+
<Arg><Property name="jetty.qos.exclude.inet" default="" /></Arg>
56+
</Call>
57+
</Arg>
58+
</Call>
59+
</New>
60+
</Arg>
61+
</Call>
62+
</Configure>

‎jetty-core/jetty-server/src/main/config/etc/jetty-size-limit.xml

+13
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,13 @@
1+
<?xml version="1.0"?>
2+
<!DOCTYPE Configure PUBLIC "-//Jetty//Configure//EN" "https://jetty.org/configure_10_0.dtd">
3+
4+
<Configure id="Server" class="org.eclipse.jetty.server.Server">
5+
<Call name="insertHandler">
6+
<Arg>
7+
<New class="org.eclipse.jetty.server.handler.SizeLimitHandler">
8+
<Arg type="long"><Property name="jetty.sizeLimit.maxRequestContentSize" default="-1" /></Arg>
9+
<Arg type="long"><Property name="jetty.sizeLimit.maxResponseContentSize" default="-1" /></Arg>
10+
</New>
11+
</Arg>
12+
</Call>
13+
</Configure>

‎jetty-core/jetty-server/src/main/config/etc/jetty-thread-limit.xml

+56
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,56 @@
1+
<?xml version="1.0"?>
2+
<!DOCTYPE Configure PUBLIC "-//Jetty//Configure//EN" "https://jetty.org/configure_10_0.dtd">
3+
4+
<Configure id="Server" class="org.eclipse.jetty.server.Server">
5+
<Call name="insertHandler">
6+
<Arg>
7+
<New id="ThreadLimitHandler" class="org.eclipse.jetty.server.handler.ThreadLimitHandler">
8+
<Arg name="forwardedHeader"><Property name="jetty.threadlimit.forwardedHeader"/></Arg>
9+
<Set name="enabled"><Property name="jetty.threadlimit.enabled" default="true"/></Set>
10+
<Set name="threadLimit" property="jetty.threadlimit.threadLimit"/>
11+
<Call name="includeMethod">
12+
<Arg>
13+
<Call class="org.eclipse.jetty.util.StringUtil" name="csvSplit">
14+
<Arg><Property name="jetty.threadlimit.include.method" default="" /></Arg>
15+
</Call>
16+
</Arg>
17+
</Call>
18+
<Call name="excludeMethod">
19+
<Arg>
20+
<Call class="org.eclipse.jetty.util.StringUtil" name="csvSplit">
21+
<Arg><Property name="jetty.threadlimit.exclude.method" default="" /></Arg>
22+
</Call>
23+
</Arg>
24+
</Call>
25+
<Call name="includePath">
26+
<Arg>
27+
<Call class="org.eclipse.jetty.util.StringUtil" name="csvSplit">
28+
<Arg><Property name="jetty.threadlimit.include.path" default="" /></Arg>
29+
</Call>
30+
</Arg>
31+
</Call>
32+
<Call name="excludePath">
33+
<Arg>
34+
<Call class="org.eclipse.jetty.util.StringUtil" name="csvSplit">
35+
<Arg><Property name="jetty.threadlimit.exclude.path" default="" /></Arg>
36+
</Call>
37+
</Arg>
38+
</Call>
39+
<Call name="includeInetAddressPattern">
40+
<Arg>
41+
<Call class="org.eclipse.jetty.util.StringUtil" name="csvSplit">
42+
<Arg><Property name="jetty.threadlimit.include.inet" default="" /></Arg>
43+
</Call>
44+
</Arg>
45+
</Call>
46+
<Call name="excludeInetAddressPattern">
47+
<Arg>
48+
<Call class="org.eclipse.jetty.util.StringUtil" name="csvSplit">
49+
<Arg><Property name="jetty.threadlimit.exclude.inet" default="" /></Arg>
50+
</Call>
51+
</Arg>
52+
</Call>
53+
</New>
54+
</Arg>
55+
</Call>
56+
</Configure>

‎jetty-core/jetty-server/src/main/config/etc/jetty-threadlimit.xml

-19
This file was deleted.

‎jetty-core/jetty-server/src/main/config/modules/delay-until-content.mod

+1-1
Original file line numberDiff line numberDiff line change
@@ -13,7 +13,7 @@ server
1313
server
1414

1515
[after]
16-
threadlimit
16+
thread-limit
1717

1818
[xml]
1919
etc/jetty-delayed.xml

0 commit comments

Comments
 (0)