Skip to content

Commit 8a0d36e

Browse files
authored
Merge branch 'main' into jsinglet/language1
2 parents 23b2007 + bbdfbe4 commit 8a0d36e

15 files changed

+625
-0
lines changed
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,98 @@
1+
# CON39-C: Do not join or detach a thread that was previously joined or detached
2+
3+
This query implements the CERT-C rule CON39-C:
4+
5+
> Do not join or detach a thread that was previously joined or detached
6+
7+
8+
## Description
9+
10+
The C Standard, 7.26.5.6 \[[ISO/IEC 9899:2011](https://wiki.sei.cmu.edu/confluence/display/c/AA.+Bibliography#AA.Bibliography-ISO-IEC9899-2011)\], states that a thread shall not be joined once it was previously joined or detached. Similarly, subclause 7.26.5.3 states that a thread shall not be detached once it was previously joined or detached. Violating either of these subclauses results in [undefined behavior](https://wiki.sei.cmu.edu/confluence/display/c/BB.+Definitions#BB.Definitions-undefinedbehavior).
11+
12+
## Noncompliant Code Example
13+
14+
This noncompliant code example detaches a thread that is later joined.
15+
16+
```cpp
17+
#include <stddef.h>
18+
#include <threads.h>
19+
20+
int thread_func(void *arg) {
21+
/* Do work */
22+
thrd_detach(thrd_current());
23+
return 0;
24+
}
25+
26+
int main(void) {
27+
thrd_t t;
28+
29+
if (thrd_success != thrd_create(&t, thread_func, NULL)) {
30+
/* Handle error */
31+
return 0;
32+
}
33+
34+
if (thrd_success != thrd_join(t, 0)) {
35+
/* Handle error */
36+
return 0;
37+
}
38+
return 0;
39+
}
40+
```
41+
42+
## Compliant Solution
43+
44+
This compliant solution does not detach the thread. Its resources are released upon successfully joining with the main thread:
45+
46+
```cpp
47+
#include <stddef.h>
48+
#include <threads.h>
49+
50+
int thread_func(void *arg) {
51+
/* Do work */
52+
return 0;
53+
}
54+
55+
int main(void) {
56+
thrd_t t;
57+
58+
if (thrd_success != thrd_create(&t, thread_func, NULL)) {
59+
/* Handle error */
60+
return 0;
61+
}
62+
63+
if (thrd_success != thrd_join(t, 0)) {
64+
/* Handle error */
65+
return 0;
66+
}
67+
return 0;
68+
}
69+
```
70+
71+
## Risk Assessment
72+
73+
Joining or detaching a previously joined or detached thread is [undefined behavior](https://wiki.sei.cmu.edu/confluence/display/c/BB.+Definitions#BB.Definitions-undefinedbehavior).
74+
75+
<table> <tbody> <tr> <th> Rule </th> <th> Severity </th> <th> Likelihood </th> <th> Remediation Cost </th> <th> Priority </th> <th> Level </th> </tr> <tr> <td> CON39-C </td> <td> Low </td> <td> Likely </td> <td> Medium </td> <td> <strong>P6</strong> </td> <td> <strong>L2</strong> </td> </tr> </tbody> </table>
76+
77+
78+
## Automated Detection
79+
80+
<table> <tbody> <tr> <th> Tool </th> <th> Version </th> <th> Checker </th> <th> Description </th> </tr> <tr> <td> <a> Astrée </a> </td> <td> 22.04 </td> <td> </td> <td> Supported, but no explicit checker </td> </tr> <tr> <td> <a> CodeSonar </a> </td> <td> 7.1p0 </td> <td> <strong>CONCURRENCY.TNJ</strong> </td> <td> Thread is not Joinable </td> </tr> <tr> <td> <a> Helix QAC </a> </td> <td> 2022.3 </td> <td> <strong>C1776</strong> </td> <td> </td> </tr> <tr> <td> <a> Parasoft C/C++test </a> </td> <td> 2022.1 </td> <td> <strong>CERT_C-CON39-a</strong> </td> <td> Do not join or detach a thread that was previously joined or detached </td> </tr> <tr> <td> <a> Polyspace Bug Finder </a> </td> <td> R2022b </td> <td> <a> CERT C: Rule CON39-C </a> </td> <td> Checks for join or detach of a joined or detached thread (rule fully covered) </td> </tr> </tbody> </table>
81+
82+
83+
## Related Vulnerabilities
84+
85+
Search for [vulnerabilities](https://wiki.sei.cmu.edu/confluence/display/c/BB.+Definitions#BB.Definitions-vulnerability) resulting from the violation of this rule on the [CERT website](https://www.kb.cert.org/vulnotes/bymetric?searchview&query=FIELD+KEYWORDS+contains+CON39-C).
86+
87+
## Bibliography
88+
89+
<table> <tbody> <tr> <td> \[ <a> ISO/IEC 9899:2011 </a> \] </td> <td> Subclause 7.26.5.3, "The <code>thrd_detach</code> Function" Subclause 7.26.5.6, "The <code>thrd_join</code> Function" </td> </tr> </tbody> </table>
90+
91+
92+
## Implementation notes
93+
94+
This query considers problematic usages of join and detach irrespective of the execution of the program and other synchronization and interprocess communication mechanisms that may be used.
95+
96+
## References
97+
98+
* CERT-C: [CON39-C: Do not join or detach a thread that was previously joined or detached](https://wiki.sei.cmu.edu/confluence/display/c)
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,50 @@
1+
/**
2+
* @id c/cert/thread-was-previously-joined-or-detached
3+
* @name CON39-C: Do not join or detach a thread that was previously joined or detached
4+
* @description Joining or detaching a previously joined or detached thread can lead to undefined
5+
* program behavior.
6+
* @kind problem
7+
* @precision high
8+
* @problem.severity error
9+
* @tags external/cert/id/con39-c
10+
* correctness
11+
* concurrency
12+
* external/cert/obligation/rule
13+
*/
14+
15+
import cpp
16+
import codingstandards.c.cert
17+
import codingstandards.cpp.Concurrency
18+
19+
// OK
20+
// 1) Thread calls detach parent DOES NOT call join
21+
// 2) Parent calls join, thread does NOT call detach()
22+
// NOT OK
23+
// 1) Thread calls detach, parent calls join
24+
// 2) Thread calls detach twice, parent does not call join
25+
// 3) Parent calls join twice, thread does not call detach
26+
from C11ThreadCreateCall tcc
27+
where
28+
not isExcluded(tcc, Concurrency5Package::threadWasPreviouslyJoinedOrDetachedQuery()) and
29+
// Note: These cases can be simplified but they are presented like this for clarity
30+
// case 1 - calls to `thrd_join` and `thrd_detach` within the parent or
31+
// within the parent / child CFG.
32+
exists(C11ThreadWait tw, C11ThreadDetach dt |
33+
tw = getAThreadContextAwareSuccessor(tcc) and
34+
dt = getAThreadContextAwareSuccessor(tcc)
35+
)
36+
or
37+
// case 2 - multiple calls to `thrd_detach` within the threaded CFG.
38+
exists(C11ThreadDetach dt1, C11ThreadDetach dt2 |
39+
dt1 = getAThreadContextAwareSuccessor(tcc) and
40+
dt2 = getAThreadContextAwareSuccessor(tcc) and
41+
not dt1 = dt2
42+
)
43+
or
44+
// case 3 - multiple calls to `thrd_join` within the threaded CFG.
45+
exists(C11ThreadWait tw1, C11ThreadWait tw2 |
46+
tw1 = getAThreadContextAwareSuccessor(tcc) and
47+
tw2 = getAThreadContextAwareSuccessor(tcc) and
48+
not tw1 = tw2
49+
)
50+
select tcc, "Thread may call join or detach after the thread is joined or detached."
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,173 @@
1+
# CON40-C: Do not refer to an atomic variable twice in an expression
2+
3+
This query implements the CERT-C rule CON40-C:
4+
5+
> Do not refer to an atomic variable twice in an expression
6+
7+
8+
## Description
9+
10+
A consistent locking policy guarantees that multiple threads cannot simultaneously access or modify shared data. Atomic variables eliminate the need for locks by guaranteeing thread safety when certain operations are performed on them. The thread-safe operations on atomic variables are specified in the C Standard, subclauses 7.17.7 and 7.17.8 \[[ISO/IEC 9899:2011](https://wiki.sei.cmu.edu/confluence/display/c/AA.+Bibliography#AA.Bibliography-ISO%2FIEC9899-2011)\]. While atomic operations can be combined, combined operations do not provide the thread safety provided by individual atomic operations.
11+
12+
Every time an atomic variable appears on the left side of an assignment operator, including a compound assignment operator such as `*=`, an atomic write is performed on the variable. The use of the increment (++`)` or decrement `(--)` operators on an atomic variable constitutes an atomic read-and-write operation and is consequently thread-safe. Any reference of an atomic variable anywhere else in an expression indicates a distinct atomic read on the variable.
13+
14+
If the same atomic variable appears twice in an expression, then two atomic reads, or an atomic read and an atomic write, are required. Such a pair of atomic operations is not thread-safe, as another thread can modify the atomic variable between the two operations. Consequently, an atomic variable must not be referenced twice in the same expression.
15+
16+
## Noncompliant Code Example (atomic_bool)
17+
18+
This noncompliant code example declares a shared `atomic_bool` `flag` variable and provides a `toggle_flag()` method that negates the current value of `flag`:
19+
20+
```cpp
21+
#include <stdatomic.h>
22+
#include <stdbool.h>
23+
24+
static atomic_bool flag = ATOMIC_VAR_INIT(false);
25+
26+
void init_flag(void) {
27+
atomic_init(&flag, false);
28+
}
29+
30+
void toggle_flag(void) {
31+
bool temp_flag = atomic_load(&flag);
32+
temp_flag = !temp_flag;
33+
atomic_store(&flag, temp_flag);
34+
}
35+
36+
bool get_flag(void) {
37+
return atomic_load(&flag);
38+
}
39+
40+
```
41+
Execution of this code may result in unexpected behavior because the value of `flag` is read, negated, and written back. This occurs even though the read and write are both atomic.
42+
43+
Consider, for example, two threads that call `toggle_flag()`. The expected effect of toggling `flag` twice is that it is restored to its original value. However, the scenario in the following table leaves `flag` in the incorrect state.
44+
45+
`toggle_flag()` without Compare-and-Exchange
46+
47+
<table> <tbody> <tr> <th> Time </th> <th> <code>flag</code> </th> <th> Thread </th> <th> Action </th> </tr> <tr> <td> 1 </td> <td> <code>true</code> </td> <td> <em> t </em> <sub> 1 </sub> </td> <td> Reads the current value of <code>flag</code> , which is <code>true,</code> into a cache </td> </tr> <tr> <td> 2 </td> <td> <code>true</code> </td> <td> <em> t </em> <sub> 2 </sub> </td> <td> Reads the current value of <code>flag</code> , which is still <code>true,</code> into a different cache </td> </tr> <tr> <td> 3 </td> <td> <code>true</code> </td> <td> <em> t </em> <sub> 1 </sub> </td> <td> Toggles the temporary variable in the cache to <code>false</code> </td> </tr> <tr> <td> 4 </td> <td> <code>true</code> </td> <td> <em> t </em> <sub> 2 </sub> </td> <td> Toggles the temporary variable in the different cache to <code>false</code> </td> </tr> <tr> <td> 5 </td> <td> <code>false</code> </td> <td> <em> t </em> <sub> 1 </sub> </td> <td> Writes the cache variable's value to <code>flag</code> </td> </tr> <tr> <td> 6 </td> <td> <code>false</code> </td> <td> <em> t </em> <sub> 2 </sub> </td> <td> Writes the different cache variable's value to <code>flag</code> </td> </tr> </tbody> </table>
48+
As a result, the effect of the call by *t*<sub>2</sub> is not reflected in `flag`; the program behaves as if `toggle_flag()` was called only once, not twice.
49+
50+
51+
## Compliant Solution (atomic_compare_exchange_weak())
52+
53+
This compliant solution uses a compare-and-exchange to guarantee that the correct value is stored in `flag`. All updates are visible to other threads. The call to `atomic_compare_exchange_weak()` is in a loop in conformance with [CON41-C. Wrap functions that can fail spuriously in a loop](https://wiki.sei.cmu.edu/confluence/display/c/CON41-C.+Wrap+functions+that+can+fail+spuriously+in+a+loop).
54+
55+
```cpp
56+
#include <stdatomic.h>
57+
#include <stdbool.h>
58+
59+
static atomic_bool flag = ATOMIC_VAR_INIT(false);
60+
61+
void init_flag(void) {
62+
atomic_init(&flag, false);
63+
}
64+
65+
void toggle_flag(void) {
66+
bool old_flag = atomic_load(&flag);
67+
bool new_flag;
68+
do {
69+
new_flag = !old_flag;
70+
} while (!atomic_compare_exchange_weak(&flag, &old_flag, new_flag));
71+
}
72+
73+
bool get_flag(void) {
74+
return atomic_load(&flag);
75+
}
76+
```
77+
An alternative solution is to use the `atomic_flag` data type for managing Boolean values atomically. However, `atomic_flag` does not support a toggle operation.
78+
79+
## Compliant Solution (Compound Assignment)
80+
81+
This compliant solution uses the `^=` assignment operation to toggle `flag`. This operation is guaranteed to be atomic, according to the C Standard, 6.5.16.2, paragraph 3. This operation performs a bitwise-exclusive-or between its arguments, but for Boolean arguments, this is equivalent to negation.
82+
83+
```cpp
84+
#include <stdatomic.h>
85+
#include <stdbool.h>
86+
87+
static atomic_bool flag = ATOMIC_VAR_INIT(false);
88+
89+
void toggle_flag(void) {
90+
flag ^= 1;
91+
}
92+
93+
bool get_flag(void) {
94+
return flag;
95+
}
96+
```
97+
An alternative solution is to use a mutex to protect the atomic operation, but this solution loses the performance benefits of atomic variables.
98+
99+
## Noncompliant Code Example
100+
101+
This noncompliant code example takes an atomic global variable `n` and computes `n + (n - 1) + (n - 2) + ... + 1`, using the formula `n * (n + 1) / 2`:
102+
103+
```cpp
104+
#include <stdatomic.h>
105+
106+
atomic_int n = ATOMIC_VAR_INIT(0);
107+
108+
int compute_sum(void) {
109+
return n * (n + 1) / 2;
110+
}
111+
```
112+
The value of `n` may change between the two atomic reads of `n` in the expression, yielding an incorrect result.
113+
114+
## Compliant Solution
115+
116+
This compliant solution passes the atomic variable as a function argument, forcing the variable to be copied and guaranteeing a correct result. Note that the function's formal parameter need not be atomic, and the atomic variable can still be passed as an actual argument.
117+
118+
```cpp
119+
#include <stdatomic.h>
120+
121+
int compute_sum(int n) {
122+
return n * (n + 1) / 2;
123+
}
124+
125+
```
126+
127+
## Risk Assessment
128+
129+
When operations on atomic variables are assumed to be atomic, but are not atomic, surprising data races can occur, leading to corrupted data and invalid control flow.
130+
131+
<table> <tbody> <tr> <th> Rule </th> <th> Severity </th> <th> Likelihood </th> <th> Remediation Cost </th> <th> Priority </th> <th> Level </th> </tr> <tr> <td> CON40-C </td> <td> Medium </td> <td> Probable </td> <td> Medium </td> <td> <strong>P8</strong> </td> <td> <strong>L2</strong> </td> </tr> </tbody> </table>
132+
133+
134+
## Automated Detection
135+
136+
<table> <tbody> <tr> <th> Tool </th> <th> Version </th> <th> Checker </th> <th> Description </th> </tr> <tr> <td> <a> Astrée </a> </td> <td> 22.04 </td> <td> <strong>multiple-atomic-accesses</strong> </td> <td> Partially checked </td> </tr> <tr> <td> <a> Axivion Bauhaus Suite </a> </td> <td> 7.2.0 </td> <td> <strong>CertC-CON40</strong> </td> <td> </td> </tr> <tr> <td> <a> CodeSonar </a> </td> <td> 7.1p0 </td> <td> <strong>CONCURRENCY.MAA</strong> </td> <td> Multiple Accesses of Atomic </td> </tr> <tr> <td> <a> Coverity </a> </td> <td> 2017.07 </td> <td> <strong>EVALUATION_ORDER (partial)</strong> <strong>MISRA 2012 Rule 13.2</strong> <strong>VOLATILE_ATOICITY (possible)</strong> </td> <td> Implemented </td> </tr> <tr> <td> <a> Helix QAC </a> </td> <td> 2022.3 </td> <td> <strong>C1114, C1115, C1116</strong> <strong>C++3171, C++4150</strong> </td> <td> </td> </tr> <tr> <td> <a> Klocwork </a> </td> <td> 2022.3 </td> <td> <strong>CERT.CONC.ATOMIC_TWICE_EXPR</strong> </td> <td> </td> </tr> <tr> <td> <a> Parasoft C/C++test </a> </td> <td> 2022.1 </td> <td> <strong>CERT_C-CON40-a</strong> </td> <td> Do not refer to an atomic variable twice in an expression </td> </tr> <tr> <td> <a> Polyspace Bug Finder </a> </td> <td> R2022b </td> <td> <a> CERT C: Rule CON40-C </a> </td> <td> Checks for: Atomic variable accessed twice in an expressiontomic variable accessed twice in an expression, atomic load and store sequence not atomictomic load and store sequence not atomic. Rule fully covered. </td> </tr> <tr> <td> <a> PRQA QA-C </a> </td> <td> 9.7 </td> <td> <strong>1114, 1115, 1116 </strong> </td> <td> </td> </tr> <tr> <td> <a> RuleChecker </a> </td> <td> 22.04 </td> <td> <strong>multiple-atomic-accesses</strong> </td> <td> Partially checked </td> </tr> </tbody> </table>
137+
138+
139+
## Related Vulnerabilities
140+
141+
Search for [vulnerabilities](https://www.securecoding.cert.org/confluence/display/seccode/BB.+Definitions#BB.Definitions-vulnerability) resulting from the violation of this rule on the [CERT website](https://www.kb.cert.org/vulnotes/bymetric?searchview&query=FIELD+KEYWORDS+contains+CON40-C).
142+
143+
## Related Guidelines
144+
145+
[Key here](https://wiki.sei.cmu.edu/confluence/display/c/How+this+Coding+Standard+is+Organized#HowthisCodingStandardisOrganized-RelatedGuidelines) (explains table format and definitions)
146+
147+
<table> <tbody> <tr> <th> Taxonomy </th> <th> Taxonomy item </th> <th> Relationship </th> </tr> <tr> <td> <a> CWE 2.11 </a> </td> <td> <a> CWE-366 </a> , Race Condition within a Thread </td> <td> 2017-07-07: CERT: Rule subset of CWE </td> </tr> </tbody> </table>
148+
149+
150+
## CERT-CWE Mapping Notes
151+
152+
[Key here](https://wiki.sei.cmu.edu/confluence/pages/viewpage.action?pageId=87152408#HowthisCodingStandardisOrganized-CERT-CWEMappingNotes) for mapping notes
153+
154+
**CWE-366 and CON40-C**
155+
156+
CON40-C = Subset( CON43-C) Intersection( CON32-C, CON40-C) = Ø
157+
158+
CWE-366 = Union( CON40-C, list) where list =
159+
160+
* C data races that do not involve an atomic variable used twice within an expression
161+
162+
## Bibliography
163+
164+
<table> <tbody> <tr> <td> \[ <a> ISO/IEC 9899:2011 </a> \] </td> <td> 6.5.16.2, "Compound Assignment" 7.17, "Atomics" </td> </tr> </tbody> </table>
165+
166+
167+
## Implementation notes
168+
169+
None
170+
171+
## References
172+
173+
* CERT-C: [CON40-C: Do not refer to an atomic variable twice in an expression](https://wiki.sei.cmu.edu/confluence/display/c)
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,47 @@
1+
/**
2+
* @id c/cert/atomic-variable-twice-in-expression
3+
* @name CON40-C: Do not refer to an atomic variable twice in an expression
4+
* @description Atomic variables that are referred to twice in the same expression can produce
5+
* unpredictable program behavior.
6+
* @kind problem
7+
* @precision very-high
8+
* @problem.severity error
9+
* @tags external/cert/id/con40-c
10+
* correctness
11+
* concurrency
12+
* external/cert/obligation/rule
13+
*/
14+
15+
import cpp
16+
import codingstandards.c.cert
17+
18+
from MacroInvocation mi, Variable v, Locatable whereFound
19+
where
20+
not isExcluded(whereFound, Concurrency5Package::atomicVariableTwiceInExpressionQuery()) and
21+
(
22+
// There isn't a way to safely use this construct in a way that is also
23+
// possible the reliably detect so advise against using it.
24+
(
25+
mi.getMacroName() = ["atomic_store", "atomic_store_explicit"]
26+
or
27+
// This construct is generally safe, but must be used in a loop. To lower
28+
// the false positive rate we don't look at the conditions of the loop and
29+
// instead assume if it is found in a looping construct that it is likely
30+
// related to the safety property.
31+
mi.getMacroName() = ["atomic_compare_exchange_weak", "atomic_compare_exchange_weak_explicit"] and
32+
not exists(Loop l | mi.getAGeneratedElement().(Expr).getParent*() = l)
33+
) and
34+
whereFound = mi
35+
)
36+
or
37+
mi.getMacroName() = "ATOMIC_VAR_INIT" and
38+
exists(Expr av |
39+
av = mi.getAGeneratedElement() and
40+
av = v.getAnAssignedValue() and
41+
exists(Assignment m |
42+
not m instanceof AssignXorExpr and
43+
m.getLValue().(VariableAccess).getTarget() = v and
44+
whereFound = m
45+
)
46+
)
47+
select mi, "Atomic variable possibly referred to twice in an $@.", whereFound, "expression"
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,8 @@
1+
| test.c:26:3:26:13 | call to thrd_create | Thread may call join or detach after the thread is joined or detached. |
2+
| test.c:32:3:32:13 | call to thrd_create | Thread may call join or detach after the thread is joined or detached. |
3+
| test.c:37:3:37:13 | call to thrd_create | Thread may call join or detach after the thread is joined or detached. |
4+
| test.c:58:3:58:13 | call to thrd_create | Thread may call join or detach after the thread is joined or detached. |
5+
| test.c:66:3:66:13 | call to thrd_create | Thread may call join or detach after the thread is joined or detached. |
6+
| test.c:73:3:73:13 | call to thrd_create | Thread may call join or detach after the thread is joined or detached. |
7+
| test.c:87:3:87:13 | call to thrd_create | Thread may call join or detach after the thread is joined or detached. |
8+
| test.c:94:3:94:13 | call to thrd_create | Thread may call join or detach after the thread is joined or detached. |
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
rules/CON39-C/ThreadWasPreviouslyJoinedOrDetached.ql

0 commit comments

Comments
 (0)