Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Hotfix: Ignore negative occupancy #9012

Merged
merged 3 commits into from
Feb 13, 2025

Conversation

hendrikmakait
Copy link
Member

This PR adds a hotfix that handles drift in occupancy leading to negative values.

  • Tests added / passed
  • Passes pre-commit run --all-files

self._network_occ -= nbytes
self.scheduler._network_occ_global -= nbytes
# FIXME: ts.get_nbytes may change if non-deterministic tasks get recomputed, causing drift
self._network_occ -= min(nbytes, self._network_occ)
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

is network_occ an integer or are we dealing with floating point foo at this point?

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

looks like _network_occ_global is defined as a float. I guess this won't be a drama since we only add and subtract integers.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I've adjusted types and initial values to match the assumption of integer values.

@hendrikmakait hendrikmakait marked this pull request as ready for review February 13, 2025 12:43
@hendrikmakait hendrikmakait mentioned this pull request Feb 13, 2025
4 tasks
Copy link
Contributor

Unit Test Results

See test report for an extended history of previous test failures. This is useful for diagnosing flaky tests.

    27 files  ±0      27 suites  ±0   11h 19m 21s ⏱️ - 3m 43s
 4 120 tests ±0   4 006 ✅ ±0    111 💤 ±0  3 ❌ ±0 
51 667 runs  ±0  49 368 ✅ ±0  2 296 💤 ±0  3 ❌ ±0 

For more details on these failures, see this check.

Results for commit b121e39. ± Comparison against base commit 33b229a.

@hendrikmakait hendrikmakait merged commit 8efe8fb into dask:main Feb 13, 2025
28 of 31 checks passed
@hendrikmakait hendrikmakait deleted the hotfix-network-occupancy-drift branch February 13, 2025 14:39
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants