Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use Expr instead of HLG #9008

Open
wants to merge 23 commits into
base: main
Choose a base branch
from
+362 −347
Open

Use Expr instead of HLG #9008

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
23 commits
Select commit Hold shift + click to select a range
3bebf55
use expressions instead of HLG
fjetter Feb 12, 2025
cfc4f27
Rename graph_header and frames
fjetter Feb 13, 2025
065f886
test against fork
fjetter Feb 13, 2025
5d63ac3
remove dead test code
fjetter Feb 13, 2025
9884c3e
flatten keys
fjetter Feb 18, 2025
666cab4
fix annotations
fjetter Mar 18, 2025
6b08ef2
fix tests
fjetter Mar 18, 2025
b464549
rename collections_to_dsk
fjetter Mar 18, 2025
a1bcf0a
handle empty compute and determ token for map
fjetter Mar 18, 2025
3b40318
better lost deps log msg
fjetter Mar 19, 2025
ce5a886
[skip-caching]
fjetter Mar 19, 2025
ffe7cd4
Fix Client.persist
fjetter Mar 19, 2025
47fccc3
add more persist tests
fjetter Mar 19, 2025
75426a2
[skip-caching]
fjetter Mar 19, 2025
309ee85
[skip-caching]
fjetter Mar 19, 2025
56e7e2b
[skip-caching]
fjetter Mar 19, 2025
3377b93
better comment
fjetter Mar 20, 2025
f95c42a
add kwarg to force shuffle
fjetter Mar 20, 2025
b358bca
Remove race from test_worker_clients_do_not_claim_ownership_of_serial…
fjetter Mar 20, 2025
3c93836
avoid cloudpickle
fjetter Mar 20, 2025
149910d
use better class names
fjetter Mar 20, 2025
fa6068a
more robust test_worker_clients_do_not_claim_ownership_of_serialize_f…
fjetter Mar 20, 2025
bfc2438
change order of lost keys detection
fjetter Mar 20, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .pre-commit-config.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -64,7 +64,7 @@ repos:
- tornado
- pyarrow
- urllib3
- git+https://github.com/dask/dask
- git+https://github.com/fjetter/dask@wrap_hlg_expr
- git+https://github.com/dask/zict

# Increase this value to clear the cache on GitHub actions if nothing else in this file
Expand Down
2 changes: 1 addition & 1 deletion continuous_integration/environment-3.10.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -56,7 +56,7 @@ dependencies:
# Temporary fix for https://github.com/jupyterlab/jupyterlab/issues/17012
- httpx<0.28.0
- pip:
- git+https://github.com/dask/dask
- git+https://github.com/fjetter/dask@wrap_hlg_expr
- git+https://github.com/dask/zict
- git+https://github.com/dask/crick # Only tested here
# Revert after https://github.com/dask/distributed/issues/8614 is fixed
Expand Down
2 changes: 1 addition & 1 deletion continuous_integration/environment-3.11.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -50,7 +50,7 @@ dependencies:
# Temporary fix for https://github.com/jupyterlab/jupyterlab/issues/17012
- httpx<0.28.0
- pip:
- git+https://github.com/dask/dask
- git+https://github.com/fjetter/dask@wrap_hlg_expr
- git+https://github.com/dask/zict
# Revert after https://github.com/dask/distributed/issues/8614 is fixed
# - git+https://github.com/dask/s3fs
Expand Down
2 changes: 1 addition & 1 deletion continuous_integration/environment-3.12.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -50,7 +50,7 @@ dependencies:
# Temporary fix for https://github.com/jupyterlab/jupyterlab/issues/17012
- httpx<0.28.0
- pip:
- git+https://github.com/dask/dask
- git+https://github.com/fjetter/dask@wrap_hlg_expr
- git+https://github.com/dask/zict
# Revert after https://github.com/dask/distributed/issues/8614 is fixed
# - git+https://github.com/dask/s3fs
Expand Down
2 changes: 1 addition & 1 deletion continuous_integration/environment-3.13.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -49,7 +49,7 @@ dependencies:
# Temporary fix for https://github.com/jupyterlab/jupyterlab/issues/17012
- httpx<0.28.0
- pip:
- git+https://github.com/dask/dask
- git+https://github.com/fjetter/dask@wrap_hlg_expr
- git+https://github.com/dask/zict
# Revert after https://github.com/dask/distributed/issues/8614 is fixed
# - git+https://github.com/dask/s3fs
Expand Down
2 changes: 1 addition & 1 deletion continuous_integration/environment-mindeps.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -23,7 +23,7 @@ dependencies:
# Distributed depends on the latest version of Dask
- pip
- pip:
- git+https://github.com/dask/dask
- git+https://github.com/fjetter/dask@wrap_hlg_expr
# test dependencies
- pytest
- pytest-cov
Expand Down
Loading
Loading