distributed
https://github.com/dask/distributed
Python
A distributed task scheduler for Dask
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Python not yet supported38 Subscribers
Add a CodeTriage badge to distributed
Help out
- Issues
- `SpecCluster` fails to remove grouped workers when they die, breaking adaptive scaling
- Semantic mismatch in `SpecCluster.requested`
- check if a Plugin is present
- Resource scheduling bug: Scheduler allows over-allocation by ignoring worker's current resource usage
- Add ForwardLoggingPlugin and ForwardOutput to built-in worker plugins documentation
- Forward `multiprocessing.current_process().authkey` to workers
- LocalCluster fails to spawn requested number of workers (capped at 5 workers on Windows)
- Add `Condition` class
- distributed zarr write fail - OSError: too many open files; P2PConsistencyError: No active shuffle with
- improve support for grouped workers in `SpecCluster`
- Docs
- Python not yet supported