icechunk
https://github.com/earth-mover/icechunk
Rust
Open-source, cloud-native transactional tensor storage engine
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Rust not yet supported1 Subscribers
Add a CodeTriage badge to icechunk
Help out
- Issues
- Storage tiering of native chunks by array (per-array storage class or key prefix)
- Feature: Manifest Packing
- Ian/coalescing gets
- RepositoryConfig storage settings seem to be silently ignored if the Storage object was used unconfigured first
- Uncompressed reads incur an extra buffer copy
- LocalFileSystem storage fails on FUSE mounts without rename()/link() support (e.g. Databricks Unity Catalog Volumes)
- Add design doc for configurable chunk directory layout
- Add configurable chunk directory layout
- GCS requester-pays support for virtual stores
- Design document for better I/O control
- Docs
- Rust not yet supported