Repository navigation

Add v2 and v3 metadata support to codecs - #3332

Open

d-v-b wants to merge 148 commits into

zarr-developers:mainfrom

d-v-b:feat/v2-v3-codecs

Open

Add v2 and v3 metadata support to codecs#3332
d-v-b wants to merge 148 commits into
zarr-developers:mainfrom
d-v-b:feat/v2-v3-codecs

Commits on Jul 31, 2025
- add numcodec protocol
  d-v-b
  committed
  a367268
- add tests for numcodecs compatibility
  d-v-b
  committed
  1d424c0
- changelog
  d-v-b
  committed
  41dd6ff
- ignore unknown key
  d-v-b
  committed
  c435a59
Commits on Aug 1, 2025
- remove re-implementation of get_codec
  d-v-b
  committed
  8e50ef8
- Merge branch 'main' into feat/numcodecs-protocol
  d-v-b
  authored
  ef31c5b
Commits on Aug 4, 2025
- Merge branch 'main' into feat/numcodecs-protocol
  d-v-b
  authored
  4ba7914
- Merge branch 'main' into feat/numcodecs-protocol
  d-v-b
  authored
  ab52539
- Merge branch 'main' into feat/numcodecs-protocol
  d-v-b
  authored
  95c9c8b
- add to_json methods to codecs
  d-v-b
  committed
  156134f
- add codecvalidationerror
  d-v-b
  committed
  486f837
- fix v2 codec json models to avoid inheritance
  d-v-b
  committed
  dd53981
- add blosc json test
  d-v-b
  committed
  678889a
- distinguish namedconfig from namedrequiredconfig
  d-v-b
  committed
  dfca3ec
- lint
  d-v-b
  committed
  262e369
- make codecvalidationerror effectively single-argument
  d-v-b
  committed
  4c7fe8a
- rename test_endian to test_bytes
  d-v-b
  committed
  1e23a91
- bring in update codec abc
  d-v-b
  committed
  d7d4e02
- add to_json_tests
  d-v-b
  committed
  9980823
- Merge branch 'main' into feat/numcodecs-protocol
  d-v-b
  authored
  fcf84b3
- lint
  d-v-b
  committed
  cbb32d7
- fix broken tests that used invalid codec JSON
  d-v-b
  committed
  e2d4df8
- update test_info
  d-v-b
  committed
  d91b0e9
- avoid circular imports by moving numcodec protocol to codec abc
  d-v-b
  committed
  1eb5b3c
- use Numcodec instead of numcodecs.abc.Codec
  d-v-b
  committed
  94ba77a
- Wip implementation of v2 / v3 codec behavior
  d-v-b
  committed
  f1ca290
Commits on Aug 5, 2025
- Merge branch 'main' into feat/numcodecs-protocol
  d-v-b
  authored
  5b0c3ac
- avoid circular imports by importing lower-level routines exactly where needed
  d-v-b
  committed
  84c9780
- push numcodec prototol into abcs; remove all numcodecs.abc.Codec type annotations
  d-v-b
  committed
  9a2f35b
- add tests for codecjson typeguard
  d-v-b
  committed
  0d0712f
- avoid using zarr's buffer / ndbuffer for numcodec encode / decode
  d-v-b
  committed
  931bf2f
- use Any to model input / output types of numcodec protocol
  d-v-b
  committed
  01bd4b7
- add numcodec protocol
  d-v-b
  committed
  f06c6aa
- add tests for numcodecs compatibility
  d-v-b
  committed
  b71e8ac
- changelog
  d-v-b
  committed
  bcaa9ee
- ignore unknown key
  d-v-b
  committed
  7e49f39
- remove re-implementation of get_codec
  d-v-b
  committed
  4b53f5d
- avoid circular imports by importing lower-level routines exactly where needed
  d-v-b
  committed
  b35e6c9
- push numcodec prototol into abcs; remove all numcodecs.abc.Codec type annotations
  d-v-b
  committed
  deef94a
- add tests for codecjson typeguard
  d-v-b
  committed
  f057525
- avoid using zarr's buffer / ndbuffer for numcodec encode / decode
  d-v-b
  committed
  190e1b2
- use Any to model input / output types of numcodec protocol
  d-v-b
  committed
  82992c5
- Merge branch 'feat/numcodecs-protocol' of github.com:d-v-b/zarr-python into feat/numcodecs-protocol
  d-v-b
  committed
  7ea7e91
Commits on Aug 6, 2025
- Merge branch 'main' into feat/numcodecs-protocol
  d-v-b
  authored
  cee4389
- Merge branch 'feat/numcodecs-protocol' of github.com:d-v-b/zarr-python into feat/v2-v3-codecs
  d-v-b
  committed
  51b9431
Commits on Aug 13, 2025
- bring in contents of numcodecs.zarr3
  d-v-b
  committed
  0183eb5
- fix tests
  d-v-b
  committed
  5f06c9e
- fix docs
  d-v-b
  committed
  e64830f
- fix config test
  d-v-b
  committed
  b6b2260
- Merge branch 'main' of https://github.com/zarr-developers/zarr-python into feat/v2-v3-codecs
  d-v-b
  committed
  a971e9c
Commits on Aug 17, 2025
- Merge branch 'main' into chore/handle-numcodecs-codecs
  d-v-b
  authored
  92e9442
Commits on Aug 18, 2025
- Merge branch 'main' into chore/handle-numcodecs-codecs
  d-v-b
  authored
  233fbbf
- make zarr.codecs.numcodecs
  d-v-b
  committed
  223ae65
Commits on Aug 19, 2025
Commits on Aug 21, 2025
- Merge branch 'main' of github.com:zarr-developers/zarr-python into feat/v2-v3-codecs
  d-v-b
  committed
  9a0d163
- adjust sharding JSON model
  d-v-b
  committed
  9ac07da
- fix info tests
  d-v-b
  committed
  90a7aca
- remove redundant declaration
  d-v-b
  committed
  d64a5d2
- make test_info more robust
  d-v-b
  committed
  7895f8f
- fix imports and type checking
  d-v-b
  committed
  41459eb
- add temporary default implementations of json ser/de serialization
  d-v-b
  committed
  096cc1a
- temporarily skip codec refinement in v2 metadata
  d-v-b
  committed
  de9e3dd
- changelog
  d-v-b
  committed
  d5e0461
- Merge branch 'main' of github.com:zarr-developers/zarr-python into chore/handle-numcodecs-codecs
  d-v-b
  committed
  e3e1216
- Merge branch 'chore/handle-numcodecs-codecs' of github.com:d-v-b/zarr-python into feat/v2-v3-codecs
  d-v-b
  committed
  666186f
- register codecs in codecs/__init__.py
  d-v-b
  committed
  0a724e6
- remove old registration sites
  d-v-b
  committed
  f023487
- Merge branch 'chore/handle-numcodecs-codecs' of github.com:d-v-b/zarr-python into feat/v2-v3-codecs
  d-v-b
  committed
  dedeaf6
- wip
  d-v-b
  committed
  6636c10
- Merge branch 'main' of github.com:zarr-developers/zarr-python into feat/v2-v3-codecs
  d-v-b
  committed
  3d910a5
- wip
  d-v-b
  committed
  53c6b46
Commits on Sep 2, 2025
Commits on Sep 13, 2025
- Merge branch 'main' of github.com:zarr-developers/zarr-python into feat/v2-v3-codecs
  d-v-b
  committed
  122b19e
- improve method annotations for numcodecs codecs
  d-v-b
  committed
  a134233
Commits on Sep 14, 2025
- fixup
  d-v-b
  committed
  fe21d7c
Commits on Sep 15, 2025
- revert enum removal, fix doctests
  d-v-b
  committed
  0252ac3
- fix info test
  d-v-b
  committed
  dd22a98
- Merge branch 'main' into feat/v2-v3-codecs
  d-v-b
  authored
  9cebaaf
- bump minimum version of typing_extensions
  d-v-b
  committed
  ea7594c
- Merge branch 'main' of github.com:zarr-developers/zarr-python into feat/v2-v3-codecs
  d-v-b
  committed
  2e316ed
- use consistent typing_extensions version
  d-v-b
  committed
  68da9bf
- fix type annotation in overload
  d-v-b
  committed
  33d0bd9
- use parse_dtype
  d-v-b
  committed
  1c9f9fe
- revert mangling of create overloads
  d-v-b
  committed
  d53d153
- refactor codecjson types to avoid circular dependency
  d-v-b
  committed
  951560b
- move codecjson definition to common
  d-v-b
  committed
  9722e9b
- update typeddicts, and handle location in crc32c codec json
  d-v-b
  committed
  bb76132
- adjust error message
  d-v-b
  committed
  65c2415
- fix json roundtrip tests
  d-v-b
  committed
  a63982f
Commits on Sep 16, 2025
- correct test invocations and weaken the requirements for crc32c json
  d-v-b
  committed
  50849fe
- lint
  d-v-b
  committed
  a93d015
Commits on Sep 22, 2025
- Merge branch 'main' of github.com:zarr-developers/zarr-python into feat/v2-v3-codecs
  d-v-b
  committed
  4363092
- fix stale import
  d-v-b
  committed
  48e4d03
- simplify type in _LikeArgs
  d-v-b
  committed
  8a68ed8
- fix stale imports
  d-v-b
  committed
  28c5b3b
- simplify tests
  d-v-b
  committed
  193887a
- add default compute_encoded_size implementations
  d-v-b
  committed
  19762ce
- remove cache poisoing bug, and deploy type checker throughout the codebase
  d-v-b
  committed
  97002a9
- lint
  d-v-b
  committed
  7fcbbd3
- lint
  d-v-b
  committed
  cbf71a6
- make cli tests pass
  d-v-b
  committed
  8566a8f
- add imagecodec example
  d-v-b
  committed
  4609d23
- fix blosc parsing from dict by ensuring that typesize is set on deserialization path
  d-v-b
  committed
  c82649f
Commits on Sep 23, 2025
- Merge branch 'main' into feat/v2-v3-codecs
  d-v-b
  authored
  bc43d5a
- Merge branch 'main' of github.com:zarr-developers/zarr-python into feat/v2-v3-codecs
  d-v-b
  committed
  b770694
Commits on Sep 24, 2025
- add some new codecs to regression tests
  d-v-b
  committed
  5c577e1
- add changelog
  d-v-b
  committed
  b3d5659
- add changelog
  d-v-b
  committed
  c7e4676
- per-codec tests for new codecs
  d-v-b
  committed
  9c09932
- add some docstrings and fix sharding JSON check
  d-v-b
  committed
  15eb997
- lint
  d-v-b
  committed
  3fb7126
- refactor codec parsing and add tests
  d-v-b
  committed
  56ad592
- update codec tests
  d-v-b
  committed
  9510a5e
Commits on Sep 25, 2025
- type-safety and more improvements using delta codec as a template
  d-v-b
  committed
  feb2047
- weaken codec JSON test, update crc32c test cases
  d-v-b
  committed
  e769f31
- pull array-array codecs out into their own modules, and design codec JSON properly
  d-v-b
  committed
  ce28794
- Merge branch 'main' of github.com:zarr-developers/zarr-python into feat/v2-v3-codecs
  d-v-b
  committed
  8c9aa99
- lint
  d-v-b
  committed
  90666ea
- fix json deserialization for fixed scale offset
  d-v-b
  committed
  af6eef9
- make numcodecs codecs backwards compatible
  d-v-b
  committed
  d0d5e92
- lint
  d-v-b
  committed
  f4598c8
- update test to use to_json output
  d-v-b
  committed
  79f4e31
- lint
  d-v-b
  committed
  7a47ef7
Commits on Sep 29, 2025
- fix crc32c json decoding
  d-v-b
  committed
  a483153
- use explicit integer dtype in blosc test
  d-v-b
  committed
  e72f905
- ensure forward compatibility for older versions of zarr python 3.x
  d-v-b
  committed
  172e01f
- fix astype test
  d-v-b
  committed
  b2526d2
Commits on Oct 3, 2025
- Merge branch 'main' of https://github.com/zarr-developers/zarr-python into feat/v2-v3-codecs
  d-v-b
  committed
  e1afd34
- Merge branch 'main' into feat/v2-v3-codecs
  d-v-b
  authored
  1111c93
Commits on Oct 22, 2025
Commits on Oct 27, 2025
- Merge branch 'main' of https://github.com/zarr-developers/zarr-python into feat/v2-v3-codecs
  d-v-b
  committed
  ff7a1a5
- fix aliases, deprecate old codecs
  d-v-b
  committed
  e3b3fe2
Commits on Oct 28, 2025
- full json alias logic
  d-v-b
  committed
  4e03381
Commits on Nov 25, 2025
- Merge branch 'main' of https://github.com/zarr-developers/zarr-python into feat/v2-v3-codecs
  d-v-b
  committed
  3cd4808
Commits on Nov 27, 2025
- refactor regression tests and fix problems revealed thereby
  d-v-b
  committed
  210759f
- tidy up imports
  d-v-b
  committed
  7891800
- use rglob to actually capture examples
  d-v-b
  committed
  19c782d
- use consistent structure for examples
  d-v-b
  committed
  f4b3a65
Commits on Dec 16, 2025
- Merge branch 'main' of github.com:zarr-developers/zarr-python into feat/v2-v3-codecs
  d-v-b
  committed
  83987ed

Commits

Commits on Jul 31, 2025

Commits on Aug 1, 2025

Commits on Aug 4, 2025

Commits on Aug 5, 2025

Commits on Aug 6, 2025

Commits on Aug 13, 2025

Commits on Aug 17, 2025

Commits on Aug 18, 2025

Commits on Aug 19, 2025

Commits on Aug 21, 2025

Commits on Sep 2, 2025

Commits on Sep 13, 2025

Commits on Sep 14, 2025

Commits on Sep 15, 2025

Commits on Sep 16, 2025

Commits on Sep 22, 2025

Commits on Sep 23, 2025

Commits on Sep 24, 2025

Commits on Sep 25, 2025