You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Iceberg encrypted metadata planning and the file-key wire contract are available after #70192 and #70213, but native encrypted Parquet data-file reading is not implemented yet.
The next independently reviewable units are:
Extract each data file's StandardKeyMetadata key and AAD into every scan split, preserving plaintext files and rejecting malformed metadata without exposing key material.
Decrypt Parquet encrypted footers, page headers, dictionary pages and data pages through parquet-cpp crypto primitives, while keeping the native Doris decoder.
Keep encrypted SQL admission disabled during these stages. Encrypted indexes, delete files and final scan integration need their own follow-up validation before execution is enabled.
Also fix the encrypted metadata fixture reset so that retained HMS tables can be recreated after the disposable KMS restarts with fresh keys. Validate the first reset after restart with the SDK and Spark reference readers.
Activity
[fix](iceberg) Preserve file encryption guards in count and delete pl…
[test](iceberg) Expand native encryption unit and SQL regression cove…
[refactor](parquet) Simplify native column reader construction
[fix](iceberg) Reject encrypted COUNT before eager scan fallback
[fix](parquet) Charge native metadata containers independently of wir…
[fix](iceberg) Reclaim decrypted page scratch and fix GCC unity build
[feature](iceberg) Propagate per-file encryption keys to scan splits (#…
[feature](iceberg) Add native encrypted Parquet reads (#70248)