Ensure physical removal of deleted Iceberg data for GDPR and CCPA compliance. Merges delete files with data files to eliminate non-compliant records.
In Iceberg, deleting a record doesn’t guarantee its physical removal from storage. Data may still exist in:
Old snapshots
Orphan files
Delete files (created when writing in Merge-on-Read mode)
Compliance Cleanup ensures that deleted data is physically removed from your Iceberg tables, meeting the requirements of GDPR, CCPA, and other data privacy regulations.
It does so by merging delete files and data files, validating that no deleted data remains in the data files.
When enabled together with snapshot expiration and orphan file cleanup, it ensures that deleted data is fully removed from the table’s storage footprint.Enable Compliance Cleanup for any table that requires compliance with data privacy regulations.