From 37f0fe2b3ed01ded0cdbf0d82bca4e7350b9aad0 Mon Sep 17 00:00:00 2001 From: Vinish Reddy Date: Thu, 22 Aug 2024 17:17:01 +0530 Subject: [PATCH] Add release notes --- website/releases/release-0.1.0-incubating.mdx | 35 ++++++++++++++++++- 1 file changed, 34 insertions(+), 1 deletion(-) diff --git a/website/releases/release-0.1.0-incubating.mdx b/website/releases/release-0.1.0-incubating.mdx index 6d3f6659..cb26f60d 100644 --- a/website/releases/release-0.1.0-incubating.mdx +++ b/website/releases/release-0.1.0-incubating.mdx @@ -1 +1,34 @@ -WIP \ No newline at end of file +--- +title: "Release 0.1.0-incubating" +sidebar_position: 1 +--- + +## [Release 0.1.0-incubating](https://github.com/apache/incubator-xtable/releases/tag/0.1.0-incubating) ([docs](https://xtable.apache.org/docs/how-to)) +This is the first official apache release for Apache XTable, an incubating project under the Apache Software Foundation. +Apache XTable™ (Incubating) is a cross-table converter for table formats that facilitates omni-directional interoperability across data processing systems and query engines. +Currently, Apache XTable™ supports widely adopted open-source table formats such as Apache Hudi, Apache Iceberg, and Delta Lake. + +## Features +Apache XTable™ (Incubating) provides users with the ability to translate metadata from one table format to another. + +Apache XTable™ (Incubating) provides two sync modes, "incremental" and "full." The incremental mode is more lightweight and has better performance, especially on large tables. If there is anything that prevents the incremental mode from working properly, the tool will fall back to the full sync mode. + +This sync provides users with the following: + +1. Syncing of data files along with their column level statistics and partition metadata +2. Schema updates in the source are reflected in the target table metadata +3. Metadata maintenance for the target table formats. + * For Hudi, unreferenced files will be marked as [cleaned](https://hudi.apache.org/docs/hoodie_cleaner/) to control the size of the metadata table. + * For Iceberg, snapshots will be [expired](https://iceberg.apache.org/docs/latest/maintenance/#expire-snapshots) after a configured amount of time. + * For Delta, the transaction log will be [retained](https://docs.databricks.com/en/sql/language-manual/delta-vacuum.html) for a configured amount of time. + + +## Improvements +1. Added apache release guide and infra components to be compliant with ASF release process. +2. Fix bugs related to dependency convicts, few edge cases related when parsing column stats. +3. Improved README, docker demo and website docs based on feedback provided by users. +4. Refactored the codebase to follow apache naming practices. +[apache-xtable-0.1.0-incubating.src (1).tgz](https://github.com/user-attachments/files/16709894/apache-xtable-0.1.0-incubating.src.1.tgz) + +## Raw Release Notes +https://github.com/apache/incubator-xtable/compare/v0.1.0-beta1...0.1.0-incubating \ No newline at end of file