v1.2.5

Major Features

• Support OceanBase as object store backend(stable now!)
• Compaction
  • support compact same table concurrently #1101
  • support pick sst by sequence order, this is required to avoid data corruption for overwrite table #1041
• Improve the stability of CeresDB
  • ensure shard is opened once #1080
  • add shard status when heartbeat to meta #1082
• Enhancement on query and write
  • avoid write queue full block #1065
  • avoid prefetching all sst streams at once #1069
  • improve performance of thetasketch distinct #1102
  • query requests dedup #1100
  • string type support dictionary, this will reduce memory consumption by 30% in our experiments #993, #1049, #1068
• Improve the performance of recovery
  • make obkv wal opening more parallelly #1129

What's Changed

• feat: expose more rocksdb options by @zouxiang1993 in #1033
• feat: add metrics for memtable by @jiacai2050 in #1036
• feat: support opentsdb put api by @zouxiang1993 in #1037
• test: add integration test for opentsdb put api by @zouxiang1993 in #1043
• feat: sst-metadata support sort by @jiacai2050 in #1042
• feat: use dictionary type to store column by @tanruixiang in #993
• fix: compaction support pick by max_seq by @jiacai2050 in #1041
• feat: sql support dictionary column by @tanruixiang in #1049
• chore(deps): bump google.golang.org/grpc from 1.47.0 to 1.53.0 in /integration_tests/sdk/go by @dependabot in #1052
• refactor: add http write metrics by @baojinri in #1045
• feat: memtable bitmap for null by @ShiKaiWi in #1046
• fix: persist sst id by @baojinri in #1009
• fix: fix kafka wal logs deletion and recovery logic by @Rachelint in #1048
• feat: split operations of Cluster and Shard, and serialize operations of Shard by @Rachelint in #1056
• feat: add record batch mem stats by @jiacai2050 in #1058
• fix: fix fully flushed region open in kakfa wal by @Rachelint in #1061
• fix: directly return when found no table datas to replay by @Rachelint in #1062
• feat: warning when query's timestamp is exceeding table's ttl by @tanruixiang in #1054
• refactor: use varint to encode string/bytes length by @baojinri in #1060
• feat: support query opened shards info by @baojinri in #1070
• fix: make is_dictionary optional by @jiacai2050 in #1074
• fix: add missing dict_id by @jiacai2050 in #1068
• feat: support cancellation safe future by @ShiKaiWi in #1071
• chore: bump version by @jiacai2050 in #1079
• feat: use manifest updates stats in TableData to trigger snapshot by @Rachelint in #1076
• chore: add testcases for time range predicate by @tanruixiang in #1078
• fix: avoid write queue full block by @baojinri in #1065
• refactor: separate common_util to multiple components by @ShiKaiWi in #1077
• refactor: remove type encode by @baojinri in #1073
• fix: ensure shard is opened once by @jiacai2050 in #1080
• feat: avoid prefetching all sst streams at once by @ShiKaiWi in #1069
• fix: separate some modules from common_types by @ShiKaiWi in #1084
• feat: add shard status when heartbeat to meta by @jiacai2050 in #1082
• fix: quote column name in prom query filter by @jiacai2050 in #1083
• fix: update pprof version by @tanruixiang in #1088
• refactor: add grpc query nums metrics by @baojinri in #1090
• chore: bump datafusion version by @Rachelint in #1086
• refactor: pprof in toml use workspace by @tanruixiang in #1092
• fix: out of range error in module ObjectStore base on OBKV by @MachaelLee in #1089
• feat: refactor stats method in wal by @Rachelint in #1098
• fix: wrong encoding when write schema is different by @ShiKaiWi in #1103
• feat: Improve performance of thetasketch distinct by @Rachelint in #1102
• feat: support compact table concurrently by @jiacai2050 in #1101
• fix: ensure shard lock is release in corner case by @jiacai2050 in #1104
• chore: bump pprof version by @tanruixiang in #1107
• chore: add actual scan duration stats into chain iterator by @Rachelint in #1109
• fix: disable read parquet page index by @jiacai2050 in #1110
• chore: remove unused codes about the page index by @ShiKaiWi in #1111
• fix: logic of keep scheduling compaction by @baojinri in #1113
• chore: remove space_and_table from the table_impl by @ShiKaiWi in #1114
• feat: query requests dedup by @baojinri in #1100
• fix: obkv wal open by @Rachelint in #1117

Full Changelog: v1.2.4...v1.2.5