v1.0.0

Major features

• Support prometheus remote storage protocol
• Query performance improvement and resource control
  • Replace bloom filter with XOR8 filter
  • Add timeout for query
  • Add route cache in remote engine client in table partition
  • Support locate partition for in sql expression in table partition
• Internal refactor
  • Refactor sst module for better extensibility
  • Refactor manifest module
• Refactor grpc storage service
• Add intergration test for cluster mode
• Bug fix
  • Fix sql identifier case-sensibility
  • Correct the order of sync meta snapshot and clean logs in wal on kafka
  • Update flushed_sequence_num after compaction
  • Fix varbinary type error

What's Changed

• Revert "refactor: separate object store from parquet sst async reader… by @ShiKaiWi in #536
• chore: add version in PartitionInfo by @chunshao90 in #537
• feat: support drop partition table by @chunshao90 in #532
• docs: wrong schema in the static routing example config by @ShiKaiWi in #543
• chore(deps): bump tokio from 1.22.0 to 1.24.1 by @dependabot in #546
• chore(deps): bump lz4-sys from 1.9.3 to 1.9.4 by @dependabot in #545
• docs: update example cluster config by @chunshao90 in #548
• avoid routing for non-existent table by @ShiKaiWi in #551
• fix: Revert "feat: support bloom filter in hybrid format (#479)" by @jiacai2050 in #549
• feat: add open_table_on_shard and close_table_on_shard in meta_event_service by @chunshao90 in #542
• feat: disable do_snapshot when recover table data by @chunshao90 in #550
• feat: use arrow-ipc to communicate between remote server and client by @jiacai2050 in #552
• feat: add timeout for query by @jiacai2050 in #539
• Supplement ceresdb docs by @MachaelLee in #555
• support schema header for http/grpc service by @ShiKaiWi in #544
• feat: add cached router for remote engine client by @Rachelint in #547
• chore: add some metrics for PartitionTable and grpc service by @chunshao90 in #560
• fix: truncated error message by @jiacai2050 in #564
• chore: change the prefix of sub partition table name to "__" by @chunshao90 in #566
• feat: pass partition info to ceresmeta when create table by @chunshao90 in #568
• chore: add code of conduct by @archerny in #575
• chore: add llvm cov codecov by @chunshao90 in #574
• feat: support querying partition tables through select in by @ZuLiangWang in #530
• feat: add permission check for sub tables in table partition by @Rachelint in #541
• feat: improve the release profile and add release-slim profile by @ShiKaiWi in #580
• feat: add some logs for reading sst by @ShiKaiWi in #581
• feat: merge breaking changes to the main branch by @ShiKaiWi in #583
• chore: update the roadmap by @archerny in #584
• chore(deps): bump git2 from 0.14.2 to 0.16.1 by @dependabot in #588
• chore(deps): bump bumpalo from 3.10.0 to 3.12.0 by @dependabot in #586
• chore: add codecov.yml to ignore some dirs that don't need code coverage by @chunshao90 in #591
• feat: implement prom remote storage api by @jiacai2050 in #578
• feat restrict partition num by @Rachelint in #598
• chore: remove docs by @jiacai2050 in #599
• chore(deps): bump warp from 0.3.2 to 0.3.3 by @dependabot in #602
• fix: re-enable SingleDistinctToGroupBy by @jiacai2050 in #594
• chore: fix missing deps in CI by @jiacai2050 in #603
• chore: make nightly image name readable by @jiacai2050 in #604
• fix: remove unnecessary type conversion in MysqlWorker by @Huachao in #606
• chore: remove lto by @jiacai2050 in #609
• feat: print error in datanode by @Rachelint in #613
• chore(deps): bump tokio from 1.24.1 to 1.25.0 by @dependabot in #610
• feat: prevent from pushing down filter of non primary key or ts key by @Rachelint in #611
• test: add testcase for timestamp not in primary key by @jiacai2050 in #619
• feat: adapt new protocol by @ShiKaiWi in #585
• feat: make bloom filter optional on column level by @ShiKaiWi in #615
• primary keys defaults to tsid, timestamp by @jiacai2050 in #621
• chore: add logs by @jiacai2050 in #614
• feat: Upgrade to Datafusion 17 by @chunshao90 in #601
• fix: avoid some unwrap with result by @chunshao90 in #624
• feat: store manifest to oss by @ShiKaiWi in #607
• chore: rename meta module to manifest in analytic crate by @ShiKaiWi in #625
• feat: add BoxError trait to simplify the way to create generic error by @Rachelint in #627
• test: add test for issue 302 by @chunshao90 in #618
• chore: remove useless code by @ShiKaiWi in #630
• chore: modify wal config by @Rachelint in #629
• chore: run ci in parallel by @jiacai2050 in #632
• feat: add cluster mode system table by @ZuLiangWang in #464
• feat: use ConfigOptions to transfer custom settings by @chunshao90 in #639
• docs: udpate readme-cn by @MachaelLee in #600
• feat: replace bloom with xor8 filter by @jiacai2050 in #631
• chore: refacor ceresdb config by @chunshao90 in #640
• feat: support request context by @jiacai2050 in #636
• feat: allow mapping between sequence and kafka offset incomplete by @Rachelint in #642
• fix: correct the order of sync meta snapshot and clean logs in wal on kafka by @Rachelint in #643
• chore: move proto to ceresdbproto repo by @chunshao90 in #644
• feat: map shard id to region id in manifest by @Rachelint in #645
• fix: sql identifier default to case-sensitive by @jiacai2050 in #641
• fix: update flushed_sequence_num after compaction by @ShiKaiWi in #651
• refactor: adjust configuration by @ShiKaiWi in #649
• feat: replace column index with id when persisting schema in manifest by @Rachelint in #652
• refactor: reuse client in manifest wal and normal wal by @Rachelint in #656
• fix: fix varbinary type error by @ZuLiangWang in #653
• refactor: use enum instead of version for encoding format in pb by @ShiKaiWi in #655
• chore: fix some clippy errors & add clippy.toml by @ShiKaiWi in #658
• refactor: remove encoder method from WalManager by @ShiKaiWi in #661
• chore: add integration test for cluster mode. by @ZuLiangWang in #646
• feat: Support DataTypes of Date and Time by @MachaelLee in #657
• chore: normalize http api by @jiacai2050 in #659
• fix: xor filter build by @jiacai2050 in #666
• chore: fix CI upload log by @ZuLiangWang in #667
• feat: remove avro encoder by @chunshao90 in #660
• feat: remove status in readme by @MachaelLee in #671
• chore: add rustc version by @jiacai2050 in #672
• test: add partition_table test in integration_test by @chunshao90 in #668
• chore: bump client by @jiacai2050 in #673
• chore: rename some files and configuration by @chunshao90 in #674
• chore: update log level by @jiacai2050 in #677
• fix: can't recognize aliyun oss NotFoundError when load manifest by @ShiKaiWi in #678
• fix: remove auto create table option by @jiacai2050 in #679
• chore: update readme by @chunshao90 in #680
• chore: release 1.0.0 by @chunshao90 in #676

New Contributors

• @dependabot made their first contribution in #546

Full Changelog: v1.0.0-alpha02...v1.0.0