Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

TuGraph是否支持直接写SST文件,然后将SST文件加载到已存在数据的子图中 #618

Closed
huzhihao1 opened this issue Aug 7, 2024 Discussed in #617 · 4 comments

Comments

@huzhihao1
Copy link

Discussed in #617

Originally posted by huzhihao1 August 7, 2024
前置条件:当前数据库中已存在一张有数据的子图
诉求:通过spark或其他手段,批量写SST文件,是否可以直接将SST文件加载到已有数据的子图中。
我在看TuGraph的源码时,看到在线全量导入时,使用的就是写SST文件,然后将SST等文件信息加载为一张子图;想请教下是否支持将SST等文件信息加载到一张有数据的子图中。

@qishipengqsp
Copy link
Collaborator

数据导入是使用rocksDB实现排序的逻辑,目前持久化存储TuGraph-DB使用的还是LMDB,所以暂不支持将SST文件load进库。目前我们正考虑支持多存储引擎,可以继续关注一下

Copy link

github-actions bot commented Aug 9, 2024

Hello @huzhihao1. Please provide more info for debugging. Issues labeled by more info needed will be closed if no activities in 7 days.

你好 @huzhihao1, 我们需要你提供更多信息以便于排查问题。7 天内未跟进此 issue 将会被自动关闭。

@huzhihao1
Copy link
Author

当前我看了下TuGraph 的在线全量导入接口会调用DoImportOffline,用的就是写SST文件的方式:
image
有几个问题请教下:
在线全量导入是否可以使用SST文件加载到空的子图?
是否可以使用分布式的方式直接写SST文件来做导入加速?
是否有其他可借鉴的并行导入的手段?

Copy link

github-actions bot commented Sep 4, 2024

Since this issue was labeled as "more info needed" but no response has been received for 15 days. Now the issue is closed. Please feel free to create a new one with more info if you have more questions.

由于该 issue 被标记为需要更多信息,却 15 天未收到回应。现关闭 issue,若有任何问题,可另开 issue 并提供更多信息。

@github-actions github-actions bot closed this as not planned Won't fix, can't repro, duplicate, stale Sep 4, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants