[Feature Request]: Implement analyzer import from RAGFlow #1973
Labels
feature request
New feature or request
Comments
yingfeng
added a commit
that referenced
this issue
Oct 6, 2024
### What problem does this PR solve? Issue link:#1973 ### Type of change - [x] New Feature (non-breaking change which adds functionality)
yingfeng
added a commit
that referenced
this issue
Oct 6, 2024
### What problem does this PR solve? Issue link:#1973 ### Type of change - [x] New Feature (non-breaking change which adds functionality)
yingfeng
added a commit
that referenced
this issue
Oct 8, 2024
### What problem does this PR solve? Remove libwn, because it could not return same results as NLTK.WordNetLemmatizer Issue link:#1973 ### Type of change - [X] New Feature (non-breaking change which adds functionality)
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Is there an existing issue for the same feature request?
Is your feature request related to a problem?
No response
Describe the feature you'd like
Implement rag_tokenizer of RAGFlow in C++:
https://github.com/infiniflow/ragflow/blob/main/rag/nlp/rag_tokenizer.py
Describe implementation you've considered
No response
Documentation, adoption, use case
No response
Additional information
No response
The text was updated successfully, but these errors were encountered: