How generate chunks that keep the paragraphs meaning in the sppliting process

AI Discussions
1

Hi guys
How generate chunks that keep the paragraphs meaning in the sppliting process?

  1. The solution that comes to my mind is to use the overlap in the splitter: RecursiveCharacterTextSplitter, that way we can reach a little more text in the splitting process for each paragraph?

Do you have other ideas? I’m considering this project to do that:

https://github.com/chschock/textsplit