Comment by leobg
21 hours ago
There are AI bros that will call an LLM to do what you could do with a regex. I’ve seen people do the chunking for RAG using an LLM…
21 hours ago
There are AI bros that will call an LLM to do what you could do with a regex. I’ve seen people do the chunking for RAG using an LLM…
If you think about chunking as "take x characters" then using LLMs is a poor idea.
But syntactic chunking also works really poorly for any serious application as you loose basically all context.
Semantic chunking, however, is a task you absolutely would use LLMs for.