Comment by kumama
3 hours ago
castform founder here. we should have made it more prominent on the blog but here's the full code example: https://github.com/castform-ai/benchmax/tree/main/examples/n...
3 hours ago
castform founder here. we should have made it more prominent on the blog but here's the full code example: https://github.com/castform-ai/benchmax/tree/main/examples/n...
Thank you for the github link, what is the license? I went briefly over several repo, unless I missed it somewhere the license was often missing.
it's apache 2.0: https://github.com/castform-ai/benchmax/tree/main?tab=Apache...
Are you using blind chunking or section aware chunking?
for the example here the chunking is section aware -> but the general training data synthesis pipeline is agnostic to type of chunking
if chunking is section aware, how do you manage large section embeddings?