Comment by 29athrowaway

IMO, not the best use case for LLMs.

COBOL projects have millions of lines of code. Any prompt/reasoning will rapidly fill the context window of any model.

And you'll probably have a better luck if you had tokenization understands COBOL keywords.

You probably have better luck implementing a data miner that slowly digests all the code and requirements into a proprietary information retrieval solution or ontology that can help answer questions...

What an engineer tells you can be inaccurate, incomplete, outdated, etc.