Comment by johnvanommen

If you wanted to brute force it, it might be possible to have it generate a hundred outputs and then include a second pass to automatically select the generated model that most accurately resembles the expected output.

Basically leverage the randomness to create many variations, then select the most accurate variation automatically.

Terribly wasteful of time and processing power, but so is using GPU time to make pretty pictures randomly.