Comment by visarga

The ad hoc heuristics are the domain knowledge baked into the model by human experts, like features, architecture and loss function.

"Evaluation" means environments or datasets, the model is supposed to discover its representations from scaled up experience. That was the bitter lesson - more data and compute beat heuristics.