Comment by ants_everywhere

I think the point of mine that you're missing (or perhaps disagreeing with implicitly) is that *everything* is fundamentally math. Or, if you like, everything is fundamentally physics, and physics is fundamentally math.

So classes of functions (ANNs) that can approximate our desired function to arbitrary precision are what we should be expecting to be working with.