Comment by energy123

Very true, although the off-diagonal terms in the variance-covariance matrix are also hard to estimate, which is a problem, especially when simulating worst case scenarios, which is often when correlations tend to break down.