A Uniform Bound on the Operator Norm of Sub-Gaussian Random Matrices and Its Applications

For an random matrix with weakly dependent uniformly sub-Gaussian entries that may depend on a possibly infinite-dimensional parameter, we obtain a uniform bound on its operator norm of the form, where C is an absolute constant, K controls the tail behavior of (the increments of), and is Talagrand's functional, a measure of multiscale complexity of the metric space. We illustrate how this result may be used for estimation that seeks to minimize the operator norm of moment conditions as well as for estimation of the maximal number of factors with functional data.