In this article, robust least-squares filtering problems are considered for non-parametric multivariate spectral uncertainty defined by the so-called spectral band and generalised-moment constraints. Its major aim is to provide a basis for computing approximate solutions to worst-case, Wiener-filtering optimisation problems involving causal filters and multivariate signals. It hinges upon associating upper and lower bounds on the minimum worst-case performance achievable with causal filters with linear-cost/linear matrix inequality (LC/LMI)-constraint optimisation problems. On the basis of a Lagrangean duality formulation for the worst-case, least-squares performance of a given filter, upper bounds on it are obtained as the optimal values of LC/LMI problems. Then, for linearly parameterised classes of filter transfer functions, a causal filter which optimises such an upper bound on worst-case performance can also be obtained from an LC/LMI optimisation problem. To estimate the amount of conservatism incurred when relying on such upper bounds, optimal, nominal, least-squares performance for a given pair of power spectral densities (for the information and noise signal) is maximised over finite-dimensional, linearly parameterised classes of the latter. Again, such problems are shown to be equivalent to LC/LMI problems and the corresponding optimal values are lower bounds on the minimum worst-case, least-squares error achievable in the original robust filtering problem (say, *). Finally, two simple numerical examples are presented to illustrate how causal filters can be obtained whose worst-case, least-squares performance is quite close to the optimal one (i.e. *).