This technical note is concerned with the robust stabilization of a class of stochastic large-scale systems governed by a finite state Markov process. Using the method of integral quadratic constraints, a sufficient condition is developed to design decentralized stabilizing controllers which use local system states and local system operation modes to produce local control inputs. The condition is given in terms of a set of rank constrained linear matrix inequalities. The theory is illustrated by an example.