We investigated the ground state of approximants consisting of <= 165 Si atoms (d(QD) <= 18.5 A) with full termination of the Si interface with F, OH, NH(2), CH(3) and H groups simulating Si QDs embedded in an ionic environment, SiO(2), Si(3)N(4), SiC matrix and a co-valent environment, respectively, with ab initio methods. As the polarity of the Si/matrix interface increases the optical band-gap becomes increasingly dominated by charge transfer at the interface rather than by quantum confinement. For Si QDs with d(QD) = 7.3-37 angstrom, the interface determines the electronic structure in competition with quantum confinement for H and CH(3) terminations and only as a secondary effect for strong polar interfaces (NH(2), OH). We present an estimate of band gaps of different QD materials with the same interface and interpret the ab initio results in conventional quantum mechanics. Crown Copyright (C) 2008 Published by Elsevier B.V. All rights reserved.