Building upon electrophysiological recordings from the lateral geniculate nucleus (LGN) of the macaque monkey, we describe a model for neural processing of color and brightness/lightness information that starts in the cone receptors and continues in the opponent cells of the retina, LGN, and visual cortex. The excitation of the three cone types to direct stimulation by light is modified in accordance with a hyperbolic response function before providing inputs to retinal ganglion cells. Using weighted differences of such cone outputs, we simulate the responses of common types of opponent ganglion and geniculate cells to light modulation along the chromatic and luminance dimensions. Extrapolating the results of the simulation, we suggest a way in which the brain might combine inputs from the geniculate to obtain correlates of chromatic and achromatic color vision and of brightness/ lightness perception. In particular, we demonstrate for the first time how combinations of "L-M" and "M-L" parvocellular ON- and OFF-opponent-cells may, lead to a quantitative account of brightness and blackness scaling. (c) 2008 Wiley Periodicals, Inc. Col Res Appl, 33, 433-443, 2008 Published online in Wiley InterScience (www.interscience.wiley.com). DOI 10.1002/col.20445