Image sources, such as digital camera captures and photographic negatives, typically have more information than can be reproduced on a photographic print or a video display. The information that is lost during the tone/color rendering process relates to both the extended dynamic range and color gamut of the original scene. In conventional photographic systems, most of this additional information is archived on the photographic negative and can be accessed by adjusting the way the negative is printed. However, most digital imaging systems have traditionally archived only a rendered video RGB image. As a result, it is not possible to make the same sorts of image manipulations that historically have been possible with conventional photographic systems. This suggests that there would be an advantage to storing images using an extended dynamic range/color gamut color encoding. However, because of file compatibility issues, digital imaging systems that store images using color encoding other than a standard video RGB representation (e.g., sRGB) would be significantly disadvantaged in the marketplace. In this article, we describe a solution that has been developed to maintain compatibility with existing file formats and software applications, while simultaneously retaining the extended dynamic range and color gamut information associated with the original scenes. With this approach, the input raw digital camera image or film scan is first transformed to the scene-referred ERIMM RGB color encoding. Next, a rendered sRGB image is formed in the usual way and stored in a conventional image file (e.g., a standard JPEG file). A residual image representing the difference between the original extended dynamic range image and the final rendered image is formed and stored in the image file using proprietary metadata tags. This provides a mechanism for archiving the extended dynamic range/color gamut information, which is normally discarded during the rendering process, without sacrificing interoperability. Appropriately enabled applications can decode the residual image metadata and use it to reconstruct the ERIMM RGB image, whereas applications that are not aware of the metadata will ignore it and only have access to the sRGB image. The residual image is formed such that it will have negligible pixel values for those portions of the image that lie within the sRGB gamut, and will therefore be highly compressible. Tests on a population of 950 real customer images have demonstrated that the extended dynamic range scene information can be stored with an average file size overhead of about 8% compared to the sRGB images alone. (C) 2003 Wiley Periodicals, Inc.