Although a number of methods have been developed for image adjustment in various applications, very little work has been done in the context of visual design. In this regard, this article introduces a novel and practical context of image color adjustment and develops a method to adjust an image for harmony with a target color. The experiment with designers revealed that designers made significant changes in hue dimension, and preferred to promote color similarity between the image and the target color. Based on insights from designers, we proposed a method to achieve a harmonious combination of an image and a color element by increasing the hue similarity between them. The result of a user test revealed that our method is particularly useful for images with nonliving objects but less effective for images involving human skin, foods, and so on. It is expected that the practical context investigated in this study can promote a variety of related studies that satisfy the tangible needs of industries and academia.