We present a bilevel optimization approach to designing effective and efficient incentive policies for stimulating investment in renewable energy. The effectiveness of an incentive policy is its capability to achieve a goal that would not be achievable without it. Renewable portfolio standards are used in this paper as the policy goal. The efficiency of an incentive policy is measured by the amount of policy intervention, such as taxes collected or subsidies paid, to achieve the policy goal. We obtain the most effective and efficient incentive policies in the context of generation expansion planning, in which a centralized planner makes investment decisions for the energy system to serve projected demand of electricity. A case study is conducted on integrated coal transportation and electricity transmission networks representing the contiguous United States. The numerical analysis from the case study provides insights on the comparison of various incentive policies. The sensitivity of the incentive policies with respect to coal production cost, wind energy investment cost, and transmission capacity is also studied. (c) 2010 Elsevier Ltd. All rights reserved.