Microscopic calculations of free energy profiles for ion transport through biological ion channels present a very serious challenge to modem simulation approaches. The main problem is due to the major convergence problems associated with the heterogeneous landscape of the electrostatic environment in ion channels and with the need to evaluate the profile associated with the transfer of the ion from bulk water to the channel environment. This problem is compounded by the lack of reliable and relevant benchmarks that can discriminate between alternative approaches. The present study is aimed at reducing the above problems by defining benchmarks that are directly relevant to ion channels and can also give converging results. This is done by constructing a series of models of a truncated gramicidin channel with different numbers of water molecules and by comparing the profiles for going around the channel and through the channel. These discriminating models are then used to validate and compare the adiabatic charging free energy perturbation (FEP) approach combined with an umbrella sampling approach (Warshel, A. J. Phys. Chem. 1982, 86, 2218) and the potential of mean force (PMF) approach used frequently in studies of ion channels. It is found that both approaches work quite well until one moves to the case of the fully solvated channel. in this limit, the PMF approach may give different results for the overall work of going through the channel and around the channel, while the FEP approach gives physically consistent results. The present benchmark also indicates that the weighted histogram analysis method (WHAM) approach does not offer a significant advantage over earlier approaches at least as much as studies of ion channels are concerned. Finally, it is concluded that the FEP approach may be more useful in evaluating the overall barrier for moving ions from water to ion channels and that in some cases it might be beneficial to use the FEP approach for selective points along the channel and then to connect these points by PMF calculations.