We study the large time behavior of mild solutions of HJB equations in infinite dimension by a purely probabilistic approach. For that purpose, we show that the solution of a backward SDE in finite horizon T taken at initial time behaves like a linear term in T shifted with the solution of the associated ergodic backward SDE taken at initial time. Moreover we give an explicit rate of convergence, which seems to be new to our best knowledge.