We introduce a procedure of quantum chemical calculations (B3P86/6-31G**) to study carboxylic acid dimerization and its correlation with temperature and properties of the solvent. Benzoic acid is chosen as a model system for studying dimerization via hydrogen bonding. Organic solvents are simulated using the self-consistent reaction field (SCRP) method with the polarized continuum model (PCM). The cyclic dimer is the most stable structure both in gas phase and solution. Dimer mono- and dihydrates could be found in the gas phase if acid molecules are in contact with water vapor. However, the formation of these hydrated conformers is very limited and cyclic dimer is the principal conformer to coexist with monomer acid in solution. Solvation of the cyclic dimer is more favorable compared to other complexes, partially due to the diminishing of hydrogen bonding capability and annihilation of dipole moments. Solvents have a strong effect on inducing dimer dissociation and this dependence is more pronounced at low dielectric constants. By accounting for selected terms in the total free energy of solvation, the solvation entropy could be incorporated to predict the dimer behavior at elevated temperatures. The temperature dependence of benzoic acid dimerization obtained by this technique is in good agreement with available experimental measurements, in which a tendency of dimer to dissociate is observed with increased temperatures. In addition, dimer breakup is more sensitive to temperature in low dielectric environments rather than in solvents with a higher dielectric constant.