We report results of the dielectric and pyroelectric measurements on solid solutions of Ga$_2$$_-$$_x$Fe$_x$O$_3$ with x = 0.75, 1.0 and 1.25. These systems exhibit dipolar cluster glass behavior in addition to the spin glass behavior making them belong to a class of few systems showing multiglass behavior. Presence of two contributing relaxations in dielectric data are observed possibly due to the flipping and breathing of polar nano-clusters. Further, emergence of polarization in these systems can be understood in terms of thermally stimulated depolarization current (TSDC) effect caused by defect dipoles possibly associated with charged oxygen vacancies rather than the intrinsic ferroelectric behavior.