We report a detailed high-temperature powder neutron diffraction investigation of the structural behavior of the multiferroic GaFeO₃ between 296 and 1368 K. Temperature dependent neutron diffraction patterns do not show any appreciable change either in intensity or appearance/ disappearance of the observed peaks up to 1368 K, ruling out any structural transition in the entire temperature range. Evolution of the distortion of the oxygen polyhedra around Ga₁, Ga₂, Fe₁, and Fe₂ cations sites suggest that the Ga₁-O tetrahedron is least distorted and Fe₁-O is most distorted. Structural features regarding the distortion of polyhedral units would be crucial to understand the temperature dependence of the microscopic origin of polarizations. The electric polarization has been estimated using a simple ionic model and its value is found to decrease with increasing temperature.