We consider Dyson models, Ising models with slow polynomial decay, at low temperature and show that its Gibbs measures deep in the phase transition region are not $g$-measures. The main ingredient in the proof is the occurrence of an entropic repulsion effect, which follows from the mesoscopic stability of a (single-point) interface for these long-range models in the phase transition region.