We give a new sufficient condition on a spectral triple to ensure that the quantum group of orientation and volume preserving isometries defined in cite{qorient} has a $C^*$-action on the underlying $C^*$ algebra.