By means of temperature and wavelength-dependent small-angle neutron scattering (SANS) experiments on sintered isotropic and textured Nd-Fe-B magnets we provide evidence for the existence of an anisometric structure in the microstructure of the textured magnets. This conclusion is reached by observing a characteristic cross-shaped angular anisotropy in the total unpolarized SANS cross section at temperatures well above the Curie temperature. Comparison of the experimental SANS data to a microstructural model based on the superquadrics form factor allows us to estimate the shape and lower bounds for the size of the structure. Subtraction of the scattering cross section in the paramagnetic regime from data taken at room temperature provides the magnetic SANS cross section. Surprisingly, the anisotropy of the magnetic scattering is very similar to the nuclear SANS signal, suggesting that the nuclear structure is decorated by the magnetic moments via spin-orbit coupling. Based on the computation of the two-dimensional correlation function we estimate lower bounds for the longitudinal and transversal magnetic correlation lengths.