The combination of Rashba spin-orbit coupling and electron correlations can induce unusual phenomena in the metallic interface between SrTiO$_3$ and LaAlO$_3$. We consider effects of Rashba spin-orbit coupling at this interface in the context of the
recent observation of anisotropic magnetism. Firstly, we show how Rashba spin-orbit coupling in a system near a band-edge can account for the observed magnetic anisotropy. Secondly, we investigate the coupling between in-plane magnetic-moment anisotropy and nematicity in the form of an orbital imbalance between d$_{xz}$ / d$_{yz}$ orbitals. We estimate this coupling to be substantial in the low electron density regime. Such an orbital ordering can affect magneto transport.
