We consider $kappa$-deformed relativistic quantum phase space and possible implementations of the Lorentz algebra. There are two ways of performing such implementations. One is a simple extension where the Poincare algebra is unaltered, while the other is a general extension where the Poincare algebra is deformed. As an example we fix the Jordanian twist and the corresponding realization of noncommutative coordinates, coproduct of momenta and addition of momenta. An extension with a one-parameter family of realizations of the Lorentz generators, dilatation and momenta closing the Poincare-Weyl algebra is considered. The corresponding physical interpretation depends on the way the Lorentz algebra is implemented in phase space. We show how the spectrum of the relativistic hydrogen atom depends on the realization of the generators of the Poincare-Weyl algebra.