The structure of neutron stars is determined by the equation of state of the matter inside the star, which relies on the knowledge of nuclear interactions. While radii of neutron stars mostly depend on the equation of state of neutron matter at nuclear densities, their maximum mass can be drastically affected by the appearance of hyperons at higher densities in the inner core of the star. We summarize recent quantum Monte Carlo results on the calculation of the equation of state of neutron matter at nuclear and higher densities. We report about the development of realistic hyperon-nucleon interactions based on the available experimental data for light- and medium-heavy hypernuclei and on the effect of $Lambda$ hyperons to the neutron star structure.