We show that the scalar products of on-shell and off-shell Bethe vectors in the algebra1ic Bethe ansatz solvable models satisfy a system of linear equations. We find solutions to this system for a wide class of integrable models. We also apply our method to the XXX spin chain with broken $U(1)$ symmetry.