We introduce a random matrix model with the symmetries of QCD at finite temperature and chemical potentials for baryon number and isospin. We analyze the phase diagram of this model in the chemical potential plane for different temperatures and quark masses. We find a rich phase structure with five different phases separated by both first and second order lines. The phases are characterized by the pion condensate and the chiral condensate for each of the flavors. In agreement with lattice simulations, we find that in the phase with zero pion condensate the critical temperature depends in the same way on the baryon number chemical potential and on the isospin chemical potential. At nonzero quark mass, we remarkably find that the critical end point at nonzero temperature and baryon chemical potential is split in two by an arbitrarily small isospin chemical potential. As a consequence, there are two crossovers that separate the hadronic phase from the quark-gluon plasma phase at high temperature. Detailed analytical results are obtained at zero temperature and in the chiral limit.