The Apache Point Observatory Galactic Evolution Experiment has measured the stellar velocities of red giant stars in the inner Milky Way. We confirm that the line of sight velocity distributions (LOSVDs) in the mid-plane exhibit a second peak at high velocities, whereas those at |b| = 2degrees do not. We use a high resolution simulation of a barred galaxy, which crucially includes gas and star formation, to guide our interpretation of the LOSVDs. We show that the data are fully consistent with the presence of a thin, rapidly rotating, nuclear disk extending to ~1 kpc. This nuclear disk is orientated perpendicular to the bar and is likely to be composed of stars on x2 orbits. The gas in the simulation is able to fall onto such orbits, leading to stars populating an orthogonal disk.