Much attention has been devoted to waters metastable phase behavior, including polyamorphism (multiple amorphous solid phases), and the hypothesized liquid-liquid transition and associated critical point. However, the possible relationship between these phenomena remains incompletely understood. Using molecular dynamics simulations of the realistic TIP4P/2005 model, we found a striking signature of the liquid-liquid critical point in the structure of water glasses, manifested as a pronounced increase in long-range density fluctuations at pressures proximate to the critical pressure. By contrast, these signatures were absent in glasses of two model systems that lack a critical point. We also characterized the departure from equilibrium upon vitrification via the non-equilibrium index; water-like systems exhibited a strong pressure dependence in this metric, whereas simple liquids did not. These results reflect a surprising relationship between the metastable equilibrium phenomenon of liquid-liquid criticality and the non-equilibrium structure of glassy water, with implications for our understanding of water phase behavior and glass physics. Our calculations suggest a possible experimental route to probing the existence of the liquid-liquid transition in water and other fluids.