We report results from a convection dynamo simulation of proto-neutron star (PNS), with a nuclear equation of state (EOS) and the initial hydrodynamic profile taken from a neutrino radiation-hydrodynamics simulation of a massive stellar core-collapse. A moderately-rotating PNS with the spin period of $170$ ms in the lepton-driven convection stage is focused. We find that large-scale flow and thermodynamic fields with north-south asymmetry develop in the turbulent flow, as a consequence of the convection in the central part of the PNS, which we call as a deep core convection. Intriguingly, even with such a moderate rotation, large-scale, $10^{15}$ G, magnetic field with dipole symmetry is spontaneously built up in the PNS. The turbulent electro-motive force arising from rotationally-constrained core convection is shown to play a key role in the large-scale dynamo. The large-scale structures organized in the PNS may impact the explosion dynamics of supernovae and subsequent evolution to the neutron stars.