Radio pulsars with millisecond spin periods are thought to have been spun up by transfer of matter and angular momentum from a low-mass companion star during an X-ray-emitting phase. The spin periods of the neutron stars in several such low-mass X-ray binary (LMXB) systems have been shown to be in the millisecond regime, but no radio pulsations have been detected. Here we report on detection and follow-up observations of a nearby radio millisecond pulsar (MSP) in a circular binary orbit with an optically identified companion star. Optical observations indicate that an accretion disk was present in this system within the last decade. Our optical data show no evidence that one exists today, suggesting that the radio MSP has turned on after a recent LMXB phase.