Chemical reactions can be surprisingly efficient at ultracold temperatures ( < 1mK) due to the wave nature of atoms and molecules. The study of reactions in the ultracold regime is a new research frontier enabled by cooling and trapping techniques developed in atomic and molecular physics. In addition, ultracold molecular gases that offer diverse molecular internal states and large electric dipolar interactions are sought after for studies of strongly interacting many-body quantum physics. Here we propose a new approach for producing ultracold molecules in the absolute internal and motional quantum ground state, where single molecules are assembled one by one from individual atoms. The scheme involves laser cooling, optical trapping, Raman sideband cooling, and coherent molecular state transfer. As a crucial initial step, we demonstrate quantum control of constituent atoms, including 3D ground-state cooling of a single Cs atom, in a simple apparatus. As laser technology advances to shorter wavelengths, additional atoms will be amenable to laser-cooling, allowing more diverse, and eventually more complex, molecules to be assembled with full quantum control.