Exfoliated black phosphorus has recently emerged as a new two-dimensional crystal that, due to its peculiar and anisotropic crystalline and electronic band structures, may have potentially important applications in electronics, optoelectronics and photonics. Despite the fact that the edges of layered crystals host a range of singular properties whose characterization and exploitation are of utmost importance for device development, the edges of black phosphorus remain poorly characterized. In this work, the atomic structure and the behavior of phonons near different black phosphorus edges are experimentally and theoretically studied using Raman spectroscopy and density functional theory calculations. Polarized Raman results show the appearance of new modes at the edges of the sample, and their spectra depend on the atomic structure of the edges (zigzag or armchair). Theoretical simulations confirm that the new modes are due to edge phonon states that are forbidden in the bulk, and originated from the lattice termination rearrangements.