Given three arbitrary vector bundles on the Fargues-Fontaine curve where one of them is assumed to be semistable, we give an explicit and complete criterion in terms of Harder-Narasimha polygons on whether there exists a short exact sequence among them. Our argument is based on a dimension analysis of certain moduli spaces of bundle maps and bundle extensions using Scholzes theory of diamonds.