Hybrid quantum optomechanical systems offer an interface between a single two-level system and a macroscopical mechanical degree of freedom. In this work, we build a hybrid system made of a vibrating microwire coupled to a single semiconductor quantum dot (QD) via material strain. It was shown a few years ago, that the QD excitonic transition energy can thus be modulated by the microwire motion. We demonstrate here the reverse effect, whereby the wire is set in motion by the resonant drive of a single QD exciton with a laser modulated at the mechanical frequency. The resulting driving force is found to be almost 3 orders of magnitude larger than radiation pressure. From a fundamental aspect, this state dependent force offers a convenient strategy to map the QD quantum state onto a mechanical degree of freedom.