Alexandrovs theorem asserts that spheres are the only closed embedded constant mean curvature hypersurfaces in space forms. In this paper, we consider Alexandrovs theorem in warped product manifolds and prove a rigidity result in the spirit of Alexandrovs theorem. Our approach generalizes the proofs of Reilly and Ros and, under more restrictive assumptions, it provides an alternative proof of a recent theorem of Brendle.