We review and expand upon recent work demonstrating that Weyl invariant theories can be broken inertially, which does not depend upon a potential. This can be understood in a general way by the current algebra of these theories, independently of specific Lagrangians. Maintaining the exact Weyl invariance in a renormalized quantum theory can be accomplished by renormalization conditions that refer back to the VEVs of fields in the action. We illustrate the computation of a Weyl invariant Coleman-Weinberg potential that breaks a U(1) symmetry together,with scale invariance.