We give formulas for the second and third integral homology of an arbitrary finitely generated Coxeter group, solely in terms of the corresponding Coxeter diagram. The first of these calculations refines a theorem of Howlett, while the second is entirely new and is the first explicit formula for the third homology of an arbitrary Coxeter group.