The new field of gravitational wave astrophysics requires a growing pool of students and researchers with unique, interdisciplinary skill sets. It also offers an opportunity to build a diverse, inclusive astronomy community from the ground up. We describe the efforts used by the North American Nanohertz Observatory for Gravitational Waves (NANOGrav) NSF Physics Frontiers Center to foster such growth by involving students at all levels in low-frequency gravitational wave astrophysics with pulsar timing arrays (PTAs) and establishing collaboration policies that ensure broad participation by diverse groups. We describe and illustrate the impact of these techniques on our collaboration as a case study for other distributed collaborations.