At present, part of the forward RPC muon system of the CMS detector at the CERN LHC remains uninstrumented in the high-eta region. An international collaboration is investigating the possibility of covering the 1.6 < |eta| < 2.4 region of the muon endcaps with large-area triple-GEM detectors. Given their good spatial resolution, high rate capability, and radiation hardness, these micro-pattern gas detectors are an appealing option for simultaneously enhancing muon tracking and triggering capabilities in a future upgrade of the CMS detector. A general overview of this feasibility study will be presented. The design and construction of small (10times10 cm2) and full-size trapezoidal (1times0.5 m2) triple-GEM prototypes will be described. During detector assembly, different techniques for stretching the GEM foils were tested. Results from measurements with x-rays and from test beam campaigns at the CERN SPS will be shown for the small and large prototypes. Preliminary simulation studies on the expected muon reconstruction and trigger performances of this proposed upgraded muon system will be reported.