We report loading of laser-cooled caesium atoms into a hollow-core photonic-bandgap fiber and confining the atoms in the fibers 7 $mu m$ diameter core with a magic-wavelength dipole trap at $sim$935 nm. The use of the magic wavelength removes the AC-Stark shift of the 852nm optical transition in caesium caused by the dipole trap in the fiber core and suppresses the inhomogeneous broadening of the atomic ensemble that arises from the radial distribution of the atoms. This opens the possibility to continuously probe the atoms over time scales of a millisecond -- approximately 1000 times longer than what was reported in previous works, as dipole trap does not have to be modulated. We describe our atom loading setup and its unique features and present spectroscopy measurements of the caesiums D$_{2}$ line in the continuous wave dipole trap with up to $1.7 times 10^{4}$ loaded inside the hollow-core fiber.