A phenomenological study of the isolated photon production in high energy $pp$ and $pA$ collisions at RHIC and LHC energies is performed. Using the color dipole approach we investigate the production cross section differential in the transverse momentum of the photon considering three different phenomenological models for the universal dipole cross section. We also present the predictions for the rapidity dependence of the ratio of $pA$ to $pp$ cross sections. As a further test of the formalism, for different energies and photon rapidites we analyse the correlation function in azimuthal angle $Deltaphi$ between the photon and a forward pion. The characteristic double-peak structure of the correlation function around $Delta phisimeq pi$ observed previously for Drell-Yan pair production is found for isolated photon emitted into the forward rapidity region which can be tested by future experiments.