We have systematically studied the magnetic properties of chromium chalcogene compounds FeCr$_2$Se$_{4-x}$Te$_x$. The FeCr2Se4 undergoes antiferromagnetic ordering below 222 K. Substitution of tellurium lowers the antiferromagnetic ordering temperature and leads to short range ferromagnetic cluster behavior towards the tellurium end. Change over from antiferromagnetic to ferrimagnetic like behavior is also reflected in the corresponding transformation from semiconducting to metallic transport behavior. There is a large variation in the Curie-Weiss temperature, effective magnetic moment and ordering temperature (TN / TC) with Te substitution. The electronic band structure calculations suggest antiferromagnetic and ferrimagnetic ground state for the FeCr2Se4 and FeCr2Te4 respectively.