This study amid at investigating the consistency between judgment and factor analysis employed as indicators of validity for many psychological concepts. Subjects were 861 ninth and tenth students. Data of the performance on two scales (psychological stress & rebellion) were taken from a previous study used judgment to determine concepts’ factors. Results showed consistency in number of factors determined by both methods for the Psychological Stress Scale. However, agreement was not found for the Rebellion Scale; two main factors revealed by the judgment method and five factors were explored by factor analysis. The study emphasized the necessity of utilizing factor analysis beside judgment when checking for validity.