We prove that the Chow motives of two smooth cubic fourfolds whose Kuznetsov components are Fourier-Mukai derived-equivalent are isomorphic as Frobenius algebra objects. As a corollary, we obtain that there exists a Galois-equivariant isomorphism between their l-adic cohomology Frobenius algebras. We also discuss the case where the Kuznetsov component of a smooth cubic fourfold is Fourier-Mukai derived-equivalent to a K3 surface.