We study ultradistributional boundary values of zero solutions of a hypoelliptic constant coefficient partial differential operator $P(D) = P(D_x, D_t)$ on $mathbb{R}^{d+1}$. Our work unifies and considerably extends various classical results of Komatsu and Matsuzawa about boundary values of holomorphic functions, harmonic functions and zero solutions of the heat equation in ultradistribution spaces. We also give new proofs of various results of Langenbruch about distributional boundary values of zero solutions of $P(D)$.