We study the interplay between recurrences for zeta related functions at integer values, `Minor Corner Lattice Toeplitz determinants and integer composition based sums. Our investigations touch on functional identities due to Ramanujan and Grosswald, the transcendence of the zeta function at odd integer values, the Li Criterion for the Riemann Hypothesis and pseudo-characteristic polynomials for zeta related functions. We begin with a recent result for zeta(2s) and some seemingly new Bernoulli relations, which we use to obtain a generalised Ramanujan polynomial and properties thereof.