I am straying way out of my depth.

Could this be a nom de plume?

The son of Samuel Taylor Coleridge, named (David) Hartley Coleridge was also a poet. He was active around this time and had Devon connections.
Furthermore his book "Poems Volume 1" was published in 1833 by the same publishers as "Solitary Hours", viz. Baldwin and Cradock, London.