Could it be Highbury House? This fits the description of being in the Tavistock Road, Weston Peverel (Peverell) and Pennycross areas.
Today it is on the corner of Outland Road leading into Tavistock Road. the area is Peverell, and Pennycross area begins just around the corner from the house.
It is now a residential care home.