The song is an allusion to “The Telltale Heart”, written by Edgar Allan Poe. it is evident in some verses.

He keeps his heart away from his lover, probably for self preservation, yet he yearns for the love they give.