This Southern gothic ballad tells of a kid named Billy, his brother and their mother, who witnesses her loser boyfriend attacking a priest with a hammer.

The London Times asked Jack White where this song came from. He replied:
< “Brendan (Benson) was over at my house a year ago, and we were playing acoustic guitar, and I just said this line: ‘This is a story about Billy and his brother and I’m going to tell it again…’ That line isn’t even in the song any more but that’s what generated the whole story. That line gave me the job to do – it told me to get to work. Billy and his brother – what’s going on there?”