This song was a collaboration with St. Vincent’s friend and fellow musician, Cate Le Bon. An excerpt from St. Vincent’s website describes some of Le Bon’s contributions to this song:

Cate shines on the title track, “All Born Screaming,” a near-seven-minute epic closer propelled by a bassline so perfectly suited that it’s impossible to imagine the song without it. "I had that guitar part but was struggling with the song’s overall tone. Cate listened to it and said ‘Give me a beer, a bass, and three hours’,” and worked out the title track’s puckish low end. “She’s my favorite modern songwriter, period,” says Clark, hinting at future collaborations to come.