“All the Boys” is about a girl who sleeps with several people, which her sexual partners are not aware of. This is one of two songs featured as a bonus track on the Target and Japanese versions of the album.

Unlike most Panic! songs, this track was written by then-bassist Dallon Weekes, who has since left the band.