It's Just Me And The Boys Tonight
 
 
The Song:

In order for it to feel more authentic, Beck filled out his Song Reader book with fragments of song titles and melodies, as well as fictional album collections and song titles. The back of "Saint Dude" lists five such albums, and "It's Just Me And The Boys Tonight" is listed as part of The Manly Family Song Album, and is copyrighted.

Many of the titles on the back of "Saint Dude" are references to older sheet music/songs. While this is a common enough phrase, and seems like it could easily be one, I did not see any in my research. It may just instead be a joke on the 'manly' theme of the album.