Vintage title strip from 1963 by musicor record number 575

George Jones and Melba Montgomery recorded "We Must Have Been Out of Our Minds" (with "Until Then" as its B-side) at the Columbia Recording Studios in Nashville, Tennessee, on January 8, 1963.

Both songs were subsequently released that same year on their hit duets album Singing What's In Our Hearts