In May 1957, two solo songs for Ethel Merman were added to the original production. They replaced two songs by the show's primary songwriters: Matt Dubey (lyrics) and Harold Karr (music). "Just a Moment Ago" replaced "This Is What I Call Love" in the first act. It was added to the show on May 6, 1957, according to Sam Zolotow's New York Times theatre column on May 7, 1957. The other song, titled "I'm Old Enough to Know Better, and Young Enough Not to Care" replaced "The Game of Love" in the second act. The change occurred on May 24, 1957, according to Zolotow's column of that date. Both song were credited solely to Kay Thompson. According to Brian Kellow's Ethel Merman: A Life, they were written by Roger Edens, but he could not take credit for them because he was working for MGM on an exclusive contract. According to Sam Irvin's book Kay Thompson: From Funny Face to Eloise, the two songs were co-written by Thompson and Edens.
On page 305, Irvin's book also quotes cast member George Martin saying that Thompson wrote Merman's first song in the show, "It's Good to Be Here" (more popularly known as "Gee, But It's Good to Be Here" as it was listed by that title on the cast recording). Martin is quoted as having said, "Kay came in and she secretly wrote that new opening number for Merman. She came to Philadelphia when we were in previews and that's where it happened. Just listen to it. It's typical Kay. Like 'Madame Crematante' in Ziegfeld Follies, it has Merman addressing a bunch of reporters—and I was one of the reporters. But Karr and Dubey were given the credit because their contract or the union made it difficult not to."