"At the time that she got pregnant, I wasn't with Lexi, and [Danielle] wasn’t with her husband," the country singer explained ...