The Northern Ireland Office minister and leading Brexiteer acknowledged the referendum would have failed under a supermajority.