Ex-New Jersey governor, once an ally, is a top critic of former president