Simon Cowell Won't Witness the Birth of His Son