It's less shut up and more for Yondu not to stress over it. It's happened, it's done, nothing can change from that. If he's wronged this new kid somehow then he would just have to repair it, if there was a chance to do so.

"Then you did your job." Though as he says this Vegeta knows there is more to being a father. It had taken time, but he knows that now. "Plus he just got here, right? It takes time to get use to this stupid fucking situation."