I will agree that Tomoya is quite emotionally unstable(Big After Story spoilers) Even after spending a long time with Nagisa, he ultimately isn’t a strong enough person and hasn’t matured enough to take care of his daughter on his own.
I do see your points, but I’m just not convinced. Call it stubbornness if you’d like, but I find it hard to stomach that Tomoya would be this indecisive and cruel, even with his insecurities. It doesn’t help that he’s quite slow to take the romance route in other stories and doesn’t broach that possiblity until he starts having feelings for the girl.
I appreciate this discussion, though, it’s been very enlightening.