But where did Carmy go?

Carmy really thought he did something by tearing down the wall, but Sydney was not happy. After he apologised to Sydney, he walked away but where TF did he go? Did he go to cry in the car because his wife was mad at him? I need answers.