He was annoyed he'd let them know to see if they were interested. No one seemed to care or show any interest. Then when he would do it they would try to lay a guilt trip.
He got upset with their antics because if it was a role switch he would've said yes or no. None of this making them feel like he was causing conflicts in their schedule. It wasn't his fault or fair with him they demanded answers after a while he got tired of explaining himself. Now they are trying to make him out to be the troublemaker before he embraced it now he walks away from it all.