You visit me once in a while.
Difficulties, on the other hand, are coming thick and fast.
I'm not sure what good it does to share my woes with you.
I suppose that you don't want to break your heart over my difficulties.