Letting them win, all those who hurt you, made you question yourself, and put you down isn't in the form of a wall. Put your defenses up, but remember to let it down from time to time for those who matter.
When their actions freeze your heart through, you turn as cold as they, when you can't be content, and happiness is all but a lie, then that is letting them win.