I think you should stay, you've already left once :\
But if you feel you need a break then you should definitely take one and return once you feel up to par.
Also, are you asking this because you are feeling sick or bored of the server or just generally for other's opinion?