Leave your job, it's obviously a problem.

Interests and hobbies have ups and downs, don't stress about it.