If you are still at the point of translating in your head, you are not a competent fluent listener. Someone who is fully competent in Latin won't do that.