No. Imagine that your heat exchanger is simply two touching pipes running parallel to each other, with flows in opposite directions. Incoming air will gradually warm up as it comes inwards, eventually being warmed by the air which has just left the room. You can get a much better result than just averaging the temperatures.