No you do not have to do anything. Rather decide on what it sounds like in comparison to a reference and each other. Compare Zero Latency with Linear and Nothing. Listen to what you like best
Check out catandbeats:
/ catandbeats
/ catandbeats
http://www.catandbeats.com