On cars so equipped the bypass hose usually connects to a small port on the water pump and will allow the coolant to bypass the heater core if the coolant level drops too low.
I'd go ahead and replace it if you never have. Chances are it is worn and brittle at this point.