Was it the balancer itself, or a pully?
A wobbly balancer does need to be replaced. You can also try gripping the outside of the balancer and try to move it around or back-and -forth (when the engine is turned off!!)
There should be no appreciable movement between the balancer and the crankshaft.
Also, bad balancers often (but not always) make a clunking/clicking noise when the engine is running.