[freakray]

You should be able to do the required putty work without any problem.

You can lightly sand the primer to even it out but the texture does have a purpose, it gives the paint a better surface to adhere to.