Yes you will need to take the Head light assembly completely out in order to change the bulbs. It isn't that hard, just take you time and keep the patience..
Do you by any chance have the Owners Manual? If you do then it will show you how to take the Headlight assembly out.