We'll warn you now in case you haven't been warned yet. Do not make changes to the default template set...see here for details
Now that you've been warned not to do that, make sure you have a custom template set in your site that you can make changes to. Many times this is taken care of by the installer but you can easily create one if you haven't yet. Here are the steps:
Now you have a custom template set that will contain your HTML/template customizations.