The Google Analytics code appears twice on my website (Magento 1.8.1+)

The currently released version of Google Analytics has not been marked compatible with this version of Magento (1.8.1) due to changes in Magento's Google Analytics extension. You might want to try the development releases from Github which will resolve the double up.