Try removing it this way:
- Click on the Start button of your task bar
- Select Settings, then click on Control Panel
- Open Add/Remove Programs
- Scroll down the Install/Uninstall list and select Baldur's Gate
- Click on the Add/Remove button
If you can't do it this way, then you'll need to use Regedit (with CAUTION!!).