To get rid of a bookmark, just drag the image of the bookmark you want to delete to the trash.