That makes sense to me and you certainly wouldn’t be the first one that was sensitive to the smell of wool (or organic wool).
You could try unzipping and removing the cover and hanging it out in the sun for a few hours to see if it makes any difference (sunshine activates the natural self cleansing and deodorizing properties of the lanolin in the wool).