Turning down skunk meat means you have rabbit meat.
Skunks are known for their ability to spray a liquid with a strong unpleasant smell. Skunk meat is considered edible but requires expert handling. This is because the meat can easily get spoiled and become totally inedible, due to the glands which produce the spray.
To turn down an offer implying it is unworthy, one suggests they have better alternatives.