I've found that using a glass scraper worked for melted plastic when I neglected to let the header cool before putting my cover on. Just be careful, I did scratch my header a little bit using this technique, but I have clumsy hands. And for some road tar that was on the muffler, I used a penny to scratch it off. The soft copper of the penny didn't scratch the chrome.
Good Luck!