Don't try any chemicals. You risk cracking your taillights, I learned the hard way.
I wet sanded mine with 800 grit and moved up to 2000 grit. And then I used my DA polisher(you can do it by hand too) to work in Meguiars Ultimate Compound. Good as new.