Yeah, i know the 300/4s, great amp
Anyway, its a good sign that it hasnt gone into protect.....maybe it did run that hot in the SS and you never realised / checked it?
I wouldnt use 8AWG to power an amp like that, 4AWG is more ideal. I know youre not really pushing the amp that hard either, but its just something to think about in the future if this cant be solved.
Where did you ground the amp?
When you say you have the voltage set to high instead of low, you mean the input level? I'd be putting that on low if youre using RCAs from the head-units preouts too. Not sure if that'll make any difference though.