The Mountain only rode stallions. The Knight of Flowers, knowing this, rode a mare that was in heat. The Mountain's horse freaks out, which is why he misses. So he kills the horse and goes after Loras for his trickery.
But yeah, he's all senseless rage too.