The only way I could get my meat fingers in there was to pull at an angle. Once I pulled it out far enough to disconnect the element wires I was able to see the clips on one corner. I kept pulling in that direction until they released and the rest came loose easily.
Pro-tip: Use one hand to leverage the mirror out with your fingers with the other hand covering the mirror and housing in case it pops quickly. Gravity and mirrors don't mix.