Tried the paper thing earlier. The paper came out on the front left and front right door (didn't try with the back doors). It took the same "strength" to pull out no matter which door I used.
Even though I just got the car a few days ago, it is about to hit 10k miles. I plan on taking it in for a basic inspection/check, and am going to ask the car guys to see if they think the noise is too loud inside the cabin.
On a different note, I managed to soften the vibration I was getting from the dash material. At the store I saw a 5 dollar seat belt cushion thingy that is meant to go over the belt right where it hits your chest. I popped that in between the windshield and the dash material, and it seems to have quieted some of the vibrations.