I think it will be fine. I hear that going the other way, 2.0 to 2.3, you have to shim the motor mount about a half inch. I don't know how that will affect you doing the reverse.
05 ZX3: 15.90 Quarter Mile Best official reaction time: .0004
New: 04 SVT : K&N panel filter, 3 performance motor mounts.