Yes, but only at radio frequencies. And it acts as a capacitive divider against base-emitter capacitance, which means the base should have some capacitance to ground, so the transistor acts somewhat like a common-base amplifier (regarding the feedback anyway).
The usual purpose is making an oscillator with an operating frequency near the transistor fT.
Tim