Temperature-immune micro-displacement measurement is demonstrated by using a Gaussian-chirped tilted fiber Bragg grating (TFBG). The internal tilt angles of the sensing TFBG are effectively modulated via a displacement-induced Gaussian-strain-gradient along the specially designed bending cantilever beam. The phase mismatch between different effective pitches and tilt angles weakens the core-to-cladding mode coupling as the beam is displaced. While the power of the ghost mode resonance in transmission shows a strong sensitivity to the displacement, it is immune from spatially uniform temperature changes. Ghost-power-referenced displacement measurement and temperature-insensitive property are experimentally achieved for this cost-effective sensing device.