By designing five different incoherent sources in ghost imaging(GI), we have proposed a kind of five-step phase-shifting method to reconstruct the phase distribution of the complicated object without the need of complicated GI system, iterative algorithm and Fourier transform step. The applicability of this theoretical proposal is demonstrated via numerical simulations with two kinds of complicated objects.