Once the home of the wealthy Chan family who served as imperial court officials and worked as merchants, they fell upon harder times with their relocation to Xiguan