In the early 20th century, the Holy Trinity Cathedral rented the abandoned Yamen and made it an elderly home. It was named Guang Yin Yuan, literally the house of general care, and the English name "Almshouse" was inscribed on the door lintel.