After Inoue Kaoru, this property was possessed by Prince Kuninomiya, the Akaboshi, and the Iwasaki families. Finally, it was passed on to government ownership after World War II and was disposed of to the I-House. The building was used as the main building until the current main building was built.