LKY is just a public servant. Like many others when their term expire they left. He is not an emperor where this country belong to him and we are his subject.
There are many building that have historical significant that have been demolished.
So why a house of a public servant be significant that the PAP govt wanted preserve unless there is other hidden agenda.