It is worth noting that Queen Elizabeth and Prince Philip did not want to move to Buckingham Palace either finding it cold and cavernous and just having just got Clarence House the way they wanted it.
They moved at the behest of the government and the Prime Minister and, I fear that Prince Charles will find himself in the same position. The Queen or King Regnant live in Buckingham Palace, the masses and tourists come to photograph a Palace that is in daily use. They stop to watch 'The Changing of the Guard', but would it be worth it if nobody lived there and it was just a museum?
It is a status symbol and I think the government learnt their lesson when they short-sightedly retired The Royal Yacht Britannia, that moveable diplomatic palace.
As to Clarence House? That will remain to be seen as it has been the heir's home, the Queen Mother's home and the heir's home again.