This delightful public area was once the royal family’s private hunting ground