This sounds like a lovely idea.
I believe that the conference mode can and shouold be reconfigured, notably through collective creation within different proposed workshops, like maybe Speculative Fiction workshops, Dream immersion, storytelling. I think it is also a good idea to invite some people and hear about their propositions and interests, establish axis of research/theme and create a programme building from this interaction…