It sounds like maybe you're working on a book?
Going off this assumption (apologies if I'm wrong), it does make sense that the person (who's vision it is not) is assuming that a story must have plot. A lot of writers and nonwriters alike thing of books as plot-based things. But they don't have to be. For some writers, it's the idea. That's the core, and anything else is auxiliary to it, inessential to it.
Good luck with whatever it is you're trying to create. I hope you'll divulge at least a bit of what it is -- you've got me curious.