I think you've got it sussed! I recently saw an interview with an author of a successful book - he wrote for an audience of one.

If somebody's inherently interesting (which you appear to be 😉), then the "audience" will come. If that particular author started writing what the audience wanted (or at least what they think they wanted), he wouldn't want to write.