Ok something is clearly not going the right way; or you do something that only appeals to a small audience (nothing wrong with that, but you want more I guess) or you are simply not "intresting".

Maybe you should fix your "act" or start doing something that appeals to a lot of people (which is eventually fixing your act).