Why not focus on the flip side of this?
There will always be someone who enjoys your work! It is now easier than ever to reach millions of people with minimal effort. The numbers game alone dictates that there will be people out there who will connect with your stories. Put those fears aside and deliver something. In time you will build your brand and with it your audience.