People are making it more damning that it actually is. Sexy covers and hot genres bring more eyes towards them, meaning more good and bad ratings. If you don't want attention, don't use baity covers.
Again, just because someone rates your story badly doesn't mean you're getting rating-bomb...