I don't think it's a good idea to unfollow people you don't like. You shouldn't stay in an echo chamber all the time.