When a person is passionate about what they're doing, there's nothing that can or will stop them. It doesn't matter how many people are talking about them not does it matter if they fall down along the way. A person filled with passion will keep getting up, keep fighting and make the most out of any situation until they succeed.
Another question.......Have you ever met a person with great passion who lacked the energy to finish their mission? I don't think so and I doubt that you'll ever find such a person.
So as the saying goes "find something you like to do so much that you'll do it for nothing and if you learn to do it well, someday people will be happy to pay for it."
What are you passionate about? Are you truly passionate about your current job or business? Or is it just something to do to pay the bills. If you have passion driving you and it's fun, then the saying stands true that "there's no fun like work!"