The Truth is that there is never anything to lose. This realization helps me to go "all in" with my pursuits, rather then being hesitant, beating around the bush, or dabbling. It's easy to identify those who are dabbling. They complain, they are indecisive, they talk behind others backs, they give up on a whim. A lot of people are dabbling in their work because their reason for doing it isn't true to themselves...they're doing it out of obligation to something else, imaginary or real, like social pressures, close relationships, or financial responsibility. It takes unfathomable courage to let go of these obligations to move in the direction of our true purpose. It goes against so much of what our parents and teachers tell us. The point is not to disobey them, but to love ourselves fully by honoring our own needs and desires.
Your outer-world is a mirror of your inner-world. You are where you are because you choose to be, so if you aren't happy with it, then change. Peacefully expect that people will reject you, that you will be ridiculed or even threatened, and calmly push on with a vivid vision of your purpose. At the start, it will be rough, and sorry - it will never get easier. But you will gain more confidence, courage, and character.
One day, you are going to die. So what are you waiting for? Go all in and don't hold anything back.