I agree that living in a society and having your own goals, you will sooner or later come across the fact that people (maybe even close people) will talk about what you will not get. They may not believe in you. They might think that you can not do it.
But the main thing that matters is your personal beliefs. We are building our own lives and we are responsible for our actions. Therefore, you must do as your heart tells you.