Is 22 too young to get pregnant and have a baby?

I am turning 22 in august and I have been with a wonderful man for 2 years. We talk about having children and marriage. He said he always wanted kids and I think he would make a very caring and protective father. Recently we had some fidelity problems on both sides. The relationship got rocky and we almost broke up, but then we came back to each other and forgave each other with the intention of a "fresh start". Also I may add that I was born with a congenital problem where my left fallopian tube was not attached to my uterus and had to be removed when I was 15. The doctor said my chances of getting pregnant are half that of the regular woman because I have to rely on the one tube. I want to get pregnant sooner than later because it might take a long time to have kids. I also have one year left of college and I work part time. My boyfriend works too, but he also told me that he is not ready for children and wants to wait until he is 25 or older. I want them now because I am afraid of two things 1) I can't get pregnant easily 2) he will leave me. Is this foolish? Is 22 too young?