For me, my muscle gains when I'm working out right (um...not like right now, when I've been on a lull for too long, letting other obligations keep me from a regular workout routine, and especially from more intense weight workouts :-( ) are just fine. I'm able to workout intensely with Cathe (and Tony Horton), and for some body parts and moves, lift heavier than Cathe. I've never had the 'look' Cathe, Jai and Lorraine do, but I'm more endo/ecto than them (and a hard gainer), and am not striving for that look anyway. (Right now, I'm softer than I want to be, but it's not due to diet: it's due to not working out as consistently as I should...but don't tell anyone!)
I make sure to have about 20 grams of protein 3 times a day (a protein smoothie in the a.m. if I don't feel like making breakfast, some lentil soup at lunch or dinner, etc.) and the other foods I eat probably bring my protein up to around 70 grams, which I think is plenty.
I think nutrient timing is important: make sure to have a 4-to-1 carb-to-protein feeding after an intense weight workout.
Also, quality of protein is important: hemp protein is probably the best plant-based protein, as it is a complete protein and contains a type of protein that is easily assimilable. Second to that, I'd go with a pea/rice protein (or yellow pea protein). Soy is a complete protein, but pretty much all non-organic protein powders are GMO, and made from concentrated or isolated protein, which I find questionable (I prefer soy FOODS, like tempeh, tofu, edamame). Soy is also hard for some to digest. When I switched from soy to, first, pea/rice protein then hemp protein, I discovered that soy protein was the culprit that had been making me gassy (TMI?).
I see no reason why being a veggie would affect performance negatively. In fact, several studies show that a vegetarian diet improves endurance. (But if you THINK that it will affect your performance negatively, then it very well might!)
I would discourage you from going back to a pure raw-food diet (if that is your intent). I've read up a lot on raw foods, and tried it out myself, and nothing convinces me that it is tenable in the long term. It's hard to get sufficient calories without excess fat, IMO. And many raw-foods diets seem too heavy in either fruits or nuts/oils. I think an 80% raw-food diet is doable and healthy, and allows sufficiently for calories from cooked foods that are not necessarily high in fat.