Don't think anybody said what you said they said. Nobody said "average." You said that.
The reality (not irony) is that Rutgers is not and will never be an Ohio State or maybe Oregon or perhaps even a Penn State. Certain on Ohio State, and perhaps Oregon and Penn State have some wiggle room. But Rutgers can be a Wisconsin, an Iowa, a Michigan State or even a Nebraska. You will note that Michigan is left out of this list. Consider Michigan's last 20 years. It took Jim Harbaugh 5 years to get Michigan to the CFP.
The other reality is Rutgers does not have the resources that teams like Oregon, Penn State and Ohio State have. Years of winning. Storied programs. Deep pocket donors like Phil Knight. 100,000 plus (check Oregon) stadium. Rutgers may never have these resources.
The other reality is New Jersey does not have rabid college football fans that root for their home team like Ohio State, Michigan, Oregon and Penn State have. New Jersey is a state full of transients, transplants and some people who were born and raised here and bleed scarlet. Those other states identify with their state university. And they also don't have a major state newspaper looking to tear down their State U as every turn.
Rutgers is what it is. For most of its history, the butt of college football jokes, an under resourced program that caught lightning in a bottle with Schiano 1.0, only to find itself homeless after the Big East dissolved, and relegated to being nearly homeless like UConn and floating on a crap island called to AAC, only to get a huge lifeline and life raft from the B1G. Who do Rutgers fans owe that to? Two people, and one of them is derided and ridiculed each time the team slips up and goes on a losing streak.
Sure, Rutgers could fire Schiano and take their chances on a flash in the pan hire and maybe get a Curt Cignetti. Maybe, however, they will get a Lance Leipold (not bad, but so far not too great -let's not get too giddy about last night), or worse yet, Rutgers could get a Mel Tucker. Or a Chris Ash or a Kyle Flood. We saw what they did.
The University and the program has a lot to overcome to get to the peak of college football. Years of losing, a fickle State population mostly disinterested in college football, lack of big pocket donors, being part of the one of the two top conferences. Greg Schiano is like Sisyphus. There is a lot working against him. Greg himself said he came here to win championships. If it took Jim Harbaugh 5 years to get Michigan to the CFP, why should Rutgers fans expect it to happen sooner under any coach they hire, and to have SUSTAINED (not one year wonder) success?