There are two ways to look at this, and each gives you a different answer.
1. Football you have an entire week to prepare for. All of your efforts for six days are focused on one opponent. You scheme for that opponent. You prepare to defend that opponent. A loss to an inferior team is inexcusable.
2. Buffalo is a far better football (and basketball) program than is Rutgers, while Fordham has been struggling for most of the time it has been in the A-10. Losing to Fordham, home or away, just isn't a good sign, while Buffalo has something pretty good going on. A loss to Fordham is inexcusable.
Of course, there is a third factor, as Buffalo was a home game and Fordham was a road game.
Empirically, the Fordham loss is worse. But a bad loss in basketball is, usually, far more excusable than a bad loss in football.