Average margin of victory is misleading, for the beginning teams were not at the same calibre . So the overall average is distorted
True, but look again at their last three wins:
Arkansas - 9
Houston - 19
Gonzaga - 16
That's pretty freaking impressive IMHO. Since 1990's UNLV 39 point romp over Duke in 1990, Baylor's 16 point win agains Gonzaga is second only to Villanova blowing out Michigan by 17 in 2018, UNC beating Michigan State by 17 in 2009, and tied with Florida beating UCLA by 16 in 2006. However, none of those games involved the #1 team in the country, previously unbeaten, losing. (Michigan State and UCLA were #2s in their bracket, Michigan was a #3.). Heck, Duke was a #3 in 1990 as well.
My point is that Baylor should be considered among the all-time great teams and it doesn't seem like the are being thought of in that way.