I've been to University of New Mexico for a conference, and to be honest, my impression of the city wasn't that bad. This was in 2019, so I'm going to assume that not much has significantly changed about the city.
Unique architecture, beautiful landscape (if you are into geology and topography), and friendly people.
My only gripes is that a lot of people would start speaking to me in Spanish because they thought I was Mexican (I'm actually Guyanese) - the cashier at the Duncan Donuts gave me a nasty look when I told her I didn't speak Spanish. I think she thought I was "pretending" not to (which ironically, is something I deal with in Brampton).
I was also really disappointed that the one Mexican restaurant I went to was terrible. I love Mexican food, but it's hard to find a good place in my city - Albuquerque is supposed to have an amazing food scene, and I just happened to pick the one place that was sub-par.
While I wouldn't visit the city for a vacation, I wouldn't object to going back if work or social commitments required me to.