Not necessarily. Academics are not everything. You're going to be living there for 4-5 years, so choosing a college based primarily on academics is kinda narrow minded. Truth is, unless you end up going to an ivy league or other top 10 school, where you got your degree is not going to matter once you get a few years of work experience under your belt.
College is a great place to experience life and maybe do a little growing up. Making sure that the activities that motivate you are available and convenient is a good thing to consider. As is the aesthetic of the campus and town, and the types of people who go to school there.