The Fairview Inn has lost its fight to keep the zoning designation that allowed it to run its business in a residential Jackson neighborhood.