Neighbors in a Citrus County community are fighting a proposal that could bring an asphalt plant to the edge of their neighborhood.