It is tempting to allow location to keep track where you are, especially if you like to ask for some business in your current area. But privacy concerns could be involved and something to think about.
If you are not showing a location close to your it might be related to how your internet is set up. An ISP local asset may be used for that reference. If you turn off location, it should ask you for a manual setting to locate you. If it doesn't, look at settings, privacy..
Does the map app get any closer to your location?