On my phone (Note 8, Android 7.1.1), when I go into Maps and Your Places, I see hundreds (around 400) of addresses from my contact list under the Labeled tab. Everything I've read says that if you don't want these address to display, you should go into Settings | Personal Content | Google Contacts and move the slider to the off position. I did that (Google Contacts is now grayed out), but all of the contacts are still showing. Hiding them one at a time would be a nightmare.
I've tried forcing the Maps app to stop hoping that would force the app to refresh the address list, but that didn't work either. I have even tried clearing the cache and saved data for the Maps app but these Contact addresses are still showing up. Any suggestions?