There used to be an experimental flag for this that allowed you to control exactly what type of items showed up in the address field drop-down. The flag was removed a while ago though. Not sure why.