Sadly, I’m not sure this would be easy given the privacy focused way we currently handle contacts :
I agree, it would be a useful feature!