Recent contacts have an “X” character next to each name. The list of names that Outlook uses is a combination of stored contacts, the company directory, and recent contacts.
When you compose an email message and add people on the To, Cc, or Bcc line, Outlook suggests names as you type characters.