Memories of relationships do come with a mental image of the person the feelings are associated with. So if said character is already in game or appears later (or someone who looks really similar does) your character will recognize them.