AD driver loopback detection

I have AD driver that syncs bi directional (account creations edir->ad, all other changes edir<-> ad). Everything working as expected sofar except when
user has two telephonenumbers in vault and one number is ad and when I delete one value from value that deletes the value from ad thats fine but publisher channel
detects that change as remove-all event and removes the second value for the telephonenumber attribute in the vault. Is that functioning as designed or did I miss something.

Thanks