Does certutil -delkey actually delete the certificate and private key?

Does certutil -delkey actually delete the certificate and private key?

I am trying to delete a certificate and it's private key using certutil -csp "Microsoft Enhanced Cryptographic Provider v1.0" -delkey "the key container". This gave me a command completed successfully message. I then check what is in the store again with certutil -store, this still lists the certificate. When i then try to delete again, it gives me KeySet does not exists. Can someone explain what the -delkey option and why it still appears in the output?