Don't re-hash the key when updating the constant buffer

This could have been done a bit more elegantly with some more effort,
but for now this serves its purpose.