[optim]: NAdam, RAdam and _multi_tensor_adadelta do not support complex types #110606
Description
🐛 Describe the bug
It is trivial to add support (by viewing params, grads and intermediates as real via view_as_real), but somehow, unlike other optim classes, they inconsistently do not support complex.
Versions
main
Tasks
- adadelta multitensor
- NAdam
- RAdam
cc @vincentqb @jbschlosser @albanD @janeyx99 @crcrpar @ezyang @anjali411 @dylanbespalko @mruberry @lezcano @nikitaved