Run following command first to see exactly which files you will remove.
find . -name "*.bak" -type f
Also, make sure that -delete is the last argument in your command. If you put it before the -name *.bak argument, it will delete everything.
But use it with precaution.
find . -name "*.bak" -type f -delete