Comment by worksonmine

And if you set `set editing-mode vi` in ~/.inputrc (readline configuration) you'll have it in even more places.