In vi/vim, to disable visual mode and keep the syntax highlighting:
Add to your ~/.vimrc file:
~/.vimrc
set mouse= syntax on