Don’t worry, there is a little trick to speed up SFTP over SSH connection. For better speed raise priority of BLOWFISH cipher (BLOWFISH is much faster than AES). You may have double increase speed while uploading/downloading files. Security goes down lightly.