How to get rid of ssh bandwidth limit?

I was playing around with a server I set up myself, running archlinux, and when I tried to retrieve files from it, using scp or rsync, I noticed the download speed was abnormally low, being capped at around 1.1MiB/s, when I didn't met any trouble sending files at 120MiB/s. (I also was able to download files using http at 70 MiB/s) I then did the following experiment:

LOCAL: $ ssh login@host
REMOTE: $ cat HUGE_FILE

Result: The content of the file is displayed in the terminal, the download speed is about 15MiB/s

LOCAL: $ ssh login@host "cat HUGE_FILE"

Result: The content of the file is also displayed in the terminal, but the download speed is only 1.1MiB/s (Edit: ssh -t login@host "cat HUGE_FILE" gives the same result) It seems there is a specific limit when launching directly a single command, but not in a regular session. I searched all I could but couldn't find some config file enabling such a limit. So I would be thankful if anyone could advice me on the source of this problem and how to solve it.