"[" displayed as "Ä" and "]" displayed as "Å" in remote terminal from vscode

I did the following things in VSCODE: 1) remote ssh into a remote virtual machine; 2) opened a terminal; 3) typed some characters into the terminal. I then noticed that [ is displayed as Ä and ] is displayed as Å in remote terminal from the vscode. I also confirmed that before remote ssh, characters in local terminal are correct. Further, my local machine is windows and executing "locale" on on bash session from remote server through vscode provides me the following result:

-console
bash-4.4$ locale
LANG=en_US.UTF-8
LC_CTYPE="en_US.UTF-8"
LC_NUMERIC="en_US.UTF-8"
LC_TIME="en_US.UTF-8"
LC_COLLATE="en_US.UTF-8"
LC_MONETARY="en_US.UTF-8"
LC_MESSAGES="en_US.UTF-8"
LC_PAPER="en_US.UTF-8"
LC_NAME="en_US.UTF-8"
LC_ADDRESS="en_US.UTF-8"
LC_TELEPHONE="en_US.UTF-8"
LC_MEASUREMENT="en_US.UTF-8"
LC_IDENTIFICATION="en_US.UTF-8"
LC_ALL=

Further, as I got no problem on the server without going through vscode, I ran "locale" there and got the following:

LANG=en_US.UTF-8
LC_CTYPE="en_US.UTF-8"
LC_NUMERIC="en_US.UTF-8"
LC_TIME="en_US.UTF-8"
LC_COLLATE="en_US.UTF-8"
LC_MONETARY="en_US.UTF-8"
LC_MESSAGES="en_US.UTF-8"
LC_PAPER="en_US.UTF-8"
LC_NAME="en_US.UTF-8"
LC_ADDRESS="en_US.UTF-8"
LC_TELEPHONE="en_US.UTF-8"
LC_MEASUREMENT="en_US.UTF-8"
LC_IDENTIFICATION="en_US.UTF-8"
LC_ALL=

There has to be some encoding decoding issue on vscode-server, in my understanding. Can anyone tell me how to fix it from vscode?