The dot icon on the dock stays despite I have closed the app

As the title clearly describes, the dot icon stays on dock for some apps such as VS Code, Terminal, Safari, and Finder despite I have closed the app. I am using Catalina 10.15.1. I have to manually right click those apps and select Quit in order to remove the dots on the dock.