Windows has supported multiple languages from the start. Now, it even lets you have multiple languages installed on your PC. You can use one for display, while the other can be used to type, and so on ...
I used the 'region and language' control panel in Windows XP to add Japanese as an input language. I no longer need it installed. So I go to the control panel and remove it, thinking I'm done with it.