This question is off-topic in the VSTO forum, as VSTO solutions run in-process with the application as tools for extending the user interface. The application hosting the VSTO solution is never sent the command to quit from the VSTO solution. The forum's
Please Read First message lists venues more appropriate for questions about general office "interop".
FWIW you should always Application.Quit to end the Word application instance. Hard to say why you might be getting errors, since we don't know your code or the architecture of your application. I suggest you post to one of the venues listed in Please Read First. When you do, be sure to
1. Mention the version of Word involved
2. Show the code that instantiates the Word application, as well as the code that's failing, plus anything else you consider relevant
3. Mention the programming language and version of Visual Studio you're using
Cindy Meister, VSTO/Word MVP