Right mouse click the document's tab to open the document context menu

Click [Close document] to close the active document, [Close other documents] to close all open documents except the active one, and [Close all documents] to close all open documents.