To immediately stop an active quiz, first click on the quiz in your Quizzes List and then click the ' Stop' button.Stopped quizzes will appear in the Quizzes list and accessing them will show a message saying that the quiz is no longer active.
Here is a guide to Stopping your Quiz:
https://www.quiz-maker.com/Quiz-Help/Stop-Quiz