I find that after my having paused the Hands-free mode, or if the timer ran out, it will at some later point wake up and say a sentence out of the blue. This can very discomforting, especially if it happens in public or in the middle of the night.
The workaround seems to be to kill the app after pausing, but that’s not an option if it was paused by the timer.
Yikes! Sorry about that. Any patterns you may have noticed or additional details please let us know. What device and Android version is this happening on?
Update: It just happened again. This time I had paused the play and was using another app when suddenly a sentence was played (only the first step in the sequence), the same that was on as I paused. This was some 15 to 25 minutes later.