Please consider removing the Explain feature entirely

Clozemaster Questions, Suggestions, Feedback
#32

I skimmed over this thread very quickly before but I came back to it now to give my full support to David’s original point.

As I’ve gone through 3,500 Ger-Eng sentences since January I have noticed a pattern that almost every time a sentence has 4+ comments it’s typically someone asking a question and then someone posting an “answer” that goes “chatGPT said: blabla” with zero criticism or context. Sometimes there are no answers from an actual native (/advanced speaker) and sometimes there is a human answer but someone has posted an AI gibberish response anyway, sometimes multiple.

But more importantly and why the thread popped into my mind again, I learned this sentence today and was flabbergasted by the comments. If it was up to me I would have banned Peter on the spot but that’s a quite harsh measure to take when the platform itself uses the same technology for getting further “context” for the sentences. All I can say is I am not in the least surprised that this thread is made by the very David nor that Peter has chimed in with further valuable remarks.

I get that the explanations can be a powerful asset when learning languages. I checked one before writing this for context and at least that one looked fine and comprehensive at a glance (not that I’d know if it was correct). That is why I would like to propose a compromise that lets you both keep the feature and improve on it:
First, when a new explanation is generated (which you thankfully only do once per sentence I noticed) have the actual language model used obfuscated and instead present a big and bold “This explanation was generated with a LLM and must be taken with a huge grain of salt as it might be completely wrong.” This should make people less prone to deifying the tech and the magical thinking around AI. We don’t need to know which model was used but we do need to know to be cautious of it.
Second, have the explanations available somewhere so that natives can check any new ones and either mark them as fine or edit them (or discard) if needed. For explanations approved by humans you can instead display at the bottom “Explanation approved by [user]” and even display the Explain button in a different colour to indicate that the sentence has a proper explanation to it.

6 Likes
#33

I like these ideas.

That’s what I meant by this comment in that other thread in this forum that also raises concerns about coherently-looking but wrong “explanations”:

2 Likes
#34

I’m sorry, but I don’t like the idea, although laudable. My problem with this is that going through even a subset of all the AI explanations is a gargantuan task, given their verbosity and their abundance of low-level detail. I’m afraid it would take very long for me to review an explanation to the degree that I would dare give it my seal of approval.

#35

From what I understood there doesn’t exist an explanation for every sentence pair by default but instead one is generated the first time someone clicks the button. If this isn’t the case then at least it could be made so that an explanation only pops up to be reviewed based on such idea anyway. This would greatly reduce the number of explanations needed for approval. Moreover I would imagine that different users desire explanation for similar sentences, like when a new piece of grammar or an idiomatic phrase pops up the first time.

I will admit that I personally would never do any approvals simply because I don’t want to read anything from a chatbot but not everyone is as vehement. My proposal was that if the explanations are here to stay we could at least improve the concept. As I said I’m all for simply removing them as I have found the old system of “if you have questions about the sentence ask away and someone might answer you in time” much preferable because the other users might have asked or pointed out something I didn’t even think of and then I’ll get extra context (actual human-provided context) to learn if I just click the comments open when I notice there are some. Or at least that used to be the case before the answers turned into “chatGPT said: [who cares]”.

3 Likes
#36

I agree with @morbrorper. This would be a gargantuan task.

The problem with @Tuutti’s proposal would be: Who would do all this work? I, at least, wouldn’t do all this work for free.

#37

I second that. If the feature that generates text by drawing words from some probability distribution won’t be removed (which has been stated multiple times already—that it won’t be removed, at least for now—which I respect and accept), then I agree with the view that at least the efforts to verify the generated texts (or to make people aware of the fact that these texts could be utter nonsense) should be increased.

If, in the end, more people need to be hired to do that (paid) work because it would be a gargantuan task that nobody (so far) would volunteer to do, which would probably lead to an increase of the costs for the customers, then one could return to the question, “Is all of that really worth it? Just to rescue a feature from elimination that is correct maybe half of the time?”

2 Likes
#38

I would just like to reiterate my post of way back when since I find it extremely useful alongside other means. Perhaps I’m too easily pleased …

3 Likes
#39

If people want to use ChatGPT for learning checkout Ecosia’s chat https://www.ecosia.org/chat?q=ecosia

It’s a version of ChatGPT but is running on 100% renewables (also worth checking out Ecosia as a search engine as it too is running on renewables and uses its profits to plant trees).

Perhaps Clozemaster could use this too one day?

1 Like
#40

this feature is extremely helpful and an essential add-on to cloze master.

There needs to be a shift renewable energy especially on the backdrop of increased usage of AI models. Nonetheless, neither this forum nor the developers of a language learning at will influence this.

1 Like
#41

It is difficult reading such condescending nonsense from someone that is emotionally bound to a global warming (or cooling?) theory. I find the explain feature extremely supportive. I haven’t experienced an error (though the pronunciations can be wrong). Humans make more errors than I expect from ChatGPT as that tool quickly scours the web and summarizes to create a readable explanation. And only has to do this one time and store the explanation? Efficient!!
It is a major reason for using ClozeMaster. Without the Explain feature, I would resort to Glossika.
Thanks Mike for not punishing the thousands to satisify the few (who don’t have to use the feature).

1 Like
#42

Just to clarify and see whether I understand you correctly: Are you denying (or not believing) the fact that Earth’s climate is changing due to greenhouse gas emissions from burning fossil fuels?

#43

I think getting into sensitive political issues will eventually spoil this thread which we have all enjoyed so far. Already I’m taking your advice and getting out now.

3 Likes
#44

Here’s an open question for the people who like to use the Explain feature: Have you tried using other resources – especially Wiktionary – to obtain similar information? If so, how did it compare? Are you aware of the feature that lets you click on a word and look it up either on one of the sites that Clozemaster gives you by default (Wiktionary being one) or a site that you configure yourself?

For every language I’ve studied except Hebrew, I’ve been able to find anything I wanted to know about a word’s grammatical characteristics (number, case, etc.) and etymology at Wiktionary. For Hebrew, where Wiktionary coverage is not very good, I’ve been able to find the information at Morfix and/or Pealim. It might take two or three clicks rather than one, but my experience shows that I can trust the information without worrying about it having been hallucinated.

I personally stay away from generative AI for a number of reasons. I’ve often seen it make mistakes in subject matter I know, so I don’t trust it with material I don’t know very well. I know that it uses huge amounts of energy (even if there might be ways to offset some of it by saving results previously obtained). It’s not very good at giving credit to its sources (though the AI I automatically see when doing Google searches has gotten somewhat better in that regard). It forces me to relinquish some control about which results I investigate further that an ordinary search doesn’t.

In this discussion, I see some people saying they like using the Explain feature. What I don’t see them doing is comparing it to the alternatives.

7 Likes
#45

Thank you for writing this, @alanf_us.

Exactly. This is called the Gell-Mann amnesia effect. Which means: When you know a topic well, it’s relatively easy to spot when somebody says something wrong about that topic. This applies not just to “AI” but also to journalism.

But when you’re a beginner or unfamiliar with a topic, you tend to take at face value and simply believe whatever you’re told by a perceived authority (like a newspaper or an “AI”), even when it’s completely made up or not based on facts. “It was in the news, so surely it’s correct! They wouldn’t print wrong information, would they? As a newspaper, they certainly have fact-checkers to get their stories right, no?” Except that humans don’t even (consciously) have that thought, they simply believe without questioning. Even when they just saw an article whose topic they’re very familiar with where the newspaper got it completely wrong.

I’m not saying that you’re stupid if this effect applies to you. I’m not saying that you fell for some trickery due to being too naive. Before I’m being called “condescending” by a climate-change denier again who thinks that all the facts I posted thus far are “nonsense”. This Gell-Mann amnesia effect is just how the human mind seems to work.

This is exactly the case when you use “AI”. Often, you don’t even notice when it’s wrong. Even when you did notice that the ChatGPT explanation got it wrong, some people never seem to learn the lesson to eventually not trust the ChatGPT explanation anymore. It’s as though each new sentence were a fresh new start where ChatGPT gets yet another chance. For some people, ChatGPT can be completely wrong as often as it wants and yet they still put their entire trust into ChatGPT again in the following sentence. This is the Gell-Mann amnesia effect. Some people brush each and every mistake aside or immediately forget that ChatGPT had just been completely wrong in the sentence they just saw. This is the ‘amnesia’ part. And I believe that many Clozemaster users are unaware that they’re under this effect.

@alanf_us might be onto something: Are all defenders of the Explain feature even aware of the existing features? After all, they’re all hidden in various sidebars, you have to know how to find and use them, et cetera. In the mobile app, it’s even harder to click or hover with your finger over something than it is on your desktop computer with a mouse. Whereas the ChatGPT explanation is directly under their nose, easy to find, and requires just one intuitive click on a simple big button in an obvious position in the UI.

I wonder what would happen if, hypothetically, a click on that “Explain” button would open Wiktionary instead of ChatGPT. Make Wiktionary as “under your nose” as the GenAI explanation currently is. The Clozemaster users obviously like the UI. The one button that gives the ultimate summary, instead of having to look up, say, 5 words 5 individual times. Hypothetical question: What if we replaced that backend behind that button (ChatGPT) with something else? Maybe the Wiktionary links etc. just need a better UI so that Clozemaster users no longer feel they’re “punished” by the hypothetical scenario of no longer having that obvious simple “Explain” button (and I specifically mean the UI element that is the button, not the ChatGPT explanation it represents). I don’t mean to remove that button from the UI, that can stay. I’m just arguing for a more sustainable backend.

2 Likes
#46

Wiktionary is designed to search a single word at a time. I don’t find this an inconvenience because I almost always only have a question about a single word (a consequence of the fact that I only use Clozemaster for languages where my level is intermediate). On the few occasions I have questions about multiple words within a sentence, I don’t mind looking them up individually.

However, if people use Clozemaster for languages where they frequently have questions about multiple words in a sentence, that might explain their fondness for the “Explain” button. I can’t think of a way around that other than automatically preparing Wiktionary-type links for every word in the sentence at once, which would seem to be a usability nightmare.

4 Likes
#47

I have found very few of these resources to be 100% accurate for French. I have seen French translations in Wiktionary that I have been unable to verify anywhere else. (That is troubling.) I have ended up with a hybrid model. I sometimes use ChatGPT, but take it with a grain of salt. I have seen ChatGPT flip-flop on difficult issues when I challenge its inconsistencies. I think ChatGPT is about 80 percent helpful, sometimes I just get clues.

Websites I trust, such as Lawless French, sometimes generalize the rules and leave out the exceptions and intracies of French grammar. I bought Le Bon Usage (an older edition, so cheaper!). Even it waffles on the grammar rules at times. Reddit is a good resource for discussions of French grammar and usage. The point is that one website, resource, or book will not be a great teacher by itself. When I delve into something that doesn’t make sense, I use them all. Then if I can’t figure it out, I post a question in the forum here or on reddit. At that point, it seems that some of the grammar rules are in the process of changing and you could say it a couple different ways and sound ok.

When I was new on Clozemaster, I used the Explain button a lot, now not so much. There were a few times that I was unable to find an explanation / translation anywhere else but under the Explain button. (For those tricky ones to find, I will leave a note what the idiomatic expression was in the public comments rather than only my own notes.)

I’m certainly ok if the Explain button is taken out. If that is done, there could be some explanation in the beginning instructions where and how to find translations. That would be a good place to discuss the pros and cons of the different resources. Alternatively, the explain button could be renamed but it would link to a page on clozemaster that talks about how to translate and what resources might be used. We might get a few more questions in the forums but that is ok too.

3 Likes
#48

Isn’t it optional? As are other translators.

1 Like
#49

This post was flagged by the community and is temporarily hidden.

#50

That is, first of all, completely wrong.

And you are very rude, in addition to being very wrong. Not to tell you what I really think you are because I don’t want to get banned from this forum.

I’m now blocking you. I won’t waste my time with someone like you. Good riddance.

#51

This post was flagged by the community and is temporarily hidden.