Wikipedia talk:Responsibly using large language models

Latest comment: 2 months ago by Joko2468 in topic Notes on advice beyond the essay's scope

Notes on advice beyond the essay's scope

edit
  • Synthesis is the principle use case of LLMs, which is incompatible with WP policy, but in my experience you can stress in your prompt that the LLM is to avoid synthesising information and it tends to be fairly effective in lowering the incidence of this.
  • This article assumes that editors will be novices when it comes to LLMs and that they will be using the base models available. That they might want to consider a paid model to improve reliability is valid advice.
  • Detailed how-to guides that are less vague would be of more use to these novice editors, but constitute advice that should really be subject to more of a consensus.
  • Ideally content quantifying the risk of hallucination and synthesis would be present but this would probably have to take the form of a study conducted by editors on a regular basis. I doubt there's much appetite for this while the epidemic of LLM misuse is in full swing.

Joko2468 (talk) 00:50, 28 March 2026 (UTC)Reply

i.e., expanding on and building consensus around these sorts of problems: User:Festucalex/Don't use LLMs as search engines. In being rooted in established guidelines and avoiding opinionated original research that goes beyond this, the essay is currently very vague and far less informative than it might otherwise be. It's unfortunately reflective of how much work is needed on establishing guidelines that could effectively combat LLM misuse. Joko2468 (talk) 11:09, 28 March 2026 (UTC)Reply
The humourous parts are supposed to get across the scale of the verification burden on LLM users-- this has been theorised in academia but I'm not aware of empirical research or a basis in Wiki policy so I chose to cover it less seriously. It's also intended to remove any condemnatory undertones. Joko2468 (talk) 13:57, 28 March 2026 (UTC)Reply