Wikipedia Grapples With Chatbots: Should It Allow Their Use For … – Techdirt
from the questions,-questions dept
There have been various chapters in the new large language models (LLMs) story. First, people were amazed that systems like ChatGPT could write a sonnet about bananas in the style of Shakespeare, and in just a few seconds. Soon, though, they realized that chatbots replies might be grammatically correct, but they were frequently peppered with false information that the system simply made up, often with equally fake references. Were now at the stage where many are starting to think through the deeper implications of using LLMs, with all their powers and flaws, and how they will affect current working (and living) practices. As a post on the Vice site explains, one group grappling with this issue is the Wikipedia community:
During a recent community call, it became apparent that there is a community split over whether or not to use large language models to generate content. While some people expressed that tools like Open AIs ChatGPT could help with generating and summarizing articles, others remained wary.
Wikipedia already has a draft policy on how LLMs can be used when writing Wikipedia entries. The draft provides an excellent summary of some of the key problems of using chatbots, many of which will be faced by people in other domains. Here are the main points from the basic guidance section:
Do not publish content on Wikipedia obtained by asking LLMs to write original content or generate references. Even if such content has been heavily edited, seek other alternatives that dont use machine-generated content.
You may use LLMs as a writing advisor, i.e. asking for outlines, asking how to improve paragraphs, asking for criticism of text, etc. However, you should be aware that the information they give to you can be unreliable and flat out wrong. Use due diligence and common sense when choosing whether to incorporate the LLMs suggestions or not.
You may use LLMs for copyediting, summarization, and paraphrasing, but note that they may not properly detect grammatical errors or keep key information intact. Use due diligence and heavily edit the response. Dont hesitate to ask the LLM to correct deficiencies such as missing information in a summary or an unencyclopedic, e.g. promotional tone.
You are responsible for making sure that using an LLM will not be disruptive to Wikipedia.
You must denote that a LLM was used in the edit summary.
LLM-created works are not reliable sources. Unless their outputs were published by reliable outlets with rigorous oversight, they should not be cited in our articles.
It would be foolish to try to forbid Wikipedia contributors from using chatbots to help write articles: people would use them anyway, but would try to hide the fact. A ban would also be counterproductive. LLMs are simply tools, just like computers, and the real issue is not whether to use them, but how to use them properly. The guidelines listed above essentially amount to yes, you can use chatbots to help you write and improve your writing, but they should not be relied upon unquestioningly. That means human input and checking afterwards are indispensable. Also important is flagging up that LLMs were used in some way, so that users of Wikipedia know where information is coming from, and can be alert to possible problems arising from this fact.
The Wikipedia draft policy concentrates on how LLMs output might be used to create material for Wikipedia entries. The Vice article points out that there is another question, about whether there should be restrictions on how LLMs can use Wikipedia entries as part of the machine learning process:
The [Wikipedia] community is also divided on whether large language models should be allowed to train on Wikipedia content. While open access is a cornerstone of Wikipedias design principles, some worry the unrestricted scraping of internet data allows AI companies like OpenAI to exploit the open web to create closed commercial datasets for their models. This is especially a problem if the Wikipedia content itself is AI-generated, creating a feedback loop of potentially biased information, if left unchecked.
That concern seems overblown. Low-quality training materials can cause chatbots to produce questionable or downright harmful outputs. An obvious way to counter that would be to encourage the use of high-quality input that has undergone some kind of fact checking. Wikipedia is one of the best and largest sources of such material, and in hundreds of languages. Provided the final Wikipedia policy on LLMs requires human checks on chatbot output, as proposed in the draft, the use of Wikipedia articles for training LLMs should surely be encouraged with the aim of making chatbots better for everyone.
Follow me @glynmoody onMastodon.
Filed Under: chatbots, chatgpt, llms, wikipediaCompanies: openai
The rest is here:
Wikipedia Grapples With Chatbots: Should It Allow Their Use For ... - Techdirt
- Orphan articles: The 'dark matter' of Wikipedia - Tech Xplore - May 22nd, 2024 [May 22nd, 2024]
- Ethereum researcher alleges Wikipedia of biased Solana coverage - Crypto Briefing - May 22nd, 2024 [May 22nd, 2024]
- Link Rot and Digital Decay on Government, News and Other Webpages - Pew Research Center - May 22nd, 2024 [May 22nd, 2024]
- El Paso librarian takes love of knowledge to Wikipedia - El Paso Inc. - May 22nd, 2024 [May 22nd, 2024]
- Assassin's Creed Shadows 'critics' have started vandalising IRL protagonist Yasuke's Wiki page - GAMINGbible - May 22nd, 2024 [May 22nd, 2024]
- People Are Vandalizing the Wikipedia Page for Assassin's Creed Shadows Protagonist Yasuke - GameRant - May 22nd, 2024 [May 22nd, 2024]
- Assassin's Creed Shadows sparks Wikipedia edit war over Yasuke - Niche Gamer - May 22nd, 2024 [May 22nd, 2024]
- Made J. Cole look like he died in the war: Drake vs Kendrick Lamar Rap Battle Gets a World War 2 Styled Wikipedia ... - FandomWire - May 7th, 2024 [May 7th, 2024]
- Five Jokes from the First Season of The Simpsons You Now Need Wikipedia to Understand - Cracked.com - May 7th, 2024 [May 7th, 2024]
- Mastodon Play 'Wikipedia: Fact or Fiction?' - Loudwire - March 30th, 2024 [March 30th, 2024]
- Wolff contacted Verstappen to explain Wikipedia statement - GPblog - March 30th, 2024 [March 30th, 2024]
- Tulu Wikipedia more than doubles in size in seven years - The Hindu - March 30th, 2024 [March 30th, 2024]
- File:Tony Gwynn Hall of Fame exhibit.jpg - Wikipedia - Rethnea.gr - January 24th, 2024 [January 24th, 2024]
- George Washington Masonic Memorial photo honored in Wikipedia photo competition - ALXnow - January 22nd, 2024 [January 22nd, 2024]
- Ruwiki, the Russian Wikipedia to launch on Monday - New York Post - January 22nd, 2024 [January 22nd, 2024]
- In the War for Narratives Iran's Regime Takes to Wikipedia - NCRI - National Council of Resistance of Iran (NCRI) - January 22nd, 2024 [January 22nd, 2024]
- We need to embrace AI, says Wikipedia's Jimmy Wales - CNBCAfrica.com - January 22nd, 2024 [January 22nd, 2024]
- People are only just realising what the Wiki in Wikipedia actually means - The Mirror - January 22nd, 2024 [January 22nd, 2024]
- Kayla Braxton furious over wrong Wikipedia update, shares reaction - Sportskeeda - December 23rd, 2023 [December 23rd, 2023]
- Chicago Bears offensive coordinator Luke Getsy given hilarious nickname on Wikipedia page - On Tap Sports Net - December 23rd, 2023 [December 23rd, 2023]
- Is Wikipedia struggling to maintain neutrality in times of political unrest? - The Spectator Australia - December 23rd, 2023 [December 23rd, 2023]
- Top 25: Here are the most-read Wikipedia articles of the year - NewsNation Now - December 23rd, 2023 [December 23rd, 2023]
- India's Jawan, Pathaan, IPL among Wikipedia's most read articles; ChatGPT tops the chart! Here's the full list | Mint - Mint - December 23rd, 2023 [December 23rd, 2023]
- Victoria Atkins' Wikipedia page edited after 'doctors in training' remark - indy100 - December 23rd, 2023 [December 23rd, 2023]
- Top 25: Here are the most-read Wikipedia articles of the year - KXAN.com - December 14th, 2023 [December 14th, 2023]
- Wikipedia, wrapped. From ChatGPT to Cricket World Cup, here are 2023's most-viewed articles on the internet's encyclopedia - WPVI-TV - December 14th, 2023 [December 14th, 2023]
- Why Wikipedia's highway editors took the exit ramp. - Slate - December 14th, 2023 [December 14th, 2023]
- Wikipedia, wrapped. From ChatGPT to Cricket World Cup, here are 2023's most-viewed articles on the internet's encyclopedia - KGO-TV - December 14th, 2023 [December 14th, 2023]
- Wikipedia asks: Have you gotten $2.75 worth of info? Consider donating - The Ledger - December 14th, 2023 [December 14th, 2023]
- Dive into the weird and wonderful Depths of Wikipedia - WBUR News - December 14th, 2023 [December 14th, 2023]
- ChatGPT, Taylor Swift: The top 25 most viewed Wikipedia pages of 2023 - USA TODAY - December 14th, 2023 [December 14th, 2023]
- The 25 Most Popular Wikipedia Pages of 2023 - Mentalfloss - December 14th, 2023 [December 14th, 2023]
- ChatGPT is Wikipedia's most-viewed article in 2023 - CoinGeek - December 14th, 2023 [December 14th, 2023]
- These are the most read entries on Wikipedia in 2023: atomic bombs and much more. - Softonic EN - December 14th, 2023 [December 14th, 2023]
- Oppenheimer and Matthew Perry rank as two of the most viewed Wikipedia pages in 2023 - Gamereactor UK - December 14th, 2023 [December 14th, 2023]
- Wikipedias Most-Viewed Articles of 2023 Revealed - Greek Reporter - December 14th, 2023 [December 14th, 2023]
- Watching the Napoleon Movie? Don't Forget to Read His Wikipedia Page. - Slate - November 24th, 2023 [November 24th, 2023]
- Crowdsourced fact-checking fights misinformation in Taiwan ... - Cornell Chronicle - November 24th, 2023 [November 24th, 2023]
- The Sunday Read: 'Wikipedia's Moment of Truth' - The New York Times - September 11th, 2023 [September 11th, 2023]
- 'The more vibrant the society, the more actors seek to influence Wikipedia' - Ynetnews - September 11th, 2023 [September 11th, 2023]
- SOMEONE Keeps Editing Joshua Wright's Wikipedia Page To Downplay The Whole 'Sleeping With 1Ls' Thing - Above the Law - September 11th, 2023 [September 11th, 2023]
- Why Wikipedia is so imperative for public relations - PR Daily - September 11th, 2023 [September 11th, 2023]
- More Wikipedia taunts as Max Verstappen erases a Lewis Hamilton World title - Yahoo Eurosport UK - September 11th, 2023 [September 11th, 2023]
- Local Teacher Becomes First Malaysian To Win Wikimedian Award ... - The Rakyat Post - September 11th, 2023 [September 11th, 2023]
- Wikipedia's Moment of Truth - The New York Times - September 11th, 2023 [September 11th, 2023]
- The shocking truth about Wikipedias Holocaust disinformation - Forward - June 20th, 2023 [June 20th, 2023]
- New Mall-Based Minnesota Kohls Store Coming in 2024 | Joel ... - NewsBreak Original - June 20th, 2023 [June 20th, 2023]
- Open Access Makes Research More Widely Cited, Helping Spread ... - Techdirt - June 20th, 2023 [June 20th, 2023]
- Russia fines Wikipedia owner for failing to delete Azov battalion content - Ifax - Yahoo News - June 7th, 2023 [June 7th, 2023]
- Interviewing Jimmy Wales, Cofounder of Wikipedia - Reason - June 7th, 2023 [June 7th, 2023]
- Purple Speedy Boyfriend Wikipedia: Who Is Purplespeedy Dating? - PKBnews.in - June 7th, 2023 [June 7th, 2023]
- How Conflicts and Population Loss Led to the Rise of English ... - Political Science Now - May 29th, 2023 [May 29th, 2023]
- Research Article: Wikipedia and Open Access (preprint) - LJ INFOdocket - May 29th, 2023 [May 29th, 2023]
- Who Was Kuaron Harvey Cousin Paris Harvey? Wikipedia And Age - PKBnews.in - May 29th, 2023 [May 29th, 2023]
- Opinion | The Impossible Math of the Debt Deal's Detractors - The New York Times - May 29th, 2023 [May 29th, 2023]
- Stephen Joness deleted rugby 7s article leads to hilarious wikipedia update | RugbyDump - RugbyDump - May 20th, 2023 [May 20th, 2023]
- Bradley Dack is the kind of football hero that cannot be judged on a ... - Football365 - May 20th, 2023 [May 20th, 2023]
- Who is Roxy Horner? Jack Whitehall's Girlfriend Age, Wikipedia And ... - PKBnews.in - May 20th, 2023 [May 20th, 2023]
- The Unspeakable Death of the 'Almighty Dollar' - Resilience - May 20th, 2023 [May 20th, 2023]
- WikiBias: How Wikipedia erases fringe theories and enforces conformity - Minding The Campus - May 2nd, 2023 [May 2nd, 2023]
- Online Safety Bill age checks? We won't do 'em, says Wikipedia - The Register - May 2nd, 2023 [May 2nd, 2023]
- Russian court fines Wikipedia over Ukraine invasion article - Verdict - May 2nd, 2023 [May 2nd, 2023]
- Wikipedia names Howie Roseman 'master of all the draft' - Yardbarker - May 2nd, 2023 [May 2nd, 2023]
- Don't rely on sites like Wikipedia to write verdicts: Madras HC - Times of India - May 2nd, 2023 [May 2nd, 2023]
- Amazon, Bing, Wikipedia make EU's list of 'Very Large' platforms - The Register - May 2nd, 2023 [May 2nd, 2023]
- Who Is Patty Raynes? Net Worth 2023, Wikipedia And Age Details ... - PKBnews.in - May 2nd, 2023 [May 2nd, 2023]
- What After Xi Jinpings Overture to Zelensky? - IDN InDepthNews | Analysis That Matters - May 2nd, 2023 [May 2nd, 2023]
- New study rejects research suggestions that Wikipedia content shapes High Court judgments - The Irish Times - April 19th, 2023 [April 19th, 2023]
- The Wikipedia fight over Poland's role in the Holocaust sparks death threats against an Ottawa professor - The Canadian Jewish News - April 19th, 2023 [April 19th, 2023]
- Who were March's most newsworthy celebrities, according to the ... - KTVZ - April 19th, 2023 [April 19th, 2023]
- Twitter using Wikipedia to decide what is 'government-funded media' - Business Insider - April 13th, 2023 [April 13th, 2023]
- Practical Apps: Wikipedia Looking Smart To Go | Spotlight ... - highcountryshopper.com - April 13th, 2023 [April 13th, 2023]
- Rob Kearney receives Wikipedia edit after Joe Biden's All Blacks blunder - Rugby OnSlaught - April 13th, 2023 [April 13th, 2023]
- Editor's notes: Nut drivers - Bryan County News - April 13th, 2023 [April 13th, 2023]
- Top 5 Kart Games of the 90's - Twin Galaxies - April 13th, 2023 [April 13th, 2023]
- Things to do in the UAE this week: Ramadan shopping festival ... - The National - April 13th, 2023 [April 13th, 2023]
- Wikipedia had the wrong Vatican City flag for years. Now incorrect flags are everywhere - Catholic News Agency - April 11th, 2023 [April 11th, 2023]
- Texas ruling to ban abortion pills nationwide gets basic facts wrong: experts - Business Insider - April 11th, 2023 [April 11th, 2023]
- Hashtag Trending Apr.5th- Wikipedias new logo, $20 billion to revive Intel, Fake ransomware attacks - IT World Canada - April 11th, 2023 [April 11th, 2023]
- ChatGPT and GPT4: Wikipedia 2.0 or a fresh starting point for society? - IT-Online - April 11th, 2023 [April 11th, 2023]