> ## Content Index > Fetch the complete content index at: https://www.lorcandempsey.net/llms.txt > Use this file to discover other available public pages before exploring further. # Hallucination and collections - URL: https://www.lorcandempsey.net/hallucination-and-collections/ - Published: 2023-05-13T19:05:34.000Z - Updated: 2023-11-12T08:12:58.000Z - Description: I asked HuggingChat about library collections. It is definitely hallucinating in its responses. - Author: Lorcan Dempsey - Tags: AI, Collections I realise that my thinking on library collections may not be as well formed as it could be, but really ...? 😉 When I experiment with Chatbot interfaces I tend to have some standard queries. I ask whether the concept of the Irish diaspora is a helpful one in the context of either British or US politics. I also ask about library collections, in particular about the three models I have been writing and speaking about in recent years: [*collective collections*](https://www.lorcandempsey.net/operationalizing-a-collective-collection/), the [*inside out collection*](https://www.lorcandempsey.net/collection-directions-accelerated/), and the [*facilitated collection*](https://www.lorcandempsey.net/the-facilitated-collection-redux-a-note-on-collections-as-a-service-the-university-of-california-and-elsevier/). These are the oddest results I have received from my chatbot experiments. Maybe they are having a day off? Maybe I missed a necessary configuration? Maybe my thoughts on library collections are completely incoherent? I was trying Hugging Chat and it was using the *OpenAssistant LLaMa 30B SFT 6* model. First off, what is the *collective collection*? ![](https://storage.ghost.io/c/77/c7/77c7bb74-1d53-4c6c-a1fc-8e2ccb21b6d2/content/images/2023/05/image.png) OK, so much for that. What about the *inside out collection*? ![](https://storage.ghost.io/c/77/c7/77c7bb74-1d53-4c6c-a1fc-8e2ccb21b6d2/content/images/2023/05/image-1.png) mmm ... OK, and the *facilitated collection*? ![](https://storage.ghost.io/c/77/c7/77c7bb74-1d53-4c6c-a1fc-8e2ccb21b6d2/content/images/2023/05/image-2.png) It is of course easy to poke fun. And other results with other models can be so impressive. I do not know what is going on here ... perhaps it is a temporary glitch. GPT-4 does somewhat better. First with a terse prompt. ![](https://storage.ghost.io/c/77/c7/77c7bb74-1d53-4c6c-a1fc-8e2ccb21b6d2/content/images/2023/05/image-4.png) A reminder that contra some expectations, GhatGPT is not a search engine. Then with some more guidance ... ![](https://storage.ghost.io/c/77/c7/77c7bb74-1d53-4c6c-a1fc-8e2ccb21b6d2/content/images/2023/05/image-5.png) This shows the importance of the prompt, giving a fuller answer than the first. Although this puts me in my place ... ![](https://storage.ghost.io/c/77/c7/77c7bb74-1d53-4c6c-a1fc-8e2ccb21b6d2/content/images/2023/05/image-6.png) It is interesting that it offers an interpretation based on the text itself. That said, Bard does 'know' more ... ![](https://storage.ghost.io/c/77/c7/77c7bb74-1d53-4c6c-a1fc-8e2ccb21b6d2/content/images/2023/05/image-8.png) And finally ... ![](https://storage.ghost.io/c/77/c7/77c7bb74-1d53-4c6c-a1fc-8e2ccb21b6d2/content/images/2023/05/image-7.png) I would not pose the *inside out collection* as competitive with the *acquired collection*, and I wonder is this partly influenced by somebody else writing about it. I haven't done a deeper dive to see what I can find out about what is going on here. I note that my website is not part of the Google C4 collection [analysed](https://www.washingtonpost.com/technology/interactive/2023/ai-chatbot-learning/?ref=lorcandempsey.net) by *The Washington Post*. **Added 16 May 2023\.** OpenAI has just expanded the capabilities of ChatGPT to include web browsing. This is an important step. Here is ChatGPT on the collective collection with web browsing switched on: ![](https://storage.ghost.io/c/77/c7/77c7bb74-1d53-4c6c-a1fc-8e2ccb21b6d2/content/images/2023/05/image-9.png) And here for the first time I actually get named. It is also interesting to see the three collecting modes mentioned, although maybe the second should be *collective collections*? ![](https://storage.ghost.io/c/77/c7/77c7bb74-1d53-4c6c-a1fc-8e2ccb21b6d2/content/images/2023/05/image-10.png) Also interesting to see a name-check here. This is an OK answer, but I was especially interested to see the last paragraph which I thought did a good job without directly copying anything I am aware of. ![](https://storage.ghost.io/c/77/c7/77c7bb74-1d53-4c6c-a1fc-8e2ccb21b6d2/content/images/2023/05/image-11.png) Incidentally, I was interested to come across this article by Leo Lo recently: [The CLEAR path: A framework for enhancing information literacy through prompt engineering](https://www.sciencedirect.com/science/article/abs/pii/S0099133323000599?ref=lorcandempsey.net). **Coda:** I had asked HuggingChat about the Irish diaspora in a previous question. The 'memory' of that may have been interfering.