Further Explorations on the Use of Large Language Models for Thematic Analysis. Open-Ended Prompts, Better Terminologies and Thematic Maps

Paper · Source
Reading and SummarizationDomain Specialization in LLMs

There is a nascent area, where scholars are approaching thematic analysis (TA) using LLMs, following the six phases developed by BRAUN and CLARKE (2006). TA is a qualitative method of analysis where the researcher labels (codes) portions of data with relevant meaning and then organises these codes/labels into patterns (the themes). BRAUN and CLARKE stipulated that TA encompasses the following phases: 1. familiarisation with the data; 2. initial coding; 3. identification of themes; 4. revision of themes; 5. renaming and summarising of themes; and 6. write-up of the results.

Lines of inquiry this paper opens 24

Research framings built by reading the notes related to this paper — the questions it feeds into.

What limits language model accuracy in evaluating ideas? How should retrieval strategies adapt to multi-step reasoning demands? Why do abstract preferences outperform episodic memories in personalization? Can AI systems perform peer review as effectively as humans? How do hallucinated citations emerge in AI scholarly output? What human oversight must AI research systems have? How should human-AI contributions be measured, disclosed, and verified? Why do LLM research ideation systems generate novelty but lack diversity? How do educators verify student capability when AI can produce indistinguishable work? Do restrictions on reviewer LLM use actually shape peer review behavior?