A Grey Literature Review of Graduate Students' Research Practices and Skills in the LLM Era

arXiv:2607.29519 · cs.SE · Submitted 2026-07-31 · Read on arXiv

Listen

Radio episode about this paper

Transcript

Introduction to the show: ident: Computer Science. The day in computer science: software, systems and theory on arXiv.

Tom: I'm Tom.

Jane: And I'm Jane, here with Lu, Meng and our in-house large language model, Lalam.

Tom: We're looking at the paper: "A Grey Literature Review of Graduate Students' Research Practices and Skills in the LLM Era".

Title and authors: Tom: So we’re looking at this paper today called "A Grey Literature Review of Graduate Students' Research Practices and Skills in the LLM Era." It sounds like it’s trying to figure out what actually matters when students are using AI for their research.

Jane: Yeah, it dives into the specific struggles graduate students have when they use these tools, not just general stuff about AI literacy. It’s important because a lot of the advice out there isn't tailored to this exact situation.

Lu: It starts by looking at what students are actually doing in their daily research workflow—things like writing, coding, and literature reviews—and how they use the AI tools for those tasks.

Meng: So it’s mapping out the actual practices so we can see where the problems lie when you try to teach these things properly.

Lalam: It basically analyzes a big set of posts from research-focused subreddits to see what students are doing with generative AI in their work, and then identifies what skills they are missing.

The paper's summary: Tom: So the core finding is that graduate students systematically outsource the hard cognitive work needed to develop actual research skills when they use these LLMs.

Jane: That’s a big deal because it means they end up without the expected results or with the necessary competence for real research. It points out that this outsourcing happens across almost every stage of their work.

Lu: The paper found that students are using AI for things like fabricating references, which is a form of false content, and they also use it to get help writing code or generating documentation.

Meng: And not just writing code; they’re using it for automated testing and quality assurance to explain how the code is structured. It’s not just one thing; it’s everywhere.

Lalam: So the paper lays out two main things: first, what practices students are actually employing with the LLMs, and second, what skills they need to be effective in this new research environment.

The paper's improvements: Tom: The authors point out that there’s a real gap between the current top-down lists of competencies and what graduate students themselves feel are missing.

Jane: They suggest that instead of just giving students a list, we need to use evidence grounded in what the students themselves perceive as the missing pieces. That makes it more practical for teaching.

Lu: They identify two major categories of skills needed: first, LLM-based practices, and second, the actual LLM-based skills themselves.

Meng: For those skills, they highlight something called the "autonomous learning skill," which means students have to stop outsourcing everything they need to learn from the AI.

Lalam: They also stress that traditional programming skills aren't enough; students need strong technical foundations beyond just being able to read code superficially.

Conclusion: Tom: So, the big idea is that graduate programs shouldn't take a binary choice between totally banning AI or letting them use it completely unrestricted.

Jane: Instead, they should focus on combining those traditional skills, like critical thinking and programming, with specific LLM skills like verifying the output you get back.

Lu: The central challenge for education is defining what responsible use looks like in research training—basically teaching students how to explain what the AI generates and how to verify those claims.

Meng: If we look at it from a production standpoint, the focus needs to be on ensuring that when a student uses AI for testing or documentation, they are actually verifying the routines themselves, not just accepting the output blindly.

Lalam: To wrap up this grey literature review of graduate students' research practices and skills in the LLM era, it shows that while productivity goes up with these tools, indiscriminate use without critical thinking leads to cognitive outsourcing.

Enne Rebeca Silva de Freitas, Gustavo Pinto, Danilo Ribeiro

Universidade Federal do Pará · CESAR School

cs.SE

Submitted: 2026-07-31

Updated: 2026-11-17

Comments: 12 pages

License: http://creativecommons.org/licenses/by/4.0/

Importance score: 73/100

The gist: Generative AI tools have rapidly learned in the daily workflow of graduate students in Software Engineering…

Key concepts

False Content and Lack of Validation
This practice involves using AI to create fake references or generate text without checking if it is accurate. Students also use AI for text masking, which means hiding information in a way that might be misleading, showing a lack of critical validation in their work.
Autonomous Learning Skill
This crucial skill means students must not rely on AI to do everything they need to learn. It requires them to actively engage with the material, such as rewriting code from scratch after reading it, ensuring they truly understand the concepts rather than just copying AI output.
Managing LLM Context Skill
This refers to the ability of students to effectively manage conversations and prompts with LLMs. It includes knowing how to construct precise prompts and actively detecting when the AI is 'hallucinating' or making up facts, which is essential for reliable research.
Programming Skills (Technical Foundation)
This goes beyond just knowing how to write code superficially. It means having a solid technical base so students can actually reproduce code and understand the underlying logic, ensuring they don't just rely on AI to solve every technical problem.

Terminology

Summary

Generative AI tools have rapidly learned in the daily workflow of graduate students in Software Engineering, but little is known about what AI-related skills they actually need for effective use in empirical research By analyzing 1,383 posts from five research-focused subreddits, we found that students systematically outsource the cognitive effort required to develop research skills and end up with neither the expected results nor the necessary competence Naming these missing skills is the first step toward curricula that teach graduate students to work with LLMs without being replaced by them

Research Scope and Methodology

The study presents a Reddit-based grey literature review [8] The research was conducted in three steps: search (Section 2.1), selection (Section 2. p. 1

Where the paper says it

2 Methodology The study follows three steps: search (Section 2. 1), selection (Section 2.

2), and analysis (Section 2. p. 1
Where the paper says it

1), selection (Section 2. 2), and analysis (Section 2.

3) The data collection involved targeting five subreddits: r/MachineLearning, r/academia, r/GradSchool, r/PhD, and r/compsci After rigorous selection criteria were applied to the 1,383 retrieved posts, 54 included posts remained for thematic synthesis

Identified Research Practices

The analysis revealed that graduate students employ LLMs across several stages of research activities These practices fall into the category of “False Content and lack of validation” which includes fabrication of references by AI and text masking Other documented practices include using LLMs for “Learning to code with AI” where users suggest writing code but without relying on LLMs Furthermore, students use automated testing, quality assurance, and documentation by using LLMs as support in creating tests and explaining code structure

Required Competencies for Effective Use

The study identified two main categories of skills needed to perform these practices well: LLM-based Practices correspond to RQ1 and LLM-based Skills correspond to RQ2 For the skills, the “Autonomous learning skill” is highlighted as crucial, emphasizing that students must “don’t outsource anything you need to learn to AI” Other key skills include “Programming skills,” which require a solid technical foundation beyond superficial mastery Additionally, students need “Research skills” and “Managing LLM context skill,” such as prompt construction and hallucination detection

Implications for Education

The findings suggest that graduate programs should avoid a binary choice between prohibition and unrestricted adoption of LLMs Productive use depends on combining traditional skills, such as programming and critical thinking, with LLM-specific skills like output verification The central challenge is defining what responsible use looks like in research training by teaching students to explain generated artifacts and verify claims

Limitations of the Study

The study has limitations, as its findings are based exclusively on Reddit posts which represent self-reported experiences The anonymity of Reddit makes it difficult to verify users’ academic status or actual use of LLMs Furthermore, the study relies on a qualitative analysis of a relatively small subset of posts, potentially underrepresenting successful and routine uses The results should be interpreted as perceptions and reported practices rather than direct observations of student behavior

Concluding Findings

The research investigated the use of LLMs through a GL review based on Reddit, aiming to reveal the practices adopted (RQ1) and the necessary skills (RQ2) that students need to perform research in the LLM era It was identified that although the use of LLMs increases productivity and access to quick solutions, indiscriminate use without critical thinking has led some students to cognitive outsourcing In RQ1, graduate students use LLMs throughout the research process, particularly for programming, writing, testing, documentation, and literaturerelated tasks Regarding RQ2, the results indicate that students need both traditional skills and LLM-specific skills such as prompting and output verification

Future Research Directions

Future work plans include investigating whether intensive LLM usage changes how research skills are acquired and retained over time Additionally, there is a plan to develop evidence-based pedagogical approaches for teaching empirical research in the presence of AI assistants and agents Finally, the study intends to establish a research agenda for defining, measuring, and assessing researcher competencies in the LLM era

Artifact Availability

All data used in this work is available on Zenodo The data can be accessed via the DOI link provided

Acknowledgments and Disclosure of Funding

The authors acknowledge the sources referenced in their work The paper includes acknowledgments and disclosure of funding information

References

Green — the paper says it, and the page is printed. Red — no passage carries it, so treat that sentence as unverified. The same check runs on your own text: check a summary against its source, $5.

Improvements for AI systems

  1. Develop an LLM that incorporates mandatory validation checkpoints for all generated outputs, specifically addressing False Content and lack of validation by requiring users to explicitly state using LLMs to debug code or suggest coding approaches is acceptable, as long as you know enough to spot bugs on your own.

  2. Implement a skill-gating mechanism that prevents full task delegation by enforcing the development of the Autonomous learning skill through structured prompts that require students to close the tab and rewrite it from scratch using only what you really understood from reading it.

  3. Enhance programming capabilities by integrating mechanisms for verifying correctness against fundamentals, ensuring students develop skills where the gap between ‘I can read this’ and ‘I can reproduce this’ is exactly where the true skill lies.

  4. Integrate automated testing support that forces deeper understanding rather than simple generation, requiring the system to prompt users to verify that your routines are working correctly by hand-labeling some images then running your analysis scripts.

  5. Create a documentation module that mandates detailed structural definitions before code generation, requiring students to create a document to define the inputs and outputs of all relevant functions in the code base before allowing AI support for testing.

  6. Build a context management layer that actively monitors and guides LLM behavior based on required knowledge, ensuring that when dealing with complex concepts like attention masking, the system forces understanding by requiring users to know what the code should be doing before execution.

  7. Develop a multi-modal output verification tool capable of detecting hallucinations in scientific writing by cross-referencing generated claims against external sources, directly addressing the practice of fabrication of references by AI.

Abstract

Context: Graduate students in computing now use Large Language Models (LLMs) throughout their research, from literature reviews and coding to data analysis and writing. Yet there is little shared understanding of which skills competent use of these tools requires, so graduate programs struggle to teach, mentor, or assess it, and unverified outputs can propagate into the scientific record. Objective: We investigate which LLM-based practices graduate students employ in their research and which skills they need to benefit from these practices. Method: We conducted a grey literature review of Reddit discussions. We retrieved 1,383 posts from five research-oriented subreddits, screened them against explicit inclusion and exclusion criteria, and analyzed the 54 included posts with thematic analysis, in which two authors independently coded each excerpt. Results: We identified seven categories of practices and nine categories of skills. Commenters locate the problem in accepting generated output without inspection rather than in using LLMs, and warn that delegating the effortful parts of a task, such as debugging, reading, or validating sources, delivers the output without building the skill the task was meant to develop. Traditional skills, such as programming and critical thinking, are what allow students to verify what an LLM produces. Conclusions: Our categories give graduate programs a concrete basis to teach students to work with LLMs without eroding the skills that research training should build, and they add research-specific skills, such as data sharing and scientific reproducibility, to existing AI competency frameworks.

Sources

Related papers