Systematic framework for evaluating scholarly and research work based on the ScholarEval methodology. This skill should be used when assessing research papers, evaluating literature reviews, scoring research methodologies, analyzing scientific writing quality, or applying structured evaluation criteria to academic work. Provides comprehensive assessment across multiple dimensions including problem formulation, literature review, methodology, data collection, analysis, results interpretation, and scholarly writing quality.
View on GitHubkjgarza/marketplace-claude
scholarly-comms-researcher
plugins/scholarly-comms-researcher/skills/scholar-evaluation/SKILL.md
January 20, 2026
Select agents to install to:
npx add-skill https://github.com/kjgarza/marketplace-claude/blob/main/plugins/scholarly-comms-researcher/skills/scholar-evaluation/SKILL.md -a claude-code --skill scholar-evaluationInstallation paths:
.claude/skills/scholar-evaluation/# Scholar Evaluation ## Overview Apply the ScholarEval framework to systematically evaluate scholarly and research work. This skill provides structured evaluation methodology based on peer-reviewed research assessment criteria, enabling comprehensive analysis of academic papers, research proposals, literature reviews, and scholarly writing across multiple quality dimensions. ## When to Use This Skill Use this skill when: - Evaluating research papers for quality and rigor - Assessing literature review comprehensiveness and quality - Reviewing research methodology design - Scoring data analysis approaches - Evaluating scholarly writing and presentation - Providing structured feedback on academic work - Benchmarking research quality against established criteria ## Evaluation Workflow ### Step 1: Initial Assessment and Scope Definition Begin by identifying the type of scholarly work being evaluated and the evaluation scope: **Work Types:** - Full research paper (empirical, theoretical, or review) - Research proposal or protocol - Literature review (systematic, narrative, or scoping) - Thesis or dissertation chapter - Conference abstract or short paper **Evaluation Scope:** - Comprehensive (all dimensions) - Targeted (specific aspects like methodology or writing) - Comparative (benchmarking against other work) Ask the user to clarify if the scope is ambiguous. ### Step 2: Dimension-Based Evaluation Systematically evaluate the work across the ScholarEval dimensions. For each applicable dimension, assess quality, identify strengths and weaknesses, and provide scores where appropriate. Refer to `references/evaluation_framework.md` for detailed criteria and rubrics for each dimension. **Core Evaluation Dimensions:** 1. **Problem Formulation & Research Questions** - Clarity and specificity of research questions - Theoretical or practical significance - Feasibility and scope appropriateness - Novelty and contribution potential 2. **Literature Review