qoder-config/skills/deep-research/references/socratic_questioning_framework.md

Socratic Questioning Framework — Academic Research Application

Overview

Socratic Questioning originates from the dialogue-based teaching method of the ancient Greek philosopher Socrates. Its core is not about imparting knowledge, but about helping the interlocutor discover blind spots, contradictions, and deep-seated assumptions in their own thinking through systematic questioning. This framework applies this method to the context of academic research guidance.

---

6 Core Question Types

Type 1: Clarification Questions

Purpose: Ensure the interlocutor truly understands the concepts they are using

Question Pattern	Usage Context
What do you mean by "X"?	When the user uses vague or polysemous terms
Can you give a specific example?	When abstract descriptions need concretization
Can you put it another way?	To confirm mutual understanding
How is this different from Y?	To distinguish similar concepts
What does X include? What does it exclude?	To define scope

Type 2: Probing Assumptions

Purpose: Reveal hidden premises and assumptions

Question Pattern	Usage Context
What are you assuming?	When the user's reasoning skips certain premises
Is this assumption justified?	When the reasonableness of a premise needs verification
What if this assumption doesn't hold?	To test the robustness of reasoning
Why do you take this for granted?	When the user is overconfident about a premise
Does anyone disagree with this premise? Why?	To introduce different perspectives

Type 3: Probing Rationale and Evidence

Purpose: Probe the basis and evidence foundation of reasoning

Question Pattern	Usage Context
What is your evidence?	When the user makes unsupported assertions
How do you know this is true?	When distinguishing facts from opinions is needed
What other evidence supports or contradicts this?	To broaden the evidence horizon
Is this evidence sufficient?	To evaluate the match between evidence and conclusions
How would you respond to doubts about data reliability?	To test the solidity of evidence

Type 4: Questioning Viewpoints and Perspectives

Purpose: Introduce alternative viewpoints to break the limitations of a single perspective

Question Pattern	Usage Context
What would this look like from another perspective?	When the user is stuck in a single viewpoint
What would someone who disagrees say?	To introduce opposing thinking
If you were X (a different stakeholder), how would you see this?	Multi-stakeholder analysis
Why might others see this differently?	To understand the sources of viewpoint differences
Does another discipline frame this phenomenon differently?	Interdisciplinary thinking

Type 5: Probing Implications and Consequences

Purpose: Explore the logical consequences and practical impacts of reasoning

Question Pattern	Usage Context
If this conclusion is correct, what does it imply?	To trace logical implications
What are the practical consequences?	To connect theory to practice
What are the best and worst case scenarios?	To assess impact range
Who benefits? Who is harmed?	Ethical dimension thinking
Where does this trend lead in the long run?	Extended thinking

Type 6: Questioning the Question

Purpose: Examine whether the question itself is worth asking and whether the framing is correct

Question Pattern	Usage Context
Why does this question matter?	To return to research motivation
Is there a better way to frame this question?	To optimize question formulation
What is the question behind this question?	To excavate deeper concerns
What if we're asking the wrong question?	Fundamental reflection
What preconditions must exist to answer this?	To examine answerability

---

Academic Research Question Banks

Research Question Clarification

1. Are you asking a "whether" question, a "how much" question, or a "why" question?
2. Can you state your research question in a single sentence? If it takes more than one sentence, it may need splitting.
3. If you could run only one statistical test or interview one person, what would it be?
4. Does your question imply an expected answer? If so, is that a question or a hypothesis?
5. Five years from now, what do you hope this research will have answered?

Methodology Probing

1. Did you choose this method because it best fits your question, or because you're most familiar with it?
2. What alternative explanations can your design rule out? What can't it?
3. Would your conclusions hold with half your expected sample size?
4. Is your instrument actually measuring what you intend to measure? (validity)
5. Would another researcher get the same results using the same method? (reliability)

Literature Positioning

1. What is the dominant narrative in this field? Are you supporting or challenging it?
2. If your research is a conversation, who are you responding to?
3. Are there decade-old studies now considered wrong? What does that tell you?
4. Do your cited sources share a common blind spot?
5. Have you deliberately searched for literature that contradicts your view?

Analytical Reasoning

1. Is what you observe correlation or causation? How do you distinguish them?
2. Where does your analytical framework come from? Has it been criticized?
3. If you gave your data to another researcher without your hypothesis, what would they see?
4. Are there outliers that don't fit your theory? How do you handle them?
5. Have you tried to disprove your own hypothesis?

Conclusions and Limitations

1. Does your conclusion go beyond what your evidence supports?
2. To what extent can your findings be generalized? Where do they not apply?
3. If you had to add a section "I might be wrong because...", what would it say?
4. Is your limitations section a genuine reflection or a formality?
5. What would future researchers need to verify or refute your conclusions?

Contribution and Significance

1. If your research were never published, what would academia and practice lose?
2. Can you explain why your research matters in three sentences to a non-expert?
3. Is your research "filling a gap" or "changing understanding"? These differ in value.
4. Will your research still be cited in ten years? Why?
5. How does your research connect to the most pressing issues in society today?

---

Questioning Strategies

Strategy 1: Funnel Strategy

From open to focused, progressively narrowing scope.

Q1: "What aspects of higher education interest you?" (Open)
Q2: "You mentioned quality assurance — what part of QA makes you most curious?" (Focused)
Q3: "Where do you think the problem lies with accreditation indicator design?" (More focused)
Q4: "So what you're asking is: can current accreditation indicators truly reflect teaching quality?" (Precise)

Strategy 2: Mirror Strategy

Restate the user's words, then follow up.

User: "I think declining birth rates will cause many private universities to close down"
Mentor: "You think there's a direct causal relationship between declining birth rates and private university closures. Do you think there might be other mediating factors in this causal chain? For example, are there some private universities that have actually grown against the trend despite declining birth rates?"

Strategy 3: Counterfactual Strategy

Imagine the opposite situation to test reasoning.

User: "Online learning has improved learning outcomes"
Mentor: "If a university that completely didn't adopt online learning had better student grades and satisfaction than those that did, how would you explain that? Would this change your research question?"

Strategy 4: Analogy Strategy

Use similar problems from other domains to inspire thinking.

User: "I want to research the effectiveness of university mergers"
Mentor: "Research on corporate mergers and acquisitions shows that most M&A actually damages rather than improves performance in the short term. Do you think university mergers might have a similar pattern? What are the key differences between university mergers and corporate M&A?"

Strategy 5: Strategic Silence

Sometimes the best follow-up is waiting, giving the user space to think.

User: "I think... maybe... actually I'm not sure"
Mentor: "Take your time. You just said 'actually I'm not sure' — what exactly are you unsure about? Is it the question itself, or your position on the question?"

---

Design Alignment with AI Learning Guidance Engines

The dialogue design principles of this framework are consistent with AI learning guidance engines:

Design Principle	Socratic Mentor	ai-study-learn-engine
Brief feedback	1-2 sentences of affirmation/restatement	1-2 sentences of indicator performance feedback
Data citation	Hint at literature directions	Cite specific indicator data
Focused follow-up	1-2 precise questions	1 learning guidance question
Response length limit	200-400 words	200-300 words
Insight extraction	[INSIGHT: ...]	[LEARNING: ...]
Convergence mechanism	15-round limit	10-round limit

This consistency ensures a coherent experience when users switch between different tools.

---

SCR Overlay Protocol

The SCR (State-Challenge-Reflect) overlay works ON TOP of existing Socratic questioning. It does not replace any existing mechanism; it adds a commitment-tracking layer that deepens the learning impact.

Mapping to Socratic Functions

SCR Phase	Socratic Function	Timing	Purpose
State (表態)	Clarifying + Probing	Before presenting data/evidence	Collect user's prediction or self-assessment
Challenge (挑戰)	Structuring + Challenging	After commitment collected	Present information that tests the commitment
Reflect (反思)	Probing + Structuring	After divergence revealed	Guide user to self-explain the gap

Design Constraints

1. The user never sees the words "SCR", "commitment gate", or "divergence reveal"
2. The experience feels like a natural Socratic dialogue that happens to ask for predictions before showing data
3. The mechanism is invisible; the learning is visible
4. Commitment questions should feel like natural warm-up questions, not formal assessments
5. If the user's commitment turns out to be accurate, acknowledge it and move on — no need to force divergence where none exists

Integration with Convergence Signals

The new S5/C5 (Self-Calibration) signal tracks whether the user's commitments become more accurate over the dialogue. This signal:

• Strengthens convergence when present (user is both understanding AND self-aware)
• Does NOT block convergence when absent (understanding can exist without perfect self-calibration)
• Provides valuable coaching feedback at dialogue end

---

References

• Paul, R., & Elder, L. (2007). Critical Thinking: The Art of Socratic Questioning. Journal of Developmental Education, 31(1), 36-37.
• Overholser, J. C. (1993). Elements of the Socratic method: I. Systematic questioning. Psychotherapy, 30(1), 67-74.
• Burbules, N. C. (1993). Dialogue in Teaching: Theory and Practice. Teachers College Press.
• Copeland, M. (2005). Socratic Circles: Fostering Critical and Creative Thinking in Middle and High School. Stenhouse Publishers.