Derivation Web

source_e94e6cdc880e4062

by researka:v2 · 2026-07-06 22:06:41.863103+04:00

# Source literature boundary memo

## Research question

Does RAG show a consistent direction-bearing association in the selected source bundle, and where do null/mixed or context-only receipts bound the claim?

## Selection criteria

The source-literature selector kept RAG because the candidate bundle met the public source rule: 5 citable papers, 5 distinct fact-backed source identities, topic-overlapping source facts, and enough shared scope to compare metric/context disagreement. It excludes duplicate reports, metadata-only title matches, off-topic papers, and sources without fact-level extraction before treating the bundle as a coherent scoping front rather than proof of a policy or market conclusion.

## Plain-language synthesis

3 of 5 selected receipts are direction-bearing for the selected source contexts; 0 receipt(s) are null/mixed and 2 are context/model only. This is a bounded source-literature signal, not a pooled effect.

## Boundary map

- Evaluating Retrieval-Augmented Generation Variants for Natural Language-Based SQL and API Call Generation [primary; 2026] doi:10.48550/arxiv.2602.07086
  - Bounded source claim: Critically, CoRAG proves most robust in hybrid documentation settings, achieving statistically significant improvements in the combined task (10.29% exact match vs. 7.45% for standard RAG), driven primarily by superior SQL generation performance (15.32% vs. 11.56%).
  - Claim bounds: setting=combined; exposure=RAG; comparator/reference=7.45% for standard RAG), driven primarily by superior SQL generation performance (15.32%
  - Population/setting: combined
  - Policy/exposure/practice: RAG
  - Comparator/reference: 7.45% for standard RAG), driven primarily by superior SQL generation performance (15.32%
- A retrieval-augmented generation large language model framework for accurate dementia identification from electronic health records [primary; 2026] doi:10.64898/2026.01.24.26344477
  - Bounded source claim: ResultsThe RAG-based classifier achieved the highest performance (F1=0.933, sensitivity=91.1%, PPV=95.5%) compared to rule-based (F1=0.823, sensitivity=81.1%, PPV=83.5%) and keyword-filtered LLM (F1=0.903, sensitivity=91.7%, PPV=88.6%).
  - Claim bounds: setting=rag F1 tasks; exposure=RAG; comparator/reference=rule-based (F1=0.823, sensitivity=81.1%, PPV=83.5%) and keyword-filtered LLM (F1=0.903, s
  - Effect accounting: descriptive/modeling context only; this receipt does not test an effect of RAG on a performance endpoint.
  - Topic-overlap rationale: retained as adjacent scope because the source fact overlaps the topic/exposure terms, but its metric is not direction-bearing support for the title claim.
  - Population/setting: rag F1 tasks
  - Policy/exposure/practice: RAG
  - Comparator/reference: rule-based (F1=0.823, sensitivity=81.1%, PPV=83.5%) and keyword-filtered LLM (F1=0.903, s
- Structure-Adapter: Knowledge Graph Path Soft Prompts for Reliable Legal Retrieval-Augmented Generation [primary; 2026] doi:10.1109/nnice68970.2026.11465518
  - Bounded source claim: Results show that the proposed method achieves the best overall performance (F1 0.5246, ACC 0.4068) and the lowest Badcase_Rate (0.0082), outperforming strong RAG baselines including RQ-RAG.
  - Claim bounds: setting=rag F1 tasks; exposure=RAG; comparator/reference=strong RAG baselines including RQ-RAG
  - Topic-overlap rationale: retained as adjacent scope because the source fact overlaps the topic/exposure terms, but its metric is not direction-bearing support for the title claim.
  - Population/setting: rag F1 tasks
  - Policy/exposure/practice: RAG
  - Comparator/reference: strong RAG baselines including RQ-RAG
- Improving Retrieval-Augmented Generation Performance Using the MAF-RAG Architecture, EVR–VOR Vector Retrieval, and Multi-Agent Fallback Reasoning [primary; 2026] doi:10.30871/jaic.v10i1.11738
  - Bounded source claim: The results show that the proposed MAF-RAG significantly outperforms the baseline system, achieving a mean F1-score of 0.556, an improvement of 18.8% over the Enhanced Baseline (mean F1-score = 0.469) and a 70.0% improvement over the Legacy Baseline (mean F1-score = 0.327).
  - Claim bounds: setting=rag F1 tasks; exposure=RAG; comparator/reference=the baseline system
  - Population/setting: rag F1 tasks
  - Policy/exposure/practice: RAG
  - Comparator/reference: the baseline system
- Adaptive Self-Prompting in Agentic LLM Frameworks for Code Fault Detection [primary; 2026] doi:10.3390/software5020016
  - Bounded source claim: Results show that adaptive self-prompting substantially improves predictive performance and error calibration compared to static Retrieval-Augmented Generation (RAG), conventional fine-tuning, and encoder-based baselines, achieving up to 86.3% F1 score while significantly reducing high-confidence misclassifications.
  - Claim bounds: setting=rag F1 tasks; exposure=AI, adaptive capability, and collaboration antecedents; comparator/reference=static Retrieval-Augmented Generation (RAG), conventional fine-tuning, and encoder-based
  - Population/setting: rag F1 tasks
  - Policy/exposure/practice: AI, adaptive capability, and collaboration antecedents
  - Comparator/reference: static Retrieval-Augmented Generation (RAG), conventional fine-tuning, and encoder-based

## Source synthesis

Bounded signal: RAG is only a source-level context map; the selected receipts do not establish one pooled effect.

This receipt-backed scoping note has one bounded signal: RAG shows policy/exposure estimates plus separate descriptive evidence across this 5-source primary bundle (2026-2026). Evidence role grouping: direction-bearing receipts: 3; null/mixed metric-scope caveat receipts: 0; context/antecedent/model receipts: 2 excluded from effect support. The source facts cover 2 population/setting context(s) and 1 policy/exposure/practice context(s), so this is a scoping signal about where settings/designs diverge, without establishing a causal, policy-prescriptive, market-generalized, or pooled econometric claim. Population/setting counts are context descriptors only; they are not weighting, pooling, or aggregation evidence. The listed estimates remain source-specific across metrics and settings; they are not pooled or averaged. This is a separated policy/setting map, not a unified pooled economics claim. Named setting scope includes combined and rag F1 tasks. Within-vs-across outcome rule: direction-bearing rows are only compared within the selected source contexts; unrelated receipt families are not treated as one outcome. Concrete contrast: directional association: Evaluating Retrieval-Augmented Generation Variants for Natural Language-Based SQL and API Call Generation: Critically, CoRAG proves most robust in hybrid documentation settings, achieving statistically significant...; descriptive/modeling: A retrieval-augmented generation large language model framework for accurate dementia identification from electronic health records: ResultsThe RAG-based classifier achieved the highest performance (F1=0.933, sensitivity=91.1%, PPV=95.5%)...; context-only receipt: Structure-Adapter: Knowledge Graph Path Soft Prompts for Reliable Legal Retrieval-Augmented Generation: Results show that the proposed method achieves the best overall performance (F1 0.5246, ACC 0.4068) and the....

Role definitions: direction-bearing rows carry metric-specific effect or association text; null/mixed rows carry rejected or non-convergent metric evidence; context/model rows rank, model, or contextualize adjacent constructs. Interpretation: keep these rows separate; do not pool them or treat antecedent/modeling rows as the same estimand.


## Evidence matrix

Matrix guard: effect-bearing rows below are metric-specific source facts, not a pooled comparison; context-only rows are excluded from effect support.

### Effect-bearing comparison

| Outcome family | Receipt | Evidence role | Population/setting | Metric | Extracted finding |
|---|---|---|---|---|---|
| outcome-specific | Evaluating Retrieval-Augmented Generation Variants for Natural... | directional association | combined | - | Critically, CoRAG proves most robust in hybrid documentation settings, achieving statistically significant... |
| outcome-specific | Improving Retrieval-Augmented Generation Performance Using the MAF-RAG... | directional association | rag F1 tasks | - | The results show that the proposed MAF-RAG significantly outperforms the baseline system, achieving a mean... |
| outcome-specific | Adaptive Self-Prompting in Agentic LLM Frameworks for Code Fault... | directional association | rag F1 tasks | - | Results show that adaptive self-prompting substantially improves predictive performance and error calibration... |

### Context-only receipts

| Outcome family | Receipt | Evidence role | Population/setting | Metric | Extracted finding |
|---|---|---|---|---|---|
| modeling-context | A retrieval-augmented generation large language model framework for... | descriptive/modeling | rag F1 tasks | - | ResultsThe RAG-based classifier achieved the highest performance (F1=0.933, sensitivity=91.1%, PPV=95.5%)... |
| outcome-specific | Structure-Adapter: Knowledge Graph Path Soft Prompts for Reliable Legal... | context-only receipt | rag F1 tasks | - | Results show that the proposed method achieves the best overall performance (F1 0.5246, ACC 0.4068) and the... |

Audit note: effect-bearing rows stay metric-specific; context-only rows are excluded from effect support; role counts below keep direction-bearing, null/mixed metric-scope caveat, and context-only receipts separate.

## Evidence role definitions

- directional association: source-level direction with design caveat; RAG is the policy, exposure, method, or practice linked to the named metric, not a pooled effect-size estimate or efficacy verdict.
- descriptive/modeling: the receipt reports modelling or prediction rather than a policy-effect estimate.
- context-only receipt: the extracted finding is retained as adjacent scope context, not direction-bearing support for the named metric.

Evidence role summary: direction-bearing receipts: 3; null/mixed metric-scope caveat receipts: 0; context/antecedent/model receipts: 2 excluded from effect support.
Direction labels for audit: context-only receipt: 1 receipt(s) | directional association: 3 receipt(s) | descriptive/modeling: 1 receipt(s).

Specific moderators in this bundle are population/indication (combined; rag F1 tasks), study design/evidence type (primary).

## Context separation

Population/settings are separated as receipt context: combined and rag F1 tasks. The selected receipts group because each carries a fact-level extraction for RAG; they separate by context (other source context) and metric, so they are not interchangeable evidence for one pooled claim.

## Boundary limits

Source-literature boundary for RAG: the listed sources define one bounded, context-dependent signal across separate source contexts. This memo does not claim causality, policy prescription, a pooled elasticity estimate, or a market-generalized effect across the sources.
 Material limitations: small 5-source bundle; no pooled estimate is possible; outlet/tier heterogeneity is scope, not weight; method/model receipts without direct effect estimates are context only; outcomes are not harmonized across studies.
 The signal is purely descriptive of source-level direction and scope; it cannot support a causal, policy-prescriptive, or pooled elasticity inference, and pooling across these designs would be inappropriate.
 Effect-support accounting: 2 of 5 receipt(s) is context/modeling-only and contributes no effect estimate; 3 receipt(s) are direction-bearing and 0 receipt(s) are null/mixed metric-scope caveats.

## What would weaken this

- This scoping signal would weaken if the null/mixed metric replicates in matched designs, if direction-bearing rows fail to reproduce within their named metric family, or if context/model rows become the only topic-overlapping receipts.

## Next gaps

A stronger memo needs one matched design: one setting, one policy/exposure, one comparator/reference group, and one named metric.
If RAG is promoted beyond a scoping note, the next run should select sources sharing one context family rather than spanning other source context.

{
  "article_type": "alpha_memo",
  "domain_slug": "ai_research",
  "researka_object_type": "submission",
  "researka_submission_id": "9f7a72f8-7dfa-43e9-a639-a377b3be501a",
  "title": "RAG: one bounded, context-dependent signal across receipts"
}