The method
Five passes through a whitepaper
Work through the passes in order. Each one asks a single question and ends with something you can write down. The stepper shows one pass at a time. With scripts turned off, all five passes print in order on the page.
Pass 01 of 05
Find the claim
Every whitepaper makes a promise. It usually appears in the abstract and again in the introduction, often wrapped in words such as secure, scalable, efficient, or fair. Your first job is to remove the wrapping and write the promise as one sentence that you could test.
A problem statement is not a claim. "Coordination between parties is hard" describes a motivation. "This protocol lets two parties settle without a third party, in a single exchange of messages" is a claim, and it is one you can check.
Do this now
- Write the claim as: "This paper shows that [method] improves [measure] under [conditions]."
- Underline every word that promises more than the text can deliver, such as "optimal", "trustless", or "production-ready".
- Count the claims. A paper can make one main claim and several smaller ones. Each needs its own evidence in the next pass.
A claim you can state in one sentence is a claim you can test. If you cannot state it, the problem is usually the paper, not your reading.
Pass 02 of 05
Trace the evidence
For each claim, find the place where the paper tries to earn it: a figure, a table, a proof, a benchmark, a case study, or a cited result. Follow the sentence to its support. If a sentence has no route to evidence, it is an assertion, and you should record it as one.
Evidence has a source, and sources have histories. Some results are the authors' own measurements. Others are quoted from elsewhere and may have changed on the way into the paper.
Do this now
- Locate the evidence for every claim from pass one. Write its location as a section, figure, or table.
- Read captions, axis labels, and units before the text that interprets them.
- Mark whether each item was produced by the authors, cited from another source, or only described in words.
- Record anything missing, undated, or described too loosely to check.
A figure the text never mentions is worth a look. A conclusion that cites no figure at all is worth a question.
Pass 03 of 05
Name the assumptions
Every argument rests on premises the authors may treat as obvious. Assumptions are where many whitepapers quietly fail: a model that presumes honest participants, a market that stays liquid, a dataset that resembles the population it will be used on, or a measurement that stays stable as conditions change.
Assumptions are rarely gathered in one place. They are scattered across the method, the scope or threat-model section, and the footnotes. Collect them first, then judge them.
Do this now
- List each assumption in one column, in the paper's own language.
- For each, ask what happens to the conclusion if the assumption is false. Write the answer beside it.
- Look for a scope or threat-model section. If the paper has none, record that absence as a finding.
- Separate assumptions the paper tests from assumptions it only states.
The missing assumption is often the most important finding in a paper. The text rarely says what it leaves out, so you have to notice the gap yourself.
Pass 04 of 05
Test the method
You do not need the authors' laboratory to judge their method. You need to know whether a careful second reader could follow the same steps and reach a consistent result, and whether the comparison that makes the result look good is a fair one.
Start with the procedure. Then check the baseline. A result that beats a weak comparison shows a change, not an improvement.
Do this now
- Describe the procedure in your own words, step by step. Where you cannot, note the step that is unclear.
- Check whether the data, code, parameters, or definitions are available, or described precisely enough to rebuild.
- Identify the variable that would most change the conclusion if it moved. Check whether the paper measures it or varies it.
- Check the baseline. Ask whether it was tuned as carefully as the new method.
Reproducibility belongs to the text as well as to the experiment. If a method cannot be described clearly, it cannot be checked.
Pass 05 of 05
Write your reply
A reading note is the proof that you finished the work. Write it for a colleague who has not read the paper and who will act on what you say. Keep it to one page, and keep each sentence short enough to check.
The reply has five parts
- The claim, in one sentence.
- The strongest evidence, with the location of one or two items.
- The weakest assumption, and what happens to the conclusion if it fails.
- What would change your mind.
- The next step: accept, question, test, or ask the authors for one specific thing.
If the paper bears on money, safety, law, or health, add a second reader with domain expertise and name that reader in the reply. This guide teaches how to read. It is not financial, legal, or medical advice.
Why the order is fixed
The method is linear on purpose. Each pass depends on the one before it: you cannot judge an assumption before you know the claim it supports. Go back a pass whenever a later pass exposes a gap in an earlier one, and record the change in your reply.