How we test this tool

Will It Stick? tests your words before you send them. This page is how we test the tool itself, with every run printed.

The claim being tested

The question is narrow. Given the same words and the same job, does the panel's answer beat a plain AI answer? We run the test, print the runs, and let the spread show. One run is never a record.

The two sides

The panel side runs the production checker, the same tool visitors use, with its dated limitation line in place.

The plain AI side runs gpt-4o, a ChatGPT class model. It gets the same job in its prompt: name the core the reader keeps, score all six SUCCESs elements from 1 to 10 with reasons, name the weakest element, and give one fix as an instruction. It may not rewrite the words, and it may not add facts.

Both sides get the same ten messages. The ten are frozen in a test kit, so every run answers the same questions. The messages are sample texts, not visitor words.

The judging

Judges score the two answers blind. They see Answer A and Answer B, never which side wrote which, and the A and B order flips from case to case and run to run.

Each case gets two judge passes from gpt-4o-mini. When the two passes split, a gpt-4o adjudicator settles the case. Ties are counted as ties, never as wins.

The judges are models, not people. A benchmark judged by people, on many more messages, is the stronger test. It is planned and not yet run, so this page claims only what the model judged runs show.

The three runs, Nov 3, 2026

RunPanel wins, of 10Remembered core (panel / plain AI / tie)Usable fix (panel / plain AI / tie)
176 / 4 / 05 / 4 / 1
253 / 6 / 16 / 4 / 0
377 / 3 / 05 / 5 / 0

A win means the judges picked that side's full answer for the case: the core it named and the one fix it gave.

What the spread means

The same test, run three times, gave 7, 5, and 7. Run 2 was a coin flip. Scores are draws, and the spread across runs is itself the finding. That is why the homepage prints the spread, not a single best number.

What "applied" means in about half of runs

Every check result carries a dated line: in the Nov 3, 2026 measurements, the server applied the fix itself in about half of runs (18 of 36, then 19 of 36 on a repeat pass). Applied has a plain meaning here. After the panel names one fix, the server tries to apply that fix to the sender's own words, and two automated guards decide whether the result counts.

The length guard: the new text must stay between 0.4 and 1.6 times the length of the original words.

The correspondence guard: the change in the new text must be the change the fix named. A change the fix never called for fails, and so does a fix the new text never actually made.

When both guards pass, the result shows your words with the fix applied, plus a count of lines changed. When either guard fails, the result carries the fix as an instruction only, with a reason, and no rewritten text. The 36 runs were a fixed set of test inputs measured twice on Nov 3, 2026. The numbers describe that set on that day, not a promise about any single check.

Sources

The six scores use the SUCCESs checklist from Made to Stick, by Chip Heath and Dan Heath, backed by Tversky and Shafir (1992), Loewenstein (1994), and Paivio (1971). This tool is independent. The authors and the publisher did not endorse it, and we have no tie to them.

Check my words