Compliance · Methodology

Scoring Methodology

How the AccessWiser Progress Marker Is Calculated

The exact arithmetic behind the progress marker in an AccessWiser scan, published in full — because a figure nobody can check is a figure nobody should trust.

Every automated accessibility tool prints a number, and almost none of them will tell you how the number was reached. That is the problem this page exists to fix. What follows is the whole method behind the progress marker in an AccessWiser scan — where it starts, what one finding costs, where it stops, and which findings are deliberately left out of the arithmetic — set out precisely enough that you can take your own findings list and reproduce the figure by hand.

We publish it for a plain commercial reason as much as an ethical one. Two automated tools pointed at the same page routinely disagree, sometimes wildly, because each one is applying its own private arithmetic to its own private severity labels. If another vendor told you eighty-five and we tell you twenty-two, you have no way to work out which of us is closer to the truth, and the honest answer is that neither figure is a measurement of anything external. Both are opinions with arithmetic attached. The only useful difference between them is whether the arithmetic is written down, and ours is written down here.

The thing to take from this page before any of the detail: the findings are the product, and the marker is a footnote to them. An AccessWiser report leads with counts of specific findings on specific elements, each of which a person can go and verify in a browser in under a minute. The marker is a small secondary figure for watching one site move over time. It is not a grade, it is not a compliance score, and it is not comparable between tools or between sites. Automated checks find only a subset of the barriers real people hit, so no figure derived from them — ours included — can stand in for testing with people and assistive technology.

  • A relative measure, not a verdict

    The marker exists to show one site moving as its team fixes things: scan, remediate, rescan, watch it climb. Nothing about it maps onto conformance, and comparing it against another tool's figure compares two different opinions.

  • One finding, one point

    Start at one hundred, subtract one for every finding that is a failure of a WCAG 2.2 AA success criterion, floor at zero. No severity weights and no per-rule cap, so you can reproduce the figure by counting rows in your own findings list.

  • Advice and review items cost nothing

    A finding is only deducted if it is a failure of something. Best-practice suggestions and checks that need a person to settle them are reported in full, in the list and in the counts, and priced at nothing.

  • No external standard defines it

    WCAG 2.2, Section 508 and EN 301 549 are pass-or-fail per success criterion and define no numeric marker at all. The arithmetic here is our judgement. So is every competitor's, whether or not they say so.

What the progress marker is for

The marker answers exactly one question: is this page better than it was last time? A team runs a scan, gets a list of findings, fixes some of them, and runs the scan again. If the work landed, the figure goes up. That is the entire job. It is a progress indicator for a single site against its own history, and it was built to be read in a series rather than on its own.

It is presented as "Progress marker (0-100)" with the range in the label and the figure standing alone underneath. That is deliberate and it is worth explaining, because it looks like a small formatting quirk and is not one. A number printed against a denominator, or as a percentage, reads instantly as a mark — the same shape as an exam result — and readers carry that reading straight into conversations about conformance where it does not belong. Putting the scale in the label keeps the range visible without ever rendering the figure as a fraction.

Everything else people want to do with a number like this, it is bad at. It cannot rank your site against a competitor's, because two pages with different templates, different element counts and different third-party embeds produce findings that are not on the same footing. It cannot be set as a contractual target, because a team optimising the figure will fix whatever is cheapest per point rather than whatever is worst for a person — and the section below on what this method costs makes that concern sharper, not softer. Used as intended, on one site, one template, a baseline and a rescan, it does a useful and modest job.

The formula, exactly as implemented

Here is the whole calculation, in the order the code performs it. It is short, and the shortness is the entire design goal.

  • Start at one hundred. The marker is a deduction from a clean page, not an accumulation towards one.
  • Subtract one point for each finding that is a failure of a WCAG 2.2 AA success criterion. One finding, one point. There are no severity weights: a finding labelled critical deducts exactly what a finding labelled minor deducts.
  • Deduct nothing for a finding that needs human review. Where a check cannot be decided automatically, the scan records it as an item for a person to settle, and it neither deducts nor credits. Counting an undecided item would mean deducting for our own uncertainty about your page.
  • Deduct nothing for a finding that is advice rather than a failure. Around thirty of the rules in axe-core — the open-source rules engine underneath our scans — are tagged best practice and name no success criterion at all, and our own rule pack marks its advisory rules the same way. They are reported in full, in the findings list and in the counts, and they cost nothing. The section after next explains what that fixed.
  • Floor the result at zero. A figure never goes negative, which is why a badly broken page and a catastrophically broken page can both read zero — a known limitation of any bounded scale, and the reason the findings list is the headline rather than the figure.
  • There is no sixth step. No per-rule cap, no severity multiplier, no adjustment for page size, no rounding, no floor other than zero and no ceiling other than one hundred.

How the report groups findings, and why that does not change the total

A report groups the deducted findings by rule, because that is how they get fixed: one rule is usually one change. The grouping is presentation, and it does not touch the arithmetic. Eighteen findings from a single rule and eighteen findings spread across eighteen rules both deduct the same eighteen points, and you can add up the rule groups or count the raw rows and land in the same place.

Every deducted finding still carries one of four impact labels — critical, serious, moderate, minor — and the report still prints it beside the rule. That label is what tells you which thing to fix first. It no longer changes the figure, and the section below is honest about what that trade cost.

A worked example you can check

Take a page with three distinct rule failures, plus two kinds of finding that get reported without being priced. A brand colour fails the contrast rule on eighteen elements, each finding labelled serious. Three form fields have no programmatic label, each finding labelled critical. One link has no accessible name, labelled minor. Alongside those, the scan reports twelve findings from the rule that wants every block of content inside a landmark — one of axe-core's best-practice rules — and two contrast checks it could not decide, because the text sits on a background image.

The deduction is eighteen plus three plus one, which is twenty-two, and the marker reads seventy-eight. The findings list has thirty-six rows in it: the twenty-two that were deducted, the twelve best-practice findings and the two review items. All thirty-six are in the report, in the counts and in the export. Fourteen of them moved the figure by nothing at all, and the page says so rather than quietly folding them in.

Notice how little there is to get wrong. The contrast rule dominates the deduction because it genuinely produced most of the failures, not because a weight decided it should, and one CSS change clears all eighteen at once.

You can run this yourself on any AccessWiser scan. Export the findings, set aside the rows marked as needing review and the rows marked best practice, count what is left, subtract that count from one hundred and floor at zero. There is no step you have to take on trust and no grouping you have to guess at. If you do not land on the figure we printed, that is a bug and we want to hear about it: a published method that cannot be reproduced from the output is not really published.

What counting costs, and why we made the trade

The marker used to be a weighted figure, and it stopped being one on the second of September, 2026. The retired model deducted ten for a critical finding, five for a serious one, two for a moderate and one for a minor, then capped each rule's total contribution at twenty so that one repeated problem could not consume the whole scale. It ranked severity correctly. We replaced it anyway, and the reason is the property that matters most on a page like this one.

It could not be reproduced from anything on screen. The report printed four severity totals beside a formula that works per rule, and the cap applied to a grouping the totals did not show — so a careful reader, capping the three severities in front of them, would arrive at fifty-six where the answer was twenty-two. The person who built it did exactly that. A figure a customer cannot check is a figure they are entitled to distrust, and publishing the method does not rescue a method the output will not let you apply.

Counting has a real cost, and we would rather print it than have you discover it. It treats every finding as equal, so it rewards volume over severity. On a real site we scanned, clearing a single contrast rule — one CSS change, eighteen findings — moved the marker by eighteen, while clearing a keyboard trap that appeared exactly once moved it by one. A team optimising this figure will fix the numerous thing before the blocking thing. That is a genuine defect in the marker as an incentive, it is the price of a figure anyone can reproduce, and it is the strongest argument on this page for reading the findings list rather than the number printed on top of it.

The severity is not lost, only unpriced. Every finding still carries its impact, the list still shows it, and the report still groups by rule with the impact beside each group. What changed is that the figure no longer encodes it, so the order you work in has to come from the list and from what a barrier does to a person.

Counting is also still sensitive to page length, and only partly cured of it. A longer page has more elements, so one template mistake repeated down it produces more findings and costs more points than the same mistake on a short page. That much is a real failure being counted more often, which we can defend. The next section is about the half of the problem that was not defensible.

One consequence of changing arithmetic, handled the same way every time: a scan that has already been issued is never re-scored. The figure a scan was given is the figure it keeps, so a history spanning a change of method shows a step rather than a smooth line. We would rather show you the step than quietly restate what an older scan found.

Advice is reported, and never deducted

The most recent change to this method, made on the ninth of September, 2026, was to stop deducting for findings that are not failures of anything. It deserves the space, because the bug it fixed made the marker actively misleading in a way no reweighting could have corrected.

Two kinds of finding are advice rather than conformance failures. The first is axe-core's own best-practice set: around thirty rules that the engine tags that way and gives no success-criterion tag at all — the rule that wants every block of content inside a landmark, the rule that wants heading levels in order, the rule that wants exactly one main landmark. They are good advice and worth acting on. axe does not claim they are WCAG failures, and neither will we. The second is our own rule pack, which has always been able to mark a rule as advisory so that a consumer can present it as advice; the marker was that consumer, and it charged a point regardless.

Here is what that cost, measured rather than argued. The landmark rule reports every top-level block of content sitting outside a landmark, so the number of findings it produces grows with the length of the document. A page whose only defect was a missing main element scored ninety-seven with one block of content, sixty-eight with thirty, and zero with one hundred. The same page with a main element added read ninety-nine at every length. Four lines of markup moved a page from zero to ninety-nine, and a long, carefully built page could come out below a short, broken one. In that band the marker was a function of page length, and it fell as a site published more.

No change to weights fixes a term that grows with the size of the document. The term had to stop being priced. Under the current model that same page reads one hundred at every length, and the landmark findings are all still there — a hundred and fifty-one of them on a page of a hundred and fifty blocks, listed, exported and fixable. Nothing was hidden and nothing was dropped from the report. What changed is that we stopped deducting for something we were not prepared to call a failure.

The test is the marking, not the absence of a citation. Treating "this finding names no success criterion" as the test would have been the tempting shortcut and it is the wrong one: a rule whose mapping was missing or broken would silently stop being priced, turning a mapping bug into a quiet under-report. A finding is treated as advice only when something that knows it is advice has said so.

This decision cuts against us commercially, and it is worth saying so plainly. It raises figures, and a higher figure is a weaker argument for buying remediation work. It is the right arithmetic anyway. A number that falls because a page got longer is not measuring accessibility, and deducting for a best-practice suggestion means asserting a conformance failure that the check itself never claimed — which is the one thing a tool in this category must not do.

The method follows no external standard, because none exists

This is the part most vendors leave out, so it goes here in plain words: there is no accessibility standard anywhere that defines a numeric marker, a severity weighting, or a threshold to clear. WCAG 2.2 is a set of success criteria, and each one is either satisfied or not satisfied for a given page — the standard has no arithmetic in it and offers no way to trade one criterion off against another. Section 508 incorporates WCAG by reference and works the same way. So does EN 301 549 in Europe. Conformance under all three is a per-criterion determination, most of which requires a person to make it.

So when any tool shows you a figure out of a hundred, that figure is the tool vendor's opinion about how to add up its own findings. Ours is our opinion. The arithmetic on this page was chosen by us — the starting figure, the cost of one finding, the choice to price advice and review items at nothing, the floor at zero — and every one of those could have been chosen differently by reasonable people. Nothing about them is derived from a standards body, and any tool implying otherwise is overstating what it has.

What we can honestly claim is the difference you are reading right now. Our opinion is published, versioned with the product, and reproducible from the output of any scan. If you disagree with a decision here, you can name which one and work out exactly what it does to your figure, because the inputs are rows you already have in front of you. That is not possible with a number whose method is private, and it is the only reason a figure like this deserves any trust at all.

One practical consequence for anyone comparing tools: if another product gave your home page a much higher number than ours did, neither of us has caught the other in an error. We have applied different arithmetic to different rule sets with different severity labels. The productive comparison is not between the two figures — it is between the two findings lists, item by item, on your actual page. Those you can check.

The one real external reference point: the WebAIM Million

There is exactly one outside anchor we consider legitimate to quote alongside a scan, and it is not a score of any kind. The WebAIM Million is an annual automated analysis of the home pages of the top one million websites, run by WebAIM at the Institute for Disability Research, Policy, and Practice at Utah State University. It has been repeated every year since 2019 with a consistent method, which is what makes it useful.

In the 2026 edition, the average home page carried 56.1 detectable errors, up from 51 the year before — the figure has risen in most years the study has run. The average home page contained 1,437 elements. Those two numbers together are the reason a raw finding count means something: they tell you what an ordinary page on the open web actually looks like when the same kind of automated detection is pointed at it.

So if your scan comes back with ninety findings, the useful sentence is not about a marker at all — it is that a typical home page has around fifty-six detectable errors and yours has more, and here they are, listed. That is a comparison against a published, repeated, independent measurement rather than against our own arithmetic. Source: WebAIM Million, webaim.org/projects/million/. We are not affiliated with WebAIM and quote the study with attribution.

One side effect of counting is worth noting here, because it makes that comparison easier to hold in your head. The marker and the deducted finding count are now the same statement rearranged: a page with ninety-two deducted findings reads eight. That is a pleasant coincidence rather than a design goal, and it is still not a reason to lead with the marker instead of the list.

WebAIM are careful about the same limitation we are, and it should be repeated here: their study detects errors automatically, which means it finds the machine-decidable subset. A page with no detectable errors is not therefore a usable page. The study measures what automated tooling can see, across a very large sample, consistently — no more than that, and no less.

What the marker cannot tell you

The limits below are not disclaimers bolted onto a good number. They are the actual boundaries of what this kind of arithmetic can do, and knowing them is what lets you use the figure well.

  • Whether your site conforms to WCAG 2.2 AA. Conformance is determined per success criterion, largely by people, and no figure on our reports is a conformance verdict. It is not a compliance score and we will not present it as one.
  • Whether a person can actually complete a task on your site. A page can produce very few automated findings and still be impossible to get through by keyboard, or announce nothing useful to a screen reader.
  • How badly any single barrier hurts. A single unlabelled field in a checkout can stop somebody completing a purchase entirely, and it deducts one point, exactly like every other finding on the page. The impact label beside it exists to tell you what to fix first. The arithmetic does not rank harm and does not try to.
  • Whether the length of your page is inflating the count. A genuine failure repeated by a template produces more findings on a long page than on a short one, and still costs a point each time. Compare a template against itself over time rather than against a page of a different size.
  • Whether your site is better than somebody else's. Different templates, page sizes and embedded third-party components make two figures incomparable even when both came from us.
  • Anything about your legal position. This is an engineering progress indicator, and it is not evidence of conformance, a certification, or a substitute for advice from a qualified professional about your obligations.
  • What the automated checks did not look for. Automated testing covers a subset of WCAG success criteria; the remainder — meaningful alternative text, sensible focus order, understandable error recovery, and much else — needs manual and assistive-technology testing. Every AccessWiser scan surface carries this coverage note, and this page is not an exception to it.

How to use it well

Treat the marker as an internal instrument. Set a baseline on the templates that matter — home, a category page, a product or booking page, checkout — and rescan the same URLs after each round of remediation. Movement on your own baseline is meaningful. A single reading on its own is close to meaningless, and a reading from a different tool is a different instrument entirely.

Read it beside the findings list, never alone. The figure can move for reasons that have nothing to do with your remediation work: a new promotional banner, a third-party embed updating itself, a marketing page gaining a carousel. When the number changes, the findings list tells you which of those it was.

Order your work from the impact labels, not from the arithmetic. Because every finding costs the same point, the cheapest way to move the figure is to clear whichever rule fired most often, and that is very often not the thing standing between a person and your checkout. The list is sorted so you do not have to make that mistake.

When you report progress upward or outward, report the findings. "We closed the eleven distinct rule failures our scans found on checkout, and here is the dated record of when each was fixed" is a true, checkable statement about work performed. The marker is a reasonable footnote to that sentence and a poor replacement for it, which is the same order of priority the reports themselves use.

Frequently asked questions

Another tool gave my site a much higher number. Which one is right?

Neither, in the sense you mean, because neither figure is a measurement of an external quantity. Each tool applies its own arithmetic to its own rule set and its own severity labels, and no standard defines what the right arithmetic would be. The comparison worth making is between the two findings lists rather than the two figures: open both, take the specific items each one reports, and check them on your page. Findings are verifiable; the arithmetic on top of them is opinion, and ours is on this page so you can see precisely what our opinion is.

Does the progress marker tell me whether my site conforms to WCAG 2.2 AA?

No. Conformance under WCAG 2.2 is decided success criterion by success criterion, and most of those criteria cannot be decided by software at all — whether alternative text is meaningful, whether focus order is logical, whether an error message is understandable. The marker is a progress indicator built from the machine-decidable subset. A high figure means the automated checks found relatively little; it does not mean a person using a screen reader or a keyboard can get through your site, and nothing in our reporting will say that it does.

Why does a finding labelled critical cost the same as one labelled minor?

Because pricing severity cost more than it bought. The retired model did rank severity — ten for a critical finding down to one for a minor, with each rule's contribution capped at twenty — and the figure it produced could not be reproduced from anything on the report, which is the property we care about most. Counting is the trade: every finding costs one point, anyone can check the total by counting rows, and the ranking moved to where it is useful. Every finding still carries its impact label and the list still shows it. The order you fix things in should come from that label and from what the barrier does to a person, never from what it does to the figure. We are aware that this rewards volume over severity, and it is stated on this page rather than left for you to find.

Why do findings that need human review contribute nothing?

Because deducting for them would mean deducting for our own uncertainty rather than for a defect on your page. Some checks cannot be decided automatically — a rules engine can see that an image has alternative text but not whether the text describes the image. Those are surfaced as review items so a person can settle them, and they stay out of the arithmetic. If they were counted, the figure would move whenever a page became more ambiguous to a machine, which is not the same thing as becoming less accessible.

Why do best-practice findings not deduct anything either?

Because they are not failures of anything. Around thirty rules in axe-core are tagged best practice and name no success criterion at all, and our own rule pack marks its advisory rules the same way. Deducting for them would mean asserting a conformance failure that the check itself never claimed. There was a concrete bug behind the change as well: the rule that wants every block of content inside a landmark fires once per block, so the marker fell as a page grew — a page whose only defect was a missing main element read ninety-seven with one block of content and zero with a hundred, while the same page with a main element read ninety-nine at any length. Every one of these findings is still reported, still exported and still worth fixing. None of them is deducted.

Can I put this figure in a report to a customer, a partner, or a regulator?

You can present it honestly for what it is — a record of your own site's automated findings moving over time — and it is genuinely useful evidence of ongoing effort when it is shown beside the dated findings and remediation record. What it is not is evidence of conformance, and it should never be presented as a certification or a pass mark. Pair it with the findings list, the dates, and the coverage note stating that automated checks find only a subset of barriers, and it supports your documentation rather than overstating it.

Does the method ever change?

It does, and when it does this page changes with it, because a published method that silently drifts is worse than one that was never published. It has changed twice recently and both changes are described above rather than buried: the weighted model was replaced by counting on the second of September, 2026, and advisory findings stopped being deducted on the ninth. Figures from either side of a change are not directly comparable, and scans that have already been issued are not re-scored — an older scan keeps the figure it was given, and a history spanning a change shows a step rather than a smooth line. This is also the reason we would rather you anchor progress conversations to counts of findings, which do not depend on any of these decisions at all.

This article is provided for general information about accessibility regulations and standards. It is not legal advice — consult a qualified professional about your specific compliance obligations.

Find and fix real barriers

AccessWiser helps you find, fix, and monitor accessibility issues relevant to Scoring Methodology — as part of your broader compliance program.

Start 7-day Free Trial