Automated Tool Results

Last updated: 2 August 2016 by @dugboticus and @cfq

Pages being tested

Table of results for our access tools audit. The columns are the tools and the rows are the test cases we've used. There is a table for our analysis and breakdown after this table as well.
Test case WCAG Level Google Accessibility Developer Tools / AccessLint Tenon Wave HTML Code Sniffer aXE tanaguru sort site EIII AChecker Nu Html Checker
Plain Language is not used not found not found not found not found not found not found not found not found not found not found
Content is not organised into into well-defined groups or chunks, using headings, lists, and other visual mechanisms not found not found not found not found not found not found not found not found not found not found
First instance of abbreviation not expanded not found not found not found not found not found not found not found not found not found not found
Content identified by location not found not found not found not found not found not found not found not found not found not found
Content is not in correct reading order in source code not found not found not found not found not found not found not found not found not found not found
Wide page forces users to scroll horizontally not found not found not found not found not found not found not found not found not found not found
Color alone is used to convey content not found not found not found not found not found not found not found not found not found not found
Small text does not have a contrast ratio of at least 4.5:1 so does not meet AA AA error found not found error found not found error found error found not found not found not found not found
Large text does not have a contrast ratio of at least 3:1 so does not meet AA AA error found not found error found not found error found error found not found not found not found not found
Small text does not have a contrast ratio of at least 7:1 so does not meet AAA AAA error found not found error found not found error found error found not found not found not found not found
Large text does not have a contrast ratio of at least 4.5:1 so does not meet AAA AAA error found not found error found not found error found error found not found not found not found not found
Very small text found not found not found warning reported not found not found not found not found not found not found not found
Italics used on long sections of text not found not found not found not found not found not found not found not found not found not found
All caps text found not found not found not found not found not found not found not found not found not found not found
Justified text found not found error found warning reported not found not found not found not found not found not found not found
Inadequate line height used not found not found not found not found not found not found not found not found not found not found
Long lines of text not found not found not found not found not found not found not found not found not found not found
Blink element found not found error found error found error found error found error found error found error found error found not found
Marquee element found not found error found error found not found error found error found error found error found error found not found
html element is missing a lang attribute error found error found not found not found error found error found error found error found error found not found
html element has an empty lang attribute error found not found not found not found not found not found not found error found not found not found
html element has an invalid value in the lang attribute false positive not found not found not found error found error found error found error found error found not found
html element has lang attribute set to wrong language false positive not found not found not found not found error found not found not found not found not found
lang attribute not used to identify change of language not found not found not found not found not found error found not found not found not found not found
lang attribute used to identify change of language, but with invalid value not found not found not found not found error found not found not found not found error found error found
lang attribute used to identify change of language, but with wrong language not found not found not found not found not found error found not found not found not found not found
Text language changed without required change in direction not found error found not found not found not found not found not found not found not found not found
Missing page title error found error found not found not found error found error found error found error found error found not found
Empty page title error found error found not found not found not found not found not found error found not found not found
Inappropriate page title not found not found not found not found not found not found not found not found not found not found
Missing H1 not found not found not found not found not found error found error found not found not found not found
Headings not structured in a hierarchical manner not found not found warning reported warning reported not found error found not found not found error found not found
Empty heading not found error found error found error found error found error found error found error found error found error found
Text formatting used instead of an actual heading not found not found not found not found not found not found not found not found not found not found
List not marked up as a list not found not found not found error found not found not found not found not found not found not found
Improperly nested lists not found error found not found not found error found not found not found not found error found error found
LI element with no parent not found error found not found not found error found not found not found not found error found error found
DT or DD elements that are not contained within a DL element not found error found not found not found error found not found not found not found error found error found
Table is missing a caption not found not found not found warning reported not found allows manual inspection not found not found different error found not found
Table has an empty table header not found error found error found not found error found allows manual inspection not found not found different error found not found
Table has no scope attributes not found not found not found error found error found allows manual inspection not found not found error found not found
Table has no table headings error found error found different error found wrong error reported error found allows manual inspection error found not found different error found not found
Table that only has TH elements in it not found error found not found not found different error found not found not found not found warning reported not found
Table nested within table header not found error found not found not found different error found not found error found not found warning reported not found
Table used for layout different error found error found identified but not a error not found not found allows manual inspection error found not found not found not found
Image with no alt attribute error found error found error found error found error found error found error found error found error found error found
Image that conveys information has an empty alt attribute not found not found identified but not a error warning reported not found allows manual inspection not found not found warning reported not found
Image that conveys information has inappropriate alt text not found not found not found not found not found allows manual inspection not found not found warning reported not found
Image alt attribute contains image file name not found error found allows manual inspection not found not found allows manual inspection error found not found warning reported not found
Image with presentation role has non-empty alt not found error found identified but not a error not found not found allows manual inspection not found not found not found not found
Image has empty alt and non-empty title not found error found not found error found not found allows manual inspection error found not found not found not found
Image has alt and title that are different not found error found not found not found not found allows manual inspection not found not found not found not found
Background image that conveys information does not have a text alternative not found not found not found different error found not found not found not found not found not found not found
A distraction is present, an animated gif not found not found not found not found not found not found not found not found warning reported not found
Uninformative link text not found error found warning reported not found not found allows manual inspection error found not found warning reported not found
Non-specific link text error found error found warning reported not found not found error found error found not found warning reported not found
Link text does not make sense out of context error found not found not found not found not found allows manual inspection not found not found warning reported not found
Adjacent links going to the same destination not found not found warning reported different error found not found not found error found not found not found not found
Image link alt text repeats text in the link not found not found warning reported error found error found not found error found not found not found not found
Image link with no alternative text error found error found error found error found error found error found error found not found error found not found
Blank link text error found error found error found error found error found error found error found error found error found not found
Link contains only a full stop error found not found not found not found not found not found not found not found warning reported not found
Link with the same text go to different pages not found not found not found not found not found error found not found not found not found not found
Link text with identical title not found error found warning reported not found not found error found not found not found not found not found
Link launches new window with no warning not found not found not found warning reported not found allows manual inspection not found not found not found not found
Link not clearly identifiable and distinguishable from surrounding text not found not found not found not found not found not found not found false positive not found not found
Link to pdf does not include information on file format and file size not found not found warning reported not found not found error found different error found not found not found not found
Link to an image, no text alternative not found error found not found not found not found not found not found error found not found not found
Link to a multimedia file, no transcript not found not found warning reported not found not found not found not found not found warning reported not found
Links to a sound file, no transcript not found not found not found not found not found not found not found not found warning reported not found
Links not seperated by printable characters not found not found not found not found not found not found not found not found not found not found
Link to #, invalid hypertext reference not found error found not found not found not found not found not found not found not found not found
Link to javascript, invalid hypertext reference not found error found not found not found not found not found not found not found not found not found
Empty button error found error found error found warning reported error found different error found not found error found not found not found
Image button has no alt attribute error found error found error found error found error found error found error found error found error found error found
Empty alt attribute on image button not found error found error found error found error found error found error found error found different error found error found
Uninformative alt attribute value on image button not found error found allows manual inspection not found not found allows manual inspection not found not found warning reported not found
Fieldset without a legend not found not found warning reported error found not found error found different error found error found not found not found
Empty legend not found not found not found error found not found error found not found error found not found not found
Form element has no label error found error found error found error found error found error found error found error found error found not found
Empty label found not found error found not found not found error found not found error found error found error found not found
Placeholder no label error found error found error found not found error found error found error found not found error found not found
Non-unique field label found not found error found not found not found not found not found warning reported wrong error reported not found not found
Field hint not associated with input not found not found not found not found not found not found not found not found not found not found
Group of radio buttons not enclosed in a fieldset not found not found warning reported not found error found not found warning reported not found not found not found
Group of check boxes not enclosed in a fieldset not found not found warning reported not found error found not found not found not found not found not found
Navigation placement, display, or functionality changes from from page to page not found not found not found not found not found not found not found not found not found not found
Inadequately-sized clickable targets found not found not found not found not found not found not found warning reported not found not found not found
Keyboard focus is not indicated visually not found not found not found not found not found error found not found not found not found not found
Don't use the accesskey attribute not found error found identified but not a error not found not found not found not found false positive not found not found
Tabindex greater than 0 error found error found identified but not a error not found error found not found not found not found not found not found
Fake button is not keyboard accessible not found not found not found not found not found not found not found not found not found not found
Link with a role=button does not work with space bar not found different error found identified but not a error not found not found not found not found not found not found not found
Keyboard focus assigned to a non focusable element using tabindex=0 not found not found not found not found not found not found not found not found not found not found
Keyboard trap not found not found not found not found not found not found not found not found not found not found
iframe is missing a title attribute not found error found not found error found error found error found error found error found not found not found
iframe title attribute does not describes the content or purpose in the iframe not found error found not found not found not found allows manual inspection not found not found not found not found
Duplicate id not found error found not found error found error found not found error found error found error found error found
Start and close tags don't match not found not found not found not found not found not found error found not found error found error found
Empty paragraph not found error found not found not found not found not found not found not found not found not found
Deprecated color definition not found error found not found different error found not found error found error found not found error found not found
Deprecated font element not found error found not found warning reported not found error found error found not found error found error found
Deprecated center element not found error found not found warning reported not found error found error found not found error found error found
Spacer image found not found error found identified but not a error not found not found allows manual inspection not found not found not found not found
PRE element without CODE element inside it not found error found not found not found not found not found not found not found not found not found
Object not embedded accessibly - wmode parameter not set to window not found error found not found not found not found different error found different error found not found not found not found
display:none used to visually hide content when it should be available to screenreader not found not found not found not found not found error found not found not found not found not found
visibility:hidden used to visually hide content when it should be available to screenreader not found not found not found not found not found error found not found not found not found not found
Content is not readable and functional when text is increased not found not found not found not found not found not found not found not found not found not found
Non-decorative content inserted using CSS not found not found not found not found not found not found not found not found not found not found
display:table being used for layout not found not found not found not found not found not found not found not found not found not found
Focus not visible not found not found not found not found not found not found not found not found not found not found
Text language is in the wrong direction not found not found not found not found not found not found not found not found not found not found
Table with inconsistent numbers of columns in rows not found not found not found allows manual inspection not found not found not found not found not found not found
Table with some empty cells not found not found not found not found not found not found not found not found not found not found
Table with column headers and double row headers not found not found not found allows manual inspection not found not found error found not found error found not found
Image with partial text alternative not found not found not found not found not found allows manual inspection not found not found allows manual inspection not found
Embedded video file is missing text alternative not found not found not found not found not found allows manual inspection not found not found not found not found
Embedded audio file is missing text alternative not found not found not found not found different error found allows manual inspection not found not found not found not found
Flashing content doesn't have warning not found not found not found not found not found different error found not found not found not found not found
Identifying links by colour alone not found not found not found not found not found not found not found not found not found not found
Errors are not identified not found not found error found not found not found allows manual inspection not found not found warning reported not found
Errors identified by colour only not found not found not found not found not found not found not found not found warning reported not found
Errors identified with a poor colour contrast warning reported not found error found not found error found error found warning reported not found not found not found
Error messages - no suggestion for corrections given, eg. required format not found not found not found not found not found not found not found not found not found not found
Missing labels in checkboxes error found error found error found error found error found error found error found error found error found not found
Two unique labels, but identical for= attributes not found not found error found not found error found not found not found not found error found not found
Label element with for= attribute but not matching id= attribute of form control error found error found error found error found error found error found error found error found error found not found
Labels missing when they would look clumsy for some form controls not found error found error found error found error found not found not found error found error found not found
Left aligned form labels with too much white space not found not found not found not found not found not found not found not found warning reported not found
Form control that changes context without warning not found not found not found not found not found not found not found not found not found not found
Lightbox - focus is not retained within the lightbox not found not found not found not found not found not found not found not found not found not found
Lightbox - close button doesn't receive focus not found not found not found not found not found not found not found not found not found not found
Lightbox - focus is not moved immediately to lightbox not found not found not found not found not found not found not found not found not found not found
Lightbox - ESC key doesn't close the lightbox not found not found not found not found not found not found not found not found not found not found
Concertina items don't get keyboard focus not found not found not found not found not found not found not found not found not found not found
Focus order in wrong order not found not found not found not found not found not found not found not found not found not found
Dropdown navigation - only the top level items receive focus not found not found not found not found not found not found not found not found not found not found
Tooltips don't receive keyboard focus not found not found not found not found not found not found not found not found not found not found
Alert shows for a short time not found not found not found not found not found not found not found not found not found not found
Invalid ARIA role names error found not found not found not found error found not found error found not found not found error found
Article element used to mark-up an element that's not an article/blog post etc. not found not found not found not found not found not found not found not found not found not found
Page zoom - boxes that don't expand with the text not found not found not found not found not found not found not found not found not found not found

Summary of results

Analysis and breakdown of numbers from the previous table. The columns are tools and the rows are for the category of errors identified by that tool.
Error category Google Accessibility Developer Tools Tenon Wave HTML Code Sniffer aXE tanaguru sort site EIII AChecker Nu Html Checker
Not found 119 90 103 113 103 84 104 120 95 133
Error found 23 55 20 20 39 38 35 23 29 13
Allows manual inspection 0 0 2 2 0 21 0 0 1 0
Warning reported 1 0 13 7 0 0 4 0 16 0
Different error found 1 1 1 3 4 3 3 0 5 0
False positive 2 0 0 0 0 0 0 2 0 0
Identified but not an error 0 0 7 0 0 0 0 0 0 0
Wrong error reported 0 0 0 1 0 0 0 1 0 0