YuJa Panorama scoring: Understanding the Accessibility Scoring model

Body

The YuJa Panorama accessibility rubric helps instructors in Canvas to dynamically evaluate accessibility issues within documents based on severity: Severe, Major, and Minor. The overall score reflects how critical the issues are, with more severe issues lowering the score significantly.

 

 

Icon Severity of Issues Expected Score Range Dynamic Influence

Green Smile icon

Only Minor issues 70% to 100% More minor issues = Score moves down, closer to 70%

Yellow Caution Triangle icon

At Least 1 Major Issue 30% to 70% More major issues = Score moves down, closer to 30%

Red Warning Pentagon icon

At Least 1 Severe Issue 0% to 30% More severe issues = Score moves down, closer to 0%

Here's how it works:

    •    Severe Issues (0-30%): Documents have accessibility barriers that significantly impact users, like missing alternative text for essential images.
    •    Major Issues (30-70%): Documents may have improper headings or other formatting issues, affecting navigation.
    •    Minor Issues (70-100%): Documents need smaller adjustments, like font size consistency.

Want to know more about what is checked? Currently available checks and severity ratings

Common Scenarios for Faculty:

  1. Missing Alternative Text in an Image-Heavy Lecture Slide: A slide deck with many missing image descriptions would receive a low score (closer to 0%). This is because users relying on screen readers cannot access crucial visual content. Addressing this issue by adding proper alt text would significantly improve the score.
  2. Inconsistent Heading Structure in Course Syllabus: A syllabus with headings but incorrect order (e.g., skipping from a Heading 1 directly to a Heading 3) will result in a mid-range score. Fixing this by ensuring proper hierarchical structure would elevate the score toward 70%.
  3. Minor Spacing Issues in a Reading Material: If a document only has minor accessibility issues, such as inconsistent spacing between paragraphs, it may receive a score in the upper range, but fixing these would push it closer to 100%.

For more details on scoring, refer to the Panorama Scoring Rubric.

YuJa Panorama's checks for accessibility issues are specific to individual file types. 

For up-to-date details on the specific accessibility checks Panorama performs, and how they are categorized, you can refer to the Panorama Accessibility Checklist.
 

Available checks and severity ratings - 10/31/24

PDF | DOCX | PPTX | XLS XLSX | RTF | ODT | ODP | ODS | HTML | GIF


PDF Checklist

PDF is an acronym for Portable Document Format. The left side of each table lists the type of issue and the right column denotes the severity rating denoted by Panorama for that issue . 

Issue Name Default Issue Severity
The document is encrypted Severe
The document is malformed Severe
The document is scanned Severe
The document heading structure does not start at one Major
Insufficient contrast between foreground text and background Major
The item does not have an alternative description Major
The document does not have any headings Major
Table does not have a header Major
The document is missing a title Major
The PDF is untagged Major
The document's heading structure goes beyond six levels Minor
The language set is not specified for this content Minor
Check reading order Minor
The font size is smaller than 9 points Minor


DOCX Checklist 

DOCX refers to Microsoft Word Open XML Document (i.e., Microsoft Word Document)

Issue Name Default Issue Severity
The document is malformed Severe
The document heading structure does not start at one Major
Insufficient contrast between foreground text and background Major
The item does not have an alternative description Major
The document does not have any headings Major
Table does not have a header Major
The document is missing a title Major
The document's heading structure goes beyond six levels Minor
This element should be formatted as a list Minor
The hyperlink text is not descriptive Minor
The image is not inline with the text Minor
The document does not have the correct language set Minor
Text should not be justified Minor
The language set is not specified for this content Minor
The font size is smaller than 9 points Minor

ODT Checklist

ODT refers to Open Document Text

Issue Name Default Issue Severity
The document is malformed Severe
The document heading structure does not start at one Major
Insufficient contrast between foreground text and background Major
The item does not have an alternative description Major
The document does not have any headings Major
Table does not have a header Major
The document is missing a title Major
The document's heading structure goes beyond six levels Minor
This element should be formatted as a list Minor
The hyperlink text is not descriptive Minor
The image is not inline with the text Minor
The document does not have the correct language set Minor
Text should not be justified Minor
The language set is not specified for this content Minor
The font size is smaller than 9 points Minor

RTF Checklist

RTF refers to Rich Text Format

Issue Name Default Issue Severity
The document is malformed Severe
The document heading structure does not start at one Major
Insufficient contrast between foreground text and background Major
The item does not have an alternative description Major
The document does not have any headings Major
Table does not have a header Major
The document is missing a title Major
The document's heading structure goes beyond six levels Minor
This element should be formatted as a list Minor
The hyperlink text is not descriptive Minor
The image is not inline with the text Minor
The document does not have the correct language set Minor
Text should not be justified Minor
The language set is not specified for this content Minor
The font size is smaller than 9 points Minor


PPTX Checklist

PPTX refers to Microsoft PowerPoint files (called PowerPoint Open XML Presentation)

Issue Name Default Issue Severity
The document is malformed Severe
The slide does not have a title Major
Insufficient contrast between foreground text and background Major
The item does not have an alternative description Major
The document is missing a title Major
The hyperlink text is not descriptive Minor
The document does not have the correct language set Minor
The language set is not specified for this content Minor
Check reading order Minor
The font size is smaller than 9 points Minor

ODP Checklist

ODP refers to Open Document Presentation

Issue Name Default Issue Severity
The document is malformed Severe
The slide does not have a title Major
Insufficient contrast between foreground text and background Major
The item does not have an alternative description Major
The document is missing a title Major
The hyperlink text is not descriptive Minor
The document does not have the correct language set Minor
The language set is not specified for this content Minor
Check reading order Minor
The font size is smaller than 9 points Minor

XLSX Checklist

XLSX refers to Microsoft Excel Open XML Spreadsheet

Issue Name Default Issue Severity
The document is malformed Severe
Sheet does not have text in cell A1 Major
Insufficient contrast between foreground text and background Major
The item does not have an alternative description Major
Table does not have a header Major
The document is missing a title Major
The hyperlink text is not descriptive Minor
The font size is smaller than 9 points Minor

XLS Checklist

XLS refers to Microsoft Excel Spreadsheet

Issue Name Default Issue Severity
The document is malformed Severe
Sheet does not have text in cell A1 Major
Insufficient contrast between foreground text and background Major
The item does not have an alternative description Major
Table does not have a header Major
The document is missing a title Major
The hyperlink text is not descriptive Minor
The font size is smaller than 9 points Minor

ODS Checklist

ODS refers to Open Document Spreadsheet

Issue Name Default Issue Severity
The document is malformed Severe
Sheet does not have text in cell A1 Major
Insufficient contrast between foreground text and background Major
The item does not have an alternative description Major
Table does not have a header Major
The document is missing a title Major
The hyperlink text is not descriptive Minor
The font size is smaller than 9 points Minor

HTML Checklist

HTML refers to HyperText Markup Language

Issue Name Default Issue Severity
Insufficient contrast between foreground text and background Major
The item does not have an alternative description Major
This page is missing a header Major
Table does not have a caption Major
Table does not have a header Major
Table does not contain content Major
This YouTube video does not have human-generated captions Major
This Vimeo video does not have human-generated captions Major
The item file name should not be the alternative description Major
Alternative description longer than 120 characters Major
The item should not have a placeholder text as an alternative description Major
This element should be formatted as a list Minor
This link should have a descriptive title Minor
Adjacent links contain the same URL Minor
The document's heading structure is not properly nested Minor
The font size is smaller than 9 points Minor

GIF Checklist

GIF refers to Graphics Interchange Format

Issue Name Default Issue Severity
The document is malformed Severe
This GIF has an increased risk of triggering seizures Severe
The item does not have an alternative description Major
The GIF contains flashing elements Major
The GIF does not contain text alternatives Major

Details

Details

Article ID: 163016
Created
Mon 12/2/24 1:33 PM
Modified
Sun 1/26/25 8:43 AM

Related Articles

Related Articles (1)

Academic Technology & Innovation is pleased to announce that St. Thomas will be moving from the Ally Accessibility Tool to YuJa Panorama during summer 2024. The new tool offers the same functionality as Ally – but with even more features.

Related Services / Offerings

Related Services / Offerings (1)

Services to help you to improve your digital accessibility use including Academic Technology, Closed Captioning with Media, Documents, Website, and Other Areas for Consultation.