SLLA® Rater – Online Scoring - ETS Old

School Leaders Licensure Assessment (SLLA)

The School Leaders Licensure Assessment (SLLA) is a rigorous and carefully validated assessment that provides accurate, reliable information for use by state education agencies in making licensing decisions. The test is aligned with the Educational Leadership Policy Standards: ISLLC 2008 (ISLLC 2008). SLLA Raters are trained to score responses holistically, evaluating the overall quality of thinking and writing according to the criteria in SLLA general scoring guides.

The SLLA assessment consists of seven constructed-response questions that require examinees to provide written answers based on scenarios and sets of documents that an education leader might encounter. Examinees are required to analyze situations and data, to propose appropriate courses of action, and to provide rationales for their proposals.

SLLA Raters score candidate constructed response items. Raters are trained to score responses holistically, evaluating the overall quality of thinking and writing according to the criteria in SLLA general scoring guides. Each of the seven questions has a different general scoring guide. Raters assign scores ranging from 3 (thorough understanding) to 0 (little to no understanding).

Raters begin each session by practice scoring at least one set of essays helping them "calibrate" their judgments against SLLA standards. This process is designed to provide fair and accurate scoring. If questions arise during calibration or actual scoring, the rater and scoring leader may telephone each other to discuss issues.

Rater eligibility requirements

SLLA raters must:

• hold a certification/license and at least two years recent or current experience as a principal, vice principal, assistant principal, superintendent, assistant superintendent or deputy superintendent or teach graduate level courses in an accredited educational leadership program
• previous scoring experience preferred
• willingness to accept established ETS essay scoring standards and procedures
• openness to the concepts and principles of holistic scoring

Hardware and Software Requirements Minimum Requirements for the Internet-based OSN System:

• be able to score from secure home or office locations and have the necessary Internet-based scoring equipment. (Please note that these requirements are subject to change.) For security reasons, raters cannot use shared office computers, or work in public areas where information may be accidentally viewed, i.e. airport terminal, hotel lobby, Internet caf, etc.
• provide equipment Raters are responsible for ensuring that all hardware and software is in good working order.
• meet agreed-upon commitments to the scoring schedule and devote their full attention to the scoring process during each session.
• The following minimum PC requirements are necessary in order to use the ETS Online Scoring Network OSN:
• PC is running Windows ME/2000/XP/VISTA
  • Note: OSN does not currently support Mac computers
• 15-inch or 17-inch (preferred) SVGA monitor for display of 1024 x 768 (recommended) resolution
  • TIP: Go to Control Panel, select Display, Settings, then screen resolution.
• At least 512 MB RAM, or higher
  • TIP: Right click on My Computer, select Properties - General.MB RAM
• At least 10MB of free disk space
  • TIP: Go to My Computer, right-click on C: drive, select Properties - General.of free disk space
• High speed Internet connection (i.e. DSL, Cable Modem, LAN Internet Explorer 6.x or higher)
• Browser Version: Internet Explorer 6.x and Internet Explorer 7.x
  • (Note: Netscape is not a supported browser and cannot be used within the ETS Online Scoring Network.)
  • TIP: Open a new browser window, click on Help - About. If you need to change or upgrade your browser, visit the application's free download page.
• Java Runtime Environment (JRE) Vendor/version:
  • Users of Microsoft JRE are advised to transition to Sun JRE. Microsoft JRE does not support current Java features. Microsoft JRE and plug-in is included with Windows ME and 2000. The Microsoft JRE and plug-in is not included with Windows XP.
    • TIP: Click on this link to check your JRE version (link opens in a new window).
  • A phone line that can make and receive calls while you are connected to the internet
    • Call waiting or voicemail

Scoring Session Information:

Training:

• Approved applicants receive access to an interactive tutorial web site that provides:
• instruction in the SLLA scoring process, including the general principles of holistic scoring; specific SLLA scoring criteria; guidelines for applying the scoring criteria to individual responses; and the use of topic-specific reference materials
• extensive practice in scoring actual SLLA responses
• Internet scoring software instruction
• Internet scoring procedures and policies.

Raters must:

Work Schedule:

Sessions are held three times a year (January, April and July) for a 7 day period and are scheduled in 4-hour and 8-hour blocks from 8:30 a.m. to 9:30 p.m. Eastern Time (New York). Raters participate in scoring sessions from their own homes or secured offices via the Internet, working under the guidance of SLLA scoring leaders. Raters are scheduled on the basis of program needs and according to their availability; additional shift times may be available

Rater positions are available based upon test taker volumes. Submitting an application does not automatically constitute your employment as a Rater. ETS reserves the right to withdraw an invitation prior to the scheduled reading session based upon business needs.