Professional Documents
Culture Documents
Responsibility and eligibility for PVAAS teacher-specific reporting is a determination made locally by the LEA. The LEA should consult its solicitor regarding any such determination because the application of PVAAS specific data has employment implications.
Act 82 Regulations:
http://www.pabulletin.com/secure/data/vol43/43-25/43_25_rr.pdf
Page 1 of 29
Table of Contents
Process and Requirements ........................................................................................................................... 4 PVAAS Roster Verification Defined ........................................................................................................... 4 Purpose of PVAAS Roster Verification ...................................................................................................... 4 Teacher Not Available to Roster ............................................................................................................... 4 Roster Verification for a Teacher of Two LEAs.......................................................................................... 4 Class Size and Roster Verification ............................................................................................................. 5 Charter Schools, Roster Verification and PVAAS Teacher Reporting........................................................ 5 Teacher Eligibility .......................................................................................................................................... 6 Attribution of Teachers for PVAAS Teacher-Specific Reporting ............................................................... 6 Teachers and Eligibility ............................................................................................................................. 6 Content-Specific Instruction ..................................................................................................................... 7 Keystone-related Courses ......................................................................................................................... 8 Types of Eligible Teachers ......................................................................................................................... 8 Teachers Providing Interventions ............................................................................................................. 9 Instructional Coaches.............................................................................................................................. 10 Grade 3 Teachers .................................................................................................................................... 10 Science Teachers of PSSA Grades 4 and 8 .............................................................................................. 10 Online/Technology Enhanced Instruction .............................................................................................. 11 Long Term Substitutes (LTS) ................................................................................................................... 13 Homebound Instructors .......................................................................................................................... 13 Teachers of PASA Students ..................................................................................................................... 14 Teachers of Reading/Writing in the Content Areas ................................................................................ 14 Teachers and Standards for Literacy in History/Social Sciences, Science and Technical Subjects ...... 15 Co-Teaching and Highly Qualified ........................................................................................................... 15 AP (Advanced Placement) and IB (International Baccalaureate) Teachers ............................................ 15 Intermediate Unit (IU) Teachers ............................................................................................................. 15 Career and Technical Education programs (CTEs) Teachers ................................................................... 15 Charter/Cyber Charter Teachers ............................................................................................................. 16 Teachers with One Section of Keystone Course ..................................................................................... 16 Teacher(s) for Reading and Literature Keystone Literature Exam ....................................................... 16 Teachers of Reading and English/Language Arts - PSSA ELA Assessment .............................................. 16 Teachers Providing Instruction in Multiple Schools or LEAs ................................................................... 17 Teachers in Multiple Schools within an LEA in a School Year ................................................................. 17 Teachers of Non-Public Students ............................................................................................................ 17 Instructional Responsibility......................................................................................................................... 18
PVAAS Statewide Team for PDE pdepvaas@iu13.org April 2014
Page 2 of 29
Percent of Instructional Responsibility Defined ..................................................................................... 18 Determining % of Instructional Responsibility........................................................................................ 18 Determining % Student + Teacher Enrollment ....................................................................................... 18 Full/Partial % of Instruction Defined....................................................................................................... 19 % Student + Teacher Enrollment - NOT Attendance ............................................................................. 19 Rationale for Enrollment Instead of Attendance .................................................................................... 19 Determining Full/Partial % of Instruction with Multiple Teachers ......................................................... 20 Minimum % Instructional Responsibility to Claim a Student ................................................................. 21 Over-claimed Students within a School/LEA .......................................................................................... 21 Over-claimed Students across LEAs/Districts ......................................................................................... 21 Special Education Teachers Claiming Students without IEPs ................................................................. 22 Student Teachers and/or Paraprofessionals........................................................................................... 22 Tutoring/Supplemental Instruction as Supplemental Contract.............................................................. 23 Impact of Change in Keystone Testing Windows.................................................................................... 23 Teacher Rosters .......................................................................................................................................... 24 Teacher of Keystone Course with Students in a PSSA-tested Grade ...................................................... 24 Rosters for Keystone-related Courses in Block Schedule ....................................................................... 24 Inclusion of Students from Various Program Types................................................................................ 25 APPENDIX: Scenarios for Instructional Responsibility ................................................................................ 27
Page 3 of 29
Page 4 of 29
a teacher completed roster verification with is their employed LEA(s). If a teacher completed roster verification at more than one LEA, they will receive value-added reporting from each LEA. If a teacher taught at multiple schools within the same LEA, they would still only get one report for each grade/subject/course for each school.
Page 5 of 29
Teacher Eligibility
Attribution of Teachers for PVAAS Teacher-Specific Reporting
Attribution of teachers does not follow the same rules as school attribution. Attribution of teachers for PVAAS teacher-specific reporting is about WHICH teacher(s) had the instructional responsibility for a student in a tested subject/grade, or Keystone-related course within the specific school year as identified by the LEA. This does not depend upon what school the students are from, the school in which the students tested, or upon how the teacher is funded. These teachers should be reported in the PIMS Course/HQT file and linked to the tested subject(s)/grade(s) or Keystone-related course(s), and the students of those subject(s)/grade(s) or Keystone-related course(s). Those teachers should have access to the PVAAS roster verification system and have rosters within that system. They will be responsible for verifying their rosters within the specified timeframes for PVAAS roster verification. Responsibility and eligibility for PVAAS teacher-specific reporting is a determination made locally by the LEA/district. The LEA/district should consult its solicitor regarding any such determination because the application of PVAAS specific data has employment implications.
Page 6 of 29
Act 82 does not speak to ONLY teachers instructing students who are at grade level. Act 82 does not include or exclude students at specific achievement levels - at, above, or below grade level.
Note: Pennsylvanias Alternate System of Assessment (PASA) is not included in PVAAS analyses as there are a very low number of students tested statewide. A significant number of students are needed for each grade level and subject to build a statistical model to yield valueadded measures for teachers from this assessment.
Content-Specific Instruction
Act 82 regulations include the following language: A professional or temporary professional employee who provides direct instruction to students related to a specific subject or grade level. This FAQ is intended to serve as a guide for LEAs as they determine eligibility and responsibility and make determinations as to which teachers are providing direct instruction to students. Responsibility and eligibility for PVAAS teacher-specific reporting is a determination made locally by the LEA. The LEA should consult its solicitor regarding any such determination because the application of PVAAS teacher-specific data has employment implications. For the purpose of PVAAS teacher-specific reporting, content-specific instruction may occur when a teacher has the responsibility to plan the instruction of the assessed eligible content, provide the instruction of the assessed eligible content, and use the assessment information to evaluate the effectiveness of the instruction of the assessed eligible content on a PA state assessment. Domains 1 and 3 from the Framework for Teaching may provide a guide for LEAs as they make this determination: Domain 1: Planning and Preparation o 1a- Demonstrating Knowledge of Content and Pedagogy o 1b- Demonstrating Knowledge of Students o 1c- Setting Instructional Outcomes o 1d- Demonstrating Knowledge of Resources o 1e- Designing Coherent Instruction o 1f- Designing Student Assessments Domain 3: Instruction o 3a- Communicating with Students o 3b- Using Questioning and Discussion Techniques o 3c- Engaging Students in Learning o 3d- Using Assessment in Instruction o 3e- Demonstrating Flexibility and Responsiveness Content-specific instruction is a determination made locally by the LEA.
Page 7 of 29
Keystone-related Courses
LEAs will identify each course, the final course before a student takes a Keystone exam (Algebra I, Literature, and Biology) as an end of course exam. Only the teacher(s) of the students enrolled in a Keystone-related course will be eligible for a PVAAS score. All students in a Keystone-related course are to take the end of course Keystone exam unless they were previously at least proficient on the Keystone exam. Keystone-related courses will be coded as a Keystone course in the PIMS Course/HQT file starting with the SY13-14 PIMS collections. These data will be used to prepopulate the PVAAS roster verification system. It is the teacher(s) of the students enrolled in that final Keystone-related course who are eligible to receive a PVAAS score. Example: For a sequence of courses such as Algebra I A, Algebra I B, and Algebra I C, Algebra I C is the course that will be identified as the Keystone-related course. In this example, teacher(s) of the students enrolled in Algebra I C are the only teacher(s) eligible for a PVAAS score. Are Keystone remediation courses considered Keystone courses? The question to ask as your LEA decides which courses are designated as Keystone-related courses is, are the students ALL receiving instruction on all of the Keystone eligible content again? (It is an LEA decision as to which courses are Keystone courses.) If the answer to the above question is yes, then that would be a Keystone-related course and the test score for those students would be included in PVAAS reporting. An example of this type of remediation course would be a re-take of the Keystone course but instruction is delivered differently in the remediation course. If the answer to the above question is no, then that would NOT be considered a Keystone-related course and students test scores would NOT be included in PVAAS reporting. However, those students test scores would count towards the banking of achievement scores for grade 11, where the best score to date would be used in the % Proficient/Advanced for the achievement portion of the School Performance Profile. An example of this type of remediation course would be one in which each student only receives instruction on the Keystone eligible content where the student needs improvement (the course is filling in the gaps).
Page 8 of 29
Responsibility and eligibility for PVAAS teacher-specific reporting is a determination made locally by the LEA. The LEA should consult its solicitor regarding any such determination because the application of PVAAS specific data has employment implications.
Page 9 of 29
Instructional Coaches
If the role of the instructional coach is only to provide support and consultation only to PA certified educator(s), this does not meet the criteria for PVAAS teacher-specific reporting. PVAAS teacher-specific reporting is provided to those who provide content-specific instruction to the students. (Framework for Teaching, Domains 1 and 3)
Grade 3 Teachers
Grade 3 teachers are not eligible for PVAAS teacher specific reporting. Grade 3 is included in the PIMS Course/HQT collection for HQT reporting purposes. However, there is no grade 3 PVAAS district, school, or teacher-specific reporting as grade 3 is the first time in which a state assessment is administered to students. Grade 3 teachers do not need to complete roster verification. For grade 3 in PIMS Course/HQT: LEAs can default the two percentages to 100%. LEAs only need to report the teacher of record for HQT purposes. LEAs do NOT need to report other teachers who share instruction with that teacher of record for those students receiving instruction on grade 3 PSSA standards/eligible content.
Page 10 of 29
The same approach is taken, for example, in sequences of courses for Algebra I; it is the final Keystone-related course that will be linked to students and a teacher to receive a PVAAS eligible score. For example, in a sequence of courses such as Algebra I A, Algebra I B, and Algebra I C, it is the Algebra I C course that will identified as the Keystone-related course. In this example, the teacher(s) of the students in Algebra I C are the only teacher(s) eligible for a PVAAS score. All teachers will have teacher specific data (fifteen percent (15%) teacher-specific data) as determined by the LEA as part of the overall teacher evaluation system. There are several options for teacher specific data for teachers in non-tested grades. These include (1) student performance on assessments (percent Proficient and Advanced); (2) valueadded assessment system data made available by the department under section 221 (must be at least 10%); (3) progress in meeting the goals of student individualized education plans required under the Individuals with Disabilities Education Act (Public Law 91-230, 20 U.S.C. 1400 et seq.); and (4) locally developed school district rubrics (electives/SLOs).
Page 11 of 29
Domain 1
Domain 1 Domain 1
Domain 1
Domain 1
Domain 3
Domain 3 Domain 3
3b- Using Questioning and Discussion Techniques 3c- Engaging Students in Learning 3d- Using Assessment in Instruction
Domain 3
Domain 3
Page 12 of 29
Homebound Instructors
When considering the inclusion of teachers in the PVAAS roster verification process/system and eligibility for a PVAAS score, the question to consider is, Who is/are the teacher(s) responsible for the content-specific instruction of the student? If the teacher who is responsible is in fact a temporary or permanent professional employee, then they would fall under Act 82 and would be eligible for participation in the PVAAS roster verification process if they also hold a valid PA teaching certificate and have full or partial responsibility for the content-specific instruction of the assessed eligible content as assessed by the PSSA or Keystone exam. Based on the role of the instructor, LEAs will make this determination. Key questions: Is the homebound teacher the teacher of record/defined in PA as the primary instructor?
PVAAS Statewide Team for PDE pdepvaas@iu13.org April 2014
Page 13 of 29
Is the homebound teacher the only instructor with the responsibility for the content-specific instruction of the student (Domains 1 & 3)? Is this work within the scope of the teachers employment? Or, is the work completed under a supplemental contract? For the situation where an employee also holds a supplemental contract, the LEA determines if the supplemental work is reflected in the teachers evaluation. "Homebound Instruction" is the instruction a district or charter school may provide when a student has been excused from compulsory attendance under 22 Pa. Code 11.25 due to temporary mental or physical illness or other urgent reasons. (PDE BEC Instruction Conducted in the Home) "Instruction conducted in the home" is included in the definition of special education located in the federal regulations (34 CFR 300.39(a)(i)) and is recognized as a placement option on the continuum of alternative placements for students with disabilities (34 CFR 300.115). The use of instruction conducted in the home is restricted to students whose needs require full-time special education services and programs outside the school setting for the entire day. Ordinarily, these will be students who, because of a severe medical condition or mobility impairment, are unable to leave home to attend school. (PDE BEC Instruction Conducted in the Home)
Page 14 of 29
Teachers and Standards for Literacy in History/Social Sciences, Science and Technical Subjects
The PA Core Standards includes Standards for Literacy in History/Social Sciences, Science and technical Subjects. The Standards for Literacy in History/Social Sciences, Science, and Technical Subjects are not assessed on the PSSA and/or the Keystone exams. PVAAS teacher-specific reporting is aligned to those teachers providing content-specific instruction of the assessed eligible content on PSSA and Keystone exams.
Page 15 of 29
Page 16 of 29
o This is a local LEA decision as to how the 100% of a students instruction is shared between the multiple teachers who are providing instruction; it is the LEA and teachers who know how the instructional responsibility is actually shared amongst multiple teachers.
Page 17 of 29
Instructional Responsibility
Percent of Instructional Responsibility Defined
The Percent of Instructional Responsibility represents the amount that each student will be weighted in the value-added analyses for PVAAS teacher-specific reporting. PVAAS teacher-specific reporting should fairly represent the proportion of instructional responsibility for each student with each teacher for each tested subject/grade/course. This proportion may vary by student. Students with less than 100% instructional responsibility are weighted less than those with 100% instructional responsibility.
Page 18 of 29
Total # Days for Course/Subject/Grade Number of days for a course/subject/grade, from Day One of the subject/grade/course up to and including the last school day before the LEAs testing window opens in that subject/grade/course. o Does NOT include days when all students are not in school: Holidays Student-Parent-Teacher Conferences Professional Development Days Weather-related closings
Page 19 of 29
Teacher-specific strategies include areas such as high expectations, relevant/meaningful/engaging instruction, relationship building with students, mentoring, parent communication, group and individual incentive programs, and continuity of instruction (teacher attendance). Students can be dropped/un-enrolled from a subject/grade/course based on LEA policy.
Page 20 of 29
It is important to remember that the Full or Partial % of Instruction may and can vary for each student. Hence, it is vital that teachers and administrators work together to decide how the Full or Partial % of Instruction is shared for a student as a student cannot be claimed for more than 100%. In any case where instruction is shared amongst multiple teachers, only ONE of the teachers in the subject/grade/course needs to be Highly Qualified for HQT reporting purposes. Teachers do NOT have to be Highly Qualified in order to share in the Full or Partial % of Instruction for a student for PVAAS teacher-specific reporting.
Page 21 of 29
equals 100% for the student. For example, if Teacher A in LEA #1 claims a student for 75% of the 5th grade PSSA math instruction and Teacher B in LEA #2 claims the same student for 50% of the 5th grade PSSA math instruction, then Teacher A's claim is re-allocated to 60% (75/125) and Teacher B's claim is re-allocated to 40% (50/125).
Page 22 of 29
Page 23 of 29
o Reminder: If the School Admin wants to give teachers more time, s/he can send the rosters back to the teacher during the two week School Admin Verification window. Neither PVAAS nor PIMS can make the changes for LEAs as each LEAs testing window(s) are different. For example, LEAs start school on different days, start semesters on different days, have different calendars overall, and have different testing windows. PVAAS teacher-specific reporting does EXCLUDE students from PVAAS analyses if the overall percentage of Instructional Responsibility is less than 10%. Some LEAs are using their Student Information System to generate reports with the new % Student + Teacher Enrollments based on changes in testing windows. They are giving these reports to administrators AND teachers so they can have them on hand when they verify or make changes to these percentages. The way your LEA needs to adjust for the changes in testing windows will depend on what Student Information System (SIS) you use and how much the LEAs Student Information System has re-aligned to PIMS state reporting needs in SY2013-14. Does your SIS have any reporting capabilities to provide reports regarding the % Student + Teacher Enrollment which could help as modifications are needed based on changes in testing windows? Or, is a staff member available who is good at pulling data from your SIS to obtain this information?
Teacher Rosters
Teacher of Keystone Course with Students in a PSSA-tested Grade
This kind of situation occurs when students are taking a PSSA along with a Keystone exam as they are enrolled in a Keystone-related course. In these situations, a teacher who taught students taking both the PSSA and the Keystone exams will need a roster for each. Most often, this kind of scenario occurs in middle schools where grade 8 students are enrolled in an Algebra I Keystone-related course. In this scenario, the middle school Math teacher who taught the 8th grade students in Algebra I would need two rosters: one for PSSA grade 8 Math and one for Keystone Algebra I. In this type of situation, grade 8 Math does NOT need to be taught as a separate course. There may, in fact, be occasional situations where the teacher has both 7th and 8th grade students (and possibly even earlier grade levels of students) in a Keystone Algebra I course. In this scenario, the teacher would need three rosters: one for PSSA grade 7 Math, one for PSSA grade 8 Math, and one for Keystone Algebra I. The teacher will receive PVAAS teacher-specific reporting for both the PSSA subject/grade area assessment(s) and the Keystone course.
Page 24 of 29
If a teacher is providing instruction in a semester-long course (versus a year-long course), it is important for that teacher to have the appropriate roster (Winter-tested roster versus Spring-tested roster) so that information is accurately captured on the semester in which a student is actually enrolled in a Keystone-related course and linked to the test score from the correct testing window. Consider these two different examples. 1. Teacher of Year-Long Biology Course Consider Teacher Jackson who teaches a year-long Biology course in his high school. Throughout the school year, Teacher Jackson teaches four periods of this year-long course. In this case, Teacher Jackson will need only ONE roster that will include students from all four periods who are concurrently enrolled with him at any point during the Spring tested Biology course. This roster will appear in the PVAAS roster verification system as Biology (Spring tested) as those students will test in the Spring testing window at the end of the year-long course. 2. Teacher of Two Semester-Long Biology Courses Consider Teacher Jones who teaches two semester-long Biology courses in her high school. Throughout semester 1, Teacher Jones teaches four periods of this semester-long course. Throughout semester 2, Teacher Jones teaches only two periods of the semester-long course. In this case, Teacher Jones needs TWO rosters as indicated below: o The first roster will appear in the PVAAS roster verification System as Biology (Winter-tested) and include all students from all four periods of the Semester 1 course who were concurrently enrolled with her at any point in the Semester 1 course and consequently tested in the Winter testing window at the end of the semester-long course. o The second roster will appear in the PVAAS roster verification System as Biology (Spring-tested) and include all students from the two periods of the Semester 2 course who were concurrently enrolled with her at any point in the Semester 2 course and consequently tested in the Spring testing window at the end of the semester-long course.
Page 25 of 29
If the students are in outside placements in private facilities WITH privately-employed teachers (BOTH must be true), then you do not need to report course data in PIMS. If the teachers of the students are IU teachers, the IU must report course data in PIMS. If the teachers are employed by private entities, you may use ID 9999999.
Page 26 of 29
Page 27 of 29
Page 28 of 29
Page 29 of 29