1. How do you know that the after school program is increasing growth or perforamnce rather than the normal instruction the student is already obtaining in the classroom? is there a comparison plan being done against non extended day students? This was one of the key components of the Boston Teacher residency Program. This may already be covered during your data collection process mentioned in the second section. if so, you might further explain the comparison.  

2. How do you define growth or performance with standardized tests or classroom grades? What is meaningful and how do you attributie any growth to the after school program?

3. The teachrs that are involved in the survey may be biased if they are alos responsible for overseeing the program and are rewarded financially for doing so. I am wondering who, exactly, would be answering the survey. Teachers administering the program? classroom teachers that offer curriculum during the normal school day or both? Can you elimante bias or at least mitigate it.

4. also, is there a class of students that should be in the program, but arent ofered the services so that you can have a third set of students to comapre? This seems like a cruel method because educationaly or behaviorally challenged students wouldnt get the services that may be essentail to their growth, but you do capture more data as to the effevtiness of the program.

Finally, I thought your narrative was really good, well thought out and organized.    

Best of luck,

Brian

Data collection for question two will involve a comparison of student performance scores on a combination of standardized tests and benchmark assessments to analyze student growth. 

The collected quantitivative data will be analyzed to determine impact on growth of student quarterly grades, benchmark assessments, and standardized assessments. 

Data collection for question three will involve a teacher survey that will allow teachers to document any notes, suggestions, concerns for a student as well as the program. Qualitative data will be analyzed to determine teacaher opinion of the program impact on homework completion rates, and functional classroom behaviors. Teachers will complete the survey once per marking period.

2.  How will participation in the Extended Day Program impact student performance on standardized testing?

3.  How will participation in the Extended Day Program impact functional student performance in the classroom?

Ryan, thank you for sharing.  The Extended Day Program sounds like a great opportunity for students who are struggling.  I imagine that in order for programs like this to be renewed each year there must be data to show that it is effective.  Your evaluation plan sounds like it could provide that data.  Some feedback for your consideration is below and best of luck on the rest of this plan…

Overall Feedback...

·  In order for students to be considered as part of the sample, will they have to attend the program for any certain amount of time?  I’m just wondering if students who attend the program 25% of the time versus students who attend the program 100% of the time will be differentiated for in the sample or in the analysis.

·  You mention collecting qualitative data about teacher opinions but I don’t see this reflected in either evaluation question.

·  How will you analyze the standardized test data? 

o  Will you look for achievement results, growth results, or both?

o  Will you look at historical data?  If so, from how far back?

For the Teacher Survey, here are a few things to consider…

·  Rearrange the order of the choices so that the “Very Ineffective” is the lowest number.

·  Would all teachers view effectiveness in the same way?  One teacher might view an improvement completion rate of 10% “Ineffective” while another would view it as “Effective.”  Maybe consider providing some guidelines with ranges. 

·  The survey asks about classroom participation and behavior but the evaluation question focuses solely on students’ quarterly grades.  If you want to evaluate the impact the program has on attitudinal/behavioral issues, you may consider adding an evaluation question or revising the current question.

·  How often will you ask the teachers to complete the survey?

completing homework with success and providing additional instruction to specifically identified

students to increase performance on benchmark and standardized assessments.

Dr. Jennifer Adams

Educ 804