A New Beginning

Last year, I started this blog as a way to journal about my experience as a first-year AP Statistics teacher. I wanted to share my experiences to help me reflect on my practices and to hopefully initiate some discussions with whomever read my blog and dared to comment. I knew that there would be other teachers out there in a similar position as I and that my posts might help them think through their own situations. I also hope experienced statistics teachers might stumble onto my blog and provide insights. In the end, the blog mostly served the first purpose, and that was fine. But, then I lost my drive to blog and I posted less regularly and then stopped altogether.

Now I begin again. I want to continue my professional development and I think blogging will be a terrific means to do that. Maybe some discussion will ensue.

Last year, I was anxious about getting through all of the material in time for the exam. To my amazement, I succeeded. Not only did my students cover every topic on the AP Statistics syllabus, but we still had two weeks to review before the exam.

However, in reflection, I do not feel my students were served best by zooming through the material. A few of them did tell me that they liked that we covered all the material (and finished the entire book). But depth of understanding was sacrificed for breadth and I hated that.

The students' results on the exam also suggested that some changes needed to be made. The students took a mock AP exam as their spring final exam two weeks before the actual AP exam. Based on their performance on that exam and based on their work all year long, I had expected them to score a bit higher. But, when I think about how hard they worked, and how some of them did not work too hard, I wasn't altogether surprised. Those who did the best had the best work ethic. Those who succumbed to senioritis largely did not pass.

This year, one change I am planning is to not worry about covering every single topic on the syllabus. I teach at an independent school (polite speak for private school) and we have only around 140 teaching days, I think, before the exam. My plan is cover 80-90% of the material, but to go into greater depth. The instructions on the AP exam itself state that they do not expect students to know everything. My class looked at scoring and were surprised to learn that you could get 50% of the multiple choice items wrong and still have a very good chance of scoring a 4 or 5.

Another change is that I am not going to give them very many multiple choice assessments. Last year, I gave the students 10 multiple choice items on every test and they had about 11 tests. And then they had 40 more multiple choice items on the mock exam. But I don't think one needs to practice multiple choice tests. Certainly not to the extent that I did last year. And I detest multiple choice items. So, I plan to give them the 40 problems on the mock exam and then maybe two other multiple choice assessments. That's it.

A third change is that I am going to incorporate more project work this year. When I have taught non-AP Statistics, I have always taught it purely project-based as I feel this is the best way to learn the material and the best way for me to evaluate their understanding. It feels more authentic and it removes test anxiety and the time constraints of tests. I will likely write an entire post on projects later.

But now, I must rest.

Thanks for reading.

Halfway there... a self-evaluation

My greatest concern going into this school year was to effectively teach AP Statistics. Though I have been teaching statistics for ten years, I had never taught AP before and I was worried about pacing and the quality of the lessons and assignments. I was worried about sacrificing pedagogical beliefs for the sake of getting through the syllabus in time and preparing students for the format of the test.

The course is going better than I had hoped. I greatly value projects in lieu of tests. Whereas a test is completed in a set amount of time, contains closed questions, and is done individually, a project is done over a number of days where students can choose how much time to spend on it, is more open-ended, and is done in a group of 2-4 students. Tests have very little value in helping students improve on their knowledge and are limited in their ability how much information they provide regarding what a student knows. Projects can help a student to better understand material and are provide richer information about what a student can or cannot do. My non-AP Statistics course was always completely project-based. I wanted to carry over as much as I could from the non-AP course into my AP course, but I feared the pace would make this difficult. I was optimistic that I could incorporate two projects this year. Happily, the students were able to complete two projects in the first semester alone. I now expect them to complete two more in the second semester at least.

The pace has been fine. While I am going faster than I ever did in my non-AP course, the pace has not been so fast that students are being left behind. The faster pace requires students to be more self-motivated, but, maybe because it carries the AP designation, students have been up to the challenge. Also, I have been able to adjust the pace at times based on feedback from my students. I had concerns that there would not be enough flexibility to adjust the pace mid-semester. But there proved to be more flexibility than I had anticipated.

Back in August, I started this blog regarding my teaching of AP Statistics. I am happy with how blogging has gone. This makes post number fourteen. Though my audience is quite limited, people have been at least clicking on the blog links I share on Twitter. One Twitter user even added one of my blog posts to the Math Education Daily and that particular post had a lot more page clicks. Blogging has allowed me frequent opportunities to reflect on my teaching and that alone has helped me to design a better course. It has provided little so far in professional discourse. I hope to get back to blogging weekly and I hope that my regularity can increase the chances of future discussions about my posts. I have engaged in a couple Twitter discussions with other math teachers. I would like to do more of that going forward.

[Regarding Twitter, I very much want to participate in Twitter Stats Chat. This is definitely a goal of mine. I have yet to figure out how to do that. I know the hashtag (#statschat) and I know that it starts at 6 pm (Pacific Time) on Tuesdays. I have TweetDeck set up for #statschat. But I never see a bunch of posts starting at the specified time in my feed. Grumble.]

In looking over the various assessments I have designed for my AP Statistics students, I am very pleased with the progress they are making. The projects and tests show that they are learning the material at an acceptable rate. Predictably, the multiple choice items have been the least helpful. I do not like such test questions. I have felt compelled to include ten with each chapter test so as to better prepare the students for the AP exam which will contain forty multiple choice questions. However, I am questioning how much practice students really need with such types of questions. This re-evaluation has partly been fueled by Jo Boaler’s book, Mathematical Mindsets, which I am almost done reading. In the book, Dr. Boaler presents research that affirms my views that students do not need practice for standardized tests. Rather, students can actually perform better on standardized tests if they have learned to be confident mathematical problem solvers. For the next chapter test, I have included ten multiple choice questions. But, I have made one adjustment that was suggested by a Twitter user: students can designate a first-choice answer and a second-choice answer. A correct first-choice answer earns two points while a second-choice answer earns one point. However, I think I will include more short answer questions and fewer multiple choice questions on future tests.

The search for a grade

The first semester at my school ends tomorrow. We do not have semester exams. Some AP teachers at my school give an exam in the evening. I chose not to. I think the main reason my colleagues opt to give an exam is to give the students the experience of sitting through an extended test in order to prepare them for the exam in May.

I am confident that all of  my students have sat a 3-hour exam once before. All but one were students at my school last spring, and they sat final exams at that time.  Therefore, I don't feel the need to give them a long test.

I do want them to be frequently reviewing and revisiting previous topics. So, I am giving them three Free Response Questions that cover the first four chapters. But, those three questions will not combine to form some large percentage of their semester average.

After today, my students will have been graded on 13 free response questions. Two of them were of the Investigative Task variety (that is, Free Response Question #6 from past exams). The others were either taken directly from past exams or were in that style. I am dropping their lowest two scores.

My assessments in AP Statistics this semester have mostly been a departure from how I have evolved otherwise. I have another (dormant) blog regarding my thoughts on assessments and evaluation. My tenth grade integrated mathematics course has zero period-long tests. I have given homework quizzes. But, in that class, grades are largely calculated from projects and presentations. I believe these forms of assessment give me the best indication of what a student can do and knows.

My AP Statistics have completed two projects this semester and they account for a large portion of their grade. I think the projects have given the students a worthwhile opportunity to engage meaningfully with the course topics and skills in a way that will prepare them for the exam. But, I think they also help the students see the utility and relevance of the topics beyond the AP exam. And, I think they provide me with a much better insight into what the students really understand and their abilities to apply the methods they have been studying.

I dislike multiple choice items a lot. (I wrote about this dislike in this blog here and here.) I do not think they are fair nor do I think they tell me much about what a student understands. Perhaps, in a 40-item multiple choice exam, they give a better picture. The larger number of items reduces the chance that a score is based largely on lucky guesses and increases its probability of being due to a student's understanding.

The free response questions are better, but still contrived as they must fit into an arbitrary allotted amount of time and they are written in a way that takes much of the decision-making away from the student.

I do wonder if I could teach a project-based AP Statistics class and still prepare my students for the big, bad AP exam. Seems possible. I guess I have my goal for next year's course.

Anybody have experience teaching AP Statistics as a project-based course? I would love to read about your experiences, recommendations, ideas, and thoughts.

Free Response to the Rescue

Though I demonize standardized tests in general, the AP Statistics exam has a saving grace: the free response questions. The first section is made up of 40 multiple choice questions and counts for half of the exam grade. The other half is based on six free response questions.

Multiple choice questions (about which I have previously written in this blog) are one of the lowest quality assessment tools available to the teacher. How fair is it to the student that they could do a problem 95% correct and get zero credit? Writing such questions is a bore and a pain. Answering them even more so. And, if you develop good test-taking skills, you can learn how to improve your odds of making a good guess. Since there are no penalty points for incorrect answers on the AP Statistics multiple choice questions, students are free to guess away. So, random guessing will, on average, get you eight correct out of 40.

Fortunately, there are the free response questions. I have long strived to develop authentic assessment tools. I want tasks, projects, activities, and problems that develop students' learning skills such as critical reading, analysis, problem solving, and synthesis. The free response questions do pretty well here. Problems are written to present at least quasi-real-life scenarios and students are asked to use their statistical tools in a meaningful way.

They are far from perfect. Students do better if they understand what the AP readers are looking for in answers. Thus, it is possible to teach free response strategies. Therefore, I feel compelled to do just that and have already begun. My first test involved two free response questions from past AP Statistics exams, as I expect will be the case for each chapter test. That means my students should get at least 24 chances to practice answering free response questions this year before their practice exam in April when they will get 6 more.

That seems like a lot and so I am relieved that I find these to generally be quality questions. I am also very thankful for Jason Molesky's StatsMonkey web site and his list of Free Response AP Problems Yay (aka FRAPPYs). On this site, the questions have been sorted by topics making it much easier for me to write my tests. Once again, the MathTeacherBlogoSphere to the rescue.

One my challenges in using these questions in class will be to apply the scoring guidelines appropriately. The College Board has made these available and easy to find, but it will take me some time to learn how to score the questions correctly. I did an AP Institute this past summer, and that helped some. My experience teaching International Baccalaureate (IB) mathematics helps. Becoming an AP reader seems like an obvious move to help me in this area, but I am three years short of the three-years-of-experience-teaching-AP-Statistics requirement. I do not understand why I must wait three years to be able to have one fewer week of summer vacation.

Some questions for my readers: How do you use free response questions in your teaching? Do you always score them exactly as the AP guidelines suggest? Have you been successful in preparing your students for the AP exam without directly teaching test-taking strategies?

The "necessary" evil?

For the last five years or so, I have thought a lot about assessment, and even more about evaluation in my classes. When I first taught my non-AP statistics course 10 years ago, I decided to not use tests or quizzes. I have often tried to make use of alternative assessments such as projects, portfolios, and take-home problem sets. My primary goal has been to create assessments for my students that are closer to something that they might actually do outside of academia. Tests and quizzes as far as I can tell are artifices almost exclusively in the domain of academia.

And yet, here I am getting my students ready for a major exam. Granted, they have eight more months to prepare for the AP Statistics exam, but in a couple weeks, I will give an in-class, timed test. What’s more, it will have 10 multiple-choice questions as part of the test.

I have not given a standard multiple-choice test in 15 years. I long ago swore them off. To me, they are assessments that in no way advantage a student and don’t even help a teacher evaluate a student’s mastery of a concept or skill. Did they get the answer right by luck? Did they get it wrong because they mis-read the question? Did they drop a negative sign in solving an equation and end up with one of the incorrect answers?

As I have told my students on numerous occasions, on a multiple-choice question, one can solve a problem and do 95% of the work correctly, but get no credit. It’s all-or-nothing.

Yes, it will make scoring those problems very easy for me. But my job as a teacher is not to make my job easy. My job is to provide my students with the best learning opportunities I can. Tests, in my mind, are very low on the totem pole of learning opportunities. Multiple-choice tests barely even qualify as a learning opportunity. Learning opportunities worth doing are projects, activities, rich tasks, and presentations. Evaluating a student’s work on a project gives so much more insight into what a student knows and what they can do.

I have avoided AP classes because I do not want to teach to a test. I do not want to rush through material because the College Board has decided that the course must contain certain topics. I prefer to dive deep into a problem and to provide my students the time to fully understand the concepts. My regular statistics students may have only learned half the number of statistics topics as an AP student. But on the material that they did cover, I daresay that their learning went deeper and that they understood better how to properly use the statistical tools. And I bet they also enjoyed the class more.