Assessment Philosophy – Veronica Brown, CTE

Bishop's University building with trees and grey sky
Bishop’s University (photo by Ryan Millar, flickr)

A few weeks ago, Julie (Timmermans from CTE) and I visited Bishop’s University to facilitate two workshops. The morning session was on course design, a condensed version of CTE’s Course Design Fundamentals. In the afternoon, the session was titled, “Designing Assessment for Learning”. We had an absolutely wonderful time and met many faculty members from both Bishop’s University and Champlain College, which is also located in Lennoxville.

We struggled for quite some time with the content of the assessment workshop. Whole university courses are dedicated to this topic. We had just three hours. What should we cover? What were the most critical messages? Should we focus on specific tools? What are some of the “best practices” that are happening at Waterloo that we should share? Should we spend an equal amount of time on both formative and summative assessment? Wow! There is so much to cover.

OK. Perhaps we could focus the assessment plan (as our intention was that the take-away from the workshop would be to have an assessment plan) around a few specific assessment tools. But what should we include? Exams? Quizzes? Assignments? Written assignments? Problem sets? Labs? Projects? Research? Essays? Community Service? Design Competitions? Case Studies? Reports? Studio projects? Individual work? Team work? Participation? Reflective Writing? Again, what a lot of content to cover in just three hours!

Our initial thoughts and design focused heavily on content and all the knowledge we wanted to impart. Ironic given the fact that we had just planned a course design workshop. We eventually took our own advice and stepped away from the content. As we continued to wrestle with these ideas, we kept asking ourselves, if there is just one thing we would like participants to know or have when they walked out the door, what would it be? It took a really, really long time to figure this out.

Eventually, we realized that we wanted participants to explore a different element of assessment. While we could impart lots of ideas related to specific tools, we decided to focus instead on how we view and value assessment. We began the workshop with an exploration of the concerns we, as instructors, have about assessment then compared it with our perceptions of students’ concerns about assessment. We then explored elements of a framework for assessment, which includes: observation (obtaining evidence of learning); interpretation (reasoning from the evidence); learning outcomes; and, at the centre of the framework, the purpose (Why am I assessing?) (the framework we presented was adapted from the National Research Council (2001). Knowing What Students Know. Washington, DC: National Academy Press, p. 44.).

Both these pieces led to the final activity of the day, in which we asked participants to articulate their Assessment Philosophy Plan, which might eventually become part of their Teaching Philosophy. The idea was to explore what their goals and philosophy were for the assessment of their students. We asked them to reflect on the following questions.

  • Who is involved with the assessment?
  • What roles does assessment play in learning?
  • What boundaries surround your assessment framework?
  • How can you provide flexibility to support the variety of learners in your class?
  • What pieces are rigid and which ones are flexible?

Having written this philosophy statement, we then asked them to reflect on how the assessments in their course reflect this philosophy. In reality, we cannot always control the contextual factors that impact our assessment choice (e.g., if part of our philosophy relates to developing a reflective practice, how do we provide formative feedback to a class of 1500?). But by reflecting and articulating our own philosophy, it can help guide us when we need to make some of the more difficult decisions tied to our assessment strategy for our course.

 

Creative and Flexible – Marlene Griffith Wrubel

In the past two months, a number of workshops were offered on current trends in teaching and learning, including How to Develop Activities that Incorporate the Concept of a Deep Approach to Learning, Personal Autonomy in Learning, Flipping the Classroom, and the Meaning of Massive Online Open Courses (MOOCs) in Education.

Recurring themes of collaboration and feedback, instructor creativity and flexibility, and injecting elements of fun in courses were addressed. Most importantly, faculty from different disciplines had an opportunity to interact with each other about the learning environments they have developed to support their students.

I was fortunate to take part in some of those conversations. It is clear to me that the successful instructors (instructors happy with how students learn in their course) are those who are creative and flexible in their approach to teaching. These instructors have systematically reworked learning activities to meet their learning outcomes. Their students learn through trial and error, receive feedback from their peers and the instructor, and are given an opportunity to improve in subsequent course activities. The learning activity is structured to emphasize the learning process and encourage students to think about the course material rather than focus on their grade. The instructor may not always be centre-stage or initiate the next step in the life of the assignment but guides the learning process nonetheless. These instructors also recognize that soliciting informal and formal student feedback of their learning experience is an important element of maintaining a good learning environment.

The trends in teaching and learning mentioned at the start of this blog will be present for the foreseeable future. Adoption of some of these trends to the classroom and online environment will take creativity and flexibility on the part of instructors. In some cases, it is already being done by faculty on campus. For anyone looking to boost their creativity quotient, you need look no further than what is happening in your department or on campus. I appreciated all of the conversations that took place in the workshops I attended. I encourage you to attend upcoming CTE events and let us know what you are doing in your class.

Johnson, Steven (2010). Where good ideas come from. Retrieved October 31, 2012, from http://www.youtube.com/watch?v=NugRZGDbPFU.

“You’re the Inspiration”

I remember the day I fell in love.  With my discipline of educational psychology.

It was my first term of graduate school, and I was taking an elective course in “Gender and Policy Studies in Education”.  The first sign that something special was about to happen came when I did the supplemental reading – a book called “Women’s Ways of Knowing.”  I never did the supplemental readings.  I think that I somehow knew that the moment would be special.  I lit candles, got comfortable, and devoured the book.  Finally, there were words (like epistemology) for the ideas that had been drifting in my mind without an anchor.  There were people doing research the way I one day wanted to do research.  Another sign appeared when it came time to write the final paper.  I had a love/hate relationship with writing.  Writing papers was usually a long and arduous (but ultimately rewarding) task.  Somehow, this 20-page paper just flowed. I wrote in one sitting, hand-writing the first draft, rather than typing it.  Somehow I felt that this connected me more to the ideas.  The first draft was also my final draft.

There have been other such moments throughout my graduate work and my career that have confirmed for me that I chose the right field – moments that revealed how my research and my self and my relationships with others are interconnected. I now realize, however, many years later, that I never told the professor of that elective course how that one reading changed my academic life, opening up an entire field within my discipline that I had not known existed, shaping my future research, and shaping, really, the lens through which I view the world.

We rarely know when we’re designing a course which moments in the classroom, conversations outside the classroom, readings, or assignments might ignite a flame in learners.   But what if we asked learners to share these moments with us, so that we might intentionally integrate them into the courses we design?  As instructors, how can we take students on the journey of discovering their own passions?

Might our own stories of falling in love be important to share with students?  In the midst of concerns about UDLES, GDLES, and accreditation, how might we weave into the courses we teach the stories of how our passion for our discipline evolved – the stories of what continues to inspire our work?

Do you remember when you fell in love with your field?   Please consider posting a brief note about the ideas/encounters/experiences that inspired your passion for your discipline.

 

Another Good Way to Learn: Debates — Justin He, Co-op Student

Learning, in many university students’ minds, is reading textbooks and attending lectures. Yes, this is one way to learn, but it should not be the only way for students to learn. It is true that students can learn knowledge by this way, but is this the best way for students to learn? Also, other than knowledge, what can they learn from just reading textbooks and attending lectures?

As we all have known in today’s society, students who only have “book” knowledge are not good enough. They require more realistic skills. The question is, how can they develop more skills? I am sure there are many ways to do that, but I suggest students to develop their skills by engaging in debates. You can develop many different useful skills for being a debater.

In general, debate helps you effectively to develop four skills:

  1. Communication
  2. Presentation
  3. Teamwork
  4. Critical thinking

A typical debate match has judges, a motion, which is a topic to debate, and at least six or more debaters. There must be two sides in a match, and debaters are evenly distributed on both sides. Each side is either in favour of or opposed to the motion. Therefore, it has a thesis statement and points to support its position.

Debaters need to figure out the most effective way to deliver all of this information to the judges. Otherwise, they will lose the match if no one can understand their speech. This is the time for people to improve their communication skill. It helps people to find a better way to deliver information and communicate with their audiences in their normal lives. Also, debaters need to clearly present their thesis and points during a debate match; therefore, this is an effective way to develop presentation skills too.

Debate is not an individual activity because a typical debate match involves more than one debater on one side. Debaters need to cooperate with teammates and debate with the other side. As we can see here, teamwork is extremely important. It is a great opportunity for debaters to build up the teamwork skill.

Furthermore, debaters should not only focus on their thesis and points. They have to think of the thesis and points of other side and find out a way to retort them. At this stage, debaters can improve or develop their critical thinking skill.

I suggest that professors consider having an in-class debate as one of the assignments for students. It will surely consume some of their lecture time for teaching; however, this assignment provides an opportunity for students to develop some important skills for their future. Therefore, it is worth to give up some teaching time to let students undertake an in-class debate.

Update Your Lectures: Re-Thinking PowerPoint in the Classroom – Zara Rafferty

Black and white photo of a teacher in the classroom

Oh, how I loved PowerPoint as a student. When the lights at the front of the room clicked off and the PowerPoint projector clicked on, my peers and I took that as our cue to sit back, relax, and start surreptitiously texting under our desks. What was class time for, really, if not to catch up with the latest Facebook news?

Silly faculty, I thought, don’t they realize that, by posting the lecture slides, they are eliminating the need for me to listen in class? As for the few wily instructors who left blanks in the slides? Well, they eliminated the need to study for tests, as we could be fairly sure those blanks would comprise the bulk of our quiz questions.

It was only when I became an instructor that I realized how vital PowerPoint was for me. The slides helped keep me on-track, allowed me to share images or embedded videos, and ensured that I touched upon key discussion points.

But, as I gazed out at my students, not-so-covertly texting, nodding off, or staring at me with vacant eyes, I realized I was doing something wrong. I was using PowerPoint as a crutch and not as an effective communication tool. I turned to PowerPoint to organize my notes when I had not left myself enough time to plan a thoughtful, engaging lecture. I thought that by using a different font (hello, Rockwell!) and selecting a colourful PowerPoint template, I was somehow pioneering educational technology.

Wrong.

I had to face the sad fact that I didn’t know how to use PowerPoint effectively. I didn’t, and you probably don’t either. And that’s okay. We can fix it! Here are my top 5 resources for reinventing how you use PowerPoint in the classroom:

1. You Suck at PowerPoint: 5 Shocking Design Mistakes to Avoid
2. Re-Think Your Use of Visuals: Dance vs. PowerPoint, a Modest Proposal (from John Bohannon, who also created the Dance Your PhD project)
3. PowerPoint Inspiration: 28 Creative PowerPoint Designs
4. Active Learning with PowerPoint Tutorial
5. Try other PowerPoint-esque programs, like Prezi, Keynote, or SlideRocket

Of course, you could always get rid of PowerPoint altogether, but I suppose that’s a topic for a future post…

Happy designing!

(Image via)

 

Visualizations for Assessment and Learning — Mark Morton

Web 3.0, they say, is going to be a “semantic web,” which I take to mean that it’s a web which will allow us to easily explore relationships among large amounts of discrete bits of data. One way of exploring relationships, of course, is visually: humans can literally “see” patterns of relationships more easily than they can otherwise apprehend them. Examples abound, but one that I recently came across is especially interesting from an “assessment” point of view. It’s a visual depiction of comments that a class of students made on one another’s blogs. In the visualization, each student is represented by a small circle (or node) and the the comments that he or she made are represented by arrows leading to the nodes of other students. So, if Matthew commented on Ephraim’s blog once, then the arrow starts from Matthew’s node and points to Ephaim’s node. At a glance, it’s easy to see who has been most active in making comments, who has received most comments, and who hasn’t been active at all — and that information can clearly help an instructor with both formative and summative assessment. You can the visualization, which was made with the platform Many Eyes, here.

Another visualization tool that I recently came across is called DebateGraph, which is intended to help people map out the various ideas, positions, and evidence that make up complex arguments. At first glance, a DebateGraph visualization looks like an ordinary concept map, but as you click the various nodes, you see that each one dynamically changes: it becomes the central node, and new nodes — ones that are connected to it — jump into place. The platform is collaborative, so if you want to contribute to the argument, you just need to log in, navigate to the appropriate node, and then add your point. You can see an example of a visualization in DebateGraph here.

I’m a bit sceptical of DebateGraph’s “practical” implications: in other words, if your family is having argument about where to go for your summer vacation, I don’t think that using DebateGraph would be worth the investment of time it would take to map out the argument. But as a learning tool — that is, as a way of helping students untangle the complexities of, say, a geopolitical conflict or an ethical issue — I think that the very “deliberate” methodology of DebateGraph could be very useful.

Where Good Ideas Come From — Shirley Hall

YouTube Embed: No video/playlist ID has been supplied

For a while now I have been digging into the literature to find resources related to creativity and innovation. There appears to be a somewhat old-fashioned belief or assumption that states there are people who are creative and there are people who are not creative and that creativity is a result of natural talent. However, Edward De Bono and his staff state that formal skills of lateral thinking can be taught, learned, and practiced in as deliberate a manner as we learn and use mathematics. Continue reading Where Good Ideas Come From — Shirley Hall