Showing posts with label assessment. Show all posts
Showing posts with label assessment. Show all posts

Wednesday, September 20, 2017

Rubric design to support assessment in Middle School

The challenge with assessment is giving targeted and goal directed feedback quickly to students so they can improve and move forward with the learning. Our Online Learning Platform (Teamie) can help streamline this process for both teachers and students so you can spend less time worrying about finding student work and copying and pasting feedback and work more efficiently.

This blog post outlines how to;
  1. Take a rubric containing reportables and our new scale and add this to Teamie
  2. Create an assignment to collect in a Google Doc
  3. Associate the rubric with created assignment
  4. Give targeted feedback based on your reportables
If you want to video version of this guide jump here.

Why are rubrics an important assessment tool?

This is an example of a rubric that we are creating to help give feedback to students. The example shown here illustrates the connection between our five point scale and what is possible for each learning outcome or "I Can Statement."

For instance it is hard for students to demonstrate an exemplary ability in some of the communication skills goals such as writing a claim, so the box is greyed out.

For the rubric to be an effective assessment tool the task itself needs to be designed and written in such as way that it aligns with the learning outcomes we have chosen, thus giving students scope to reach the top levels. The alignment of assessment method such as a selected response, written or performance task to the learning outcome is always crucial in giving students clear opportunities to succeed.

Getting started with Rubrics in Teamie:

You can take the same text as shown above and add this into Teamie to create your own rubric which can be attached to an assignment. Assignments allow you to collect in one or more documents from each student and track attempts, deadlines and send notifications.

There is no magic button where you can import any random rubric in a Google Doc into Teamie as the formatting is always different but the online editor is easy to use.

Firstly, you need to first make an assignment from which you can attach a rubric to as shown below.



You now have the option to either search the rubric bank for ones that colleagues have made. (search by name) or to create your own one from a blank template. Click to create from top right corner.

You will always be able to go back and reuse your rubrics when you next make an assignment.



The following screenshot shows the rubric editor. You begin with one criteria and four levels which you can all adjust. All of the text boxes are editable but when you actually mark the work online you can see the criteria title but need to hover to see the detailed criteria.



To take the original rubric I began by copying the learning goals into the heading and some of the other detail into the descriptor. I then copied the scale descriptors into the boxes as shown below. Once complete there is a clever duplicate button which saves time when adding the next criteria.



Then duplicating allows you to add subsequent criteria but keep the same scales. Some departments might choose to give more specific guidance for each scale specific to assessed learning goals or "I Can Statements" but you can equally keep this the same and simpler for students to use.

Using your rubric to provide feedback on student work:

Once you have made the rubric you can step to open a submission and give feedback. You can open the rubric from the right hand sidebar and you can drag it around the page. Once you click on the level it will automatically save your selection.



You can also leave more precise feedback on each learning outcome by clicking on the add comment option at the end of each learning outcome title. This will save you comment in either text or audio to the sidebar comment stream so students can see. You can hide these comments from students.



Publishing and viewing assessment data from your Markbook

For students to see you final feedback you will need to go back to the assignment submission page and select all and then publish grades for them to be notified of the feedback. A clever trick is to publish these all at once in class and ask students to reflect and add their own learning goals into the comment stream for you to refer back to.

The collated data across multiple assignments that you mark within Teamie is available in your markbook and you can select on one student to see an overview of the year. Eventually you will be able to see a mastery overview of how students are progressing against all of your learning goals for multiple assessments but you might have to wait until next year for this !

The video overview


Thursday, May 26, 2016

Tech Enhanced MindMaps

Mindmap Methodology via Examtime

Mind maps are such flexible, powerful ways to represent learning, and yet I rarely see them used. I think one thing that probably puts people off is they think they might as well just use paper, and I too once thought this... I was wrong.

Shifting mind maps to a screen drastically changes what you can do with them—so when you ask students to mind map on a screen, don't just ask them to replace what they can do just as well with paper mind maps—use SAMMS to transform them, so they are used in ways that can’t be replicated using static media like paper:

Situated Creativity

Online or 'cloud based' mind maps can be worked on in groups, synchronously and asynchronously - collaboratively or cooperatively, a seamless blend of classwork/homework. This means that rather than the tedium of teachers collecting in the work regularly to 'mark' the can view any of them, at any time, anywhere.

Accessibility

Smart web search for images to illustrate stages - combine with smart use of unit keywords (process, source) to really empower inquiry, eg students can clarify the understanding of essential words and terms by adding images that to illustrate (not just decorate) their maps; eg students learning about the process of how chocolate is manufactures can add an image that illustrates “chocolate process” or ‘chocolate source” to amplify the meaning of key ideas with images, and even videos. Terms that are ambiguous or confusing for the student can include a simple definition (in Google just type define: ). The treasure trove of knowledge that is the internet becomes a cornucopia of content to simple and easily make a mind map a glorious representation of that students expanding understanding.

Mutability

This is probably the most powerful enhancement of mind mapping on a screen. The mind map can be evolve, so it a form of assessment I call an ‘ongoingative’, in that it starts as a pre-assessment, gets used formatively throughout the unit, and ends up becoming a summative assessment. A much more natural, nonlinear, ‘organic’ way to organise ideas—starting very simply with initial ideas and understanding (pre-assessment), then revisiting the same mindmap regularly (once a week?) taking screenshots of the changes/evolution over the course of the unit.* Another factor here is that, unlike with the paper equivalent, ideas can easily be dragged and dropped, disconnected and reconnected, moved and removed as the overall map becomes more focused and as a clear structure emerges. Also, on the screen there is no need to be confined to the limits of a page, they can allow their mind map to expand in any direction their thinking takes them. The examples below (Rewind, Review, Reflect) shows how this works in Mind Meister using the history tool to review a process that took weeks in minutes.

Multimodality

At the end of the unit, the screen shots of the mind maps over the previous weeks can be turned into a screencast with the student reflecting on their learning. In iOS Puppet EDU makes this very easy, or use Quicktime to narrate a sequence of screenshots. Alternatively kids could use PicCollage to make a montage of key screenshots of a LJ post, with some text to summarise their learning? Mind maps like Mind Meister incorporate a Prezi like presentation mode, that allows the students to guide the audience/teacher through the elements that are most essential, they can even add a narration using an app like QuickTime - see the 'Reflect, Present, Narrate...' example below.


Socially Networked Activity

Mid unit reflection, kids can share their on going work in a multiplicity of ways, from sharing their mind map with their peers to facilitate collaboration or cooperation, or as simple as posting a screen capture of the most recent version of their mind map to share with the class, either via a class online space, or a Padlet et cetera. Peer to peer feedback, mediated by the teacher.


An Example from Grade 3

Michael Wheeler worked though a unit with his class that really exemplifies how well this approach works. Over the course of several weeks the mind map/concept map became a repository for recording and reflecting on their learning experiences throughout the unit; special guests, website info, BrainPop activities and videos, educational interactives—all summarised and and mapped in relation to three essential understandings. 




Rewind, Review, Reflect

This video powerfully demonstrates the 'history' tool, which effectively allows the students to rewind the map, and review the entire process of learning and inquiry captured over the preceding weeks.


Reflect, Present, Narrate...

The screen captures below demonstrate the final stage of the project, where each student was able to turn this formative record of learning into a summative presentation with a few clicks, this was then used to record a screen narration where the students reflected upon their work, by summing up the overarching understandings from the unit, not just narrating the text on the screen.


Grade 5

Across the Curriculum

Mind maps can be used for:

  • problem solving - WWWHWW
  • outline/framework design
  • structure/relationship representations
  • marriage of words and visuals
  • condensing material into a concise and memorable format
  • Project management 
  • Book/film/unit summaries
  • Word study - spellings, forms, etymology, patterns/conventions/connections
  • Brainstorming (ideation)
  • Knowledge management (including pre assessment) 
  • Planning 
  • Ongoingatives 
  • Connections between concepts, ideas, knowledge, skills. 
  • Maths strategy representations and connections, and/or process stages/steps

Concept maps vs Mind Maps

Technically mind maps differ from concept maps in that mind maps focus on only one word or idea, whereas concept maps connect multiple words or ideas. Also, concept maps typically have text labels on their connecting lines/arms. Mind maps are based on radial hierarchies and tree structures denoting relationships with a central governing concept, whereas concept maps are based on connections between concepts in more diverse patterns. A concept map is a way of representing relationships between ideas, images, or words. In a concept map, each word or phrase is connected to another and linked back to the original idea, word or phrase. Concept maps are a way to develop logical thinking by revealing connections and helping students see how individual ideas form a larger whole.

A Mind map reflects what you think about a single topic, which can focus group brainstorming. A Concept maps are more free form, as multiple hubs and clusters can be created, unlike mind maps which fix on a single conceptual centre. The reality is that I doubt many people really care about the semantic differences, my mind maps also exploit the features of concept maps, or maybe it's vice versa? The point is that this model is versatile and dynamic, it can be whatever you want it to be. This is a sentiment clearly echoed by a passionate advocate of this way of working, Ken Robinson; who gives the following, practical advice:
There is no wrong way to create a mind map as long as it makes sense to you. Mind mapping offers you a lot of creative freedom and can open whole new ways if thinking. Here are some of the main principles you to keep in mind as you practice mind mapping: 
  • Use single words or very short phrases for each line. Remember, this is a visual as much as a verbal system.
  • Form organic connections.
  • Use a variety of colours throughout the mind map. Colours give the map visual appeal and they help to identify different levels and types of ideas."
  • Each keyword or image should have its own line. 
Finding Your Element, pp 11-12

Key Concept Mind Maps

No need to look far for the a set of powerful single words that can form the basis of a concept map in any curricular area, some or all this essential 8, I call, '2Fs, 3Cs, 2Rs and 1P' are all you need:
  • form - define it, what is it?
  • function - how does it work?
  • causation - why is it like this?
  • change - how is it changing?
  • connections - how is it similar to other things?
  • responsibility - what do you/we need to do about it?
  • reflection - how do you know what you think you know is true?
  • perspective - what are the possible points of view?
Key concept starters in Popplet




Key Concepts in Mind Meister


Some Suggested Tools

For the reasons outlined in this post, mind mapping tools that are situated online make the most sense, top of my list for these is Popplet, followed closely by MindMeister, which has the added advantage of working with GApps, although it is more suited to older students, as you can see in the examples above, it works well with students as young as grade 3 as well.

Further Reading

MindMeister have published a great post on the benefits of mind mapping, "From Collecting Dots to Connecting Dots": Using Mind Maps to Improve Memory and Learning" that is well worth a read. It provides a short overview of principles of memory and learning and effective learning techniques, and demonstrates how students can use mind maps to become more effective learners.

*Mind maps like Popplet and Mindmeister include history tools that literally allow you to rewind to the start of the process and play it back.

Saturday, May 21, 2016

Not another Test/Rubric...?


http://www.hippoquotes.com/assessing-quotes


Assessment drives everything educational. So, not surprisingly, assessment is the biggest factor in terms of planning the use of tech in effective ways. This means that it's critical to ensure that we use a varied range of assessment strategies, which is where I find a surprising lack of options.

Why do so many teachers assume that only rubrics and tests are suitable for assessment? Sure they have their place but only within a suite of assessment strategies...

I don't mean to denigrate any particular assessment tool—clearly rubrics and tests can be effective assessment tools, but when they dominate, they have an unfortunate tendency to diminish the importance and efficacy of all of the other tools that are available. It is depressingly common to me that in virtually any educational context (classroom, conference, online) when the conversation inevitably turns to assessment, the question seems to default to, 'what rubric or test will we use?' rather than any awareness that there are a plethora of other tools and strategies that could be just as effective if not more so.

Do less, but do it better.

Now of course it's highly possible that teachers are unaware of the wider range of assessment tools they use effectively almost everyday, such as the ad hoc/informal conversations (conferences in the jargon) with students every day, to spirited class debates (not lectures) that utlise skilful Socratic strategies, which are in and of themselves valid assessment tools. The problem is that I think these are seen as somehow inferior to a "proper" test/rubric. All this does is create a lose/lose scenario for the teacher and the student.  Rather than focusing on tests and rubrics, wouldn't it be better for everyone if we were to embrace a much wider tool kit when it comes to assessment? To see them all as valid/powerful, maybe that conversation/conference was so effective that adding a rubric or a test is not only unnecessary but possibly even counter productive?

I think if you had asked most teachers why it is that they rely so strongly upon rubrics and tests as opposed to all of the other powerful forms of assessment, I think you would find that they would point to one sad fact; they feel they need paper with marks on, that they can attach a grade to, so they  can point to it as being hard evidence of their assessment judgement. While there is clearly a place for this kind of formal (usually summative) judgement, in my experience it is far too frequent and far too common. Teachers could do themselves a favour and do their students a favour by focusing on the goal of learning rather than the need to have a hard artefact to present evidence of every stage of progress.

What if instead we were to focus on the goal, that is, as long as the assessment tools you use allow you to provide effective individual feedback to the student and enables them to progress in their learning point where they are improving compare to their previous level of competence (ipsative assessment), then the goal has been achieved! So why not work a little smarter and use a range of assessment tools that are a far more varied. In so doing you create a classroom environment that is more dynamic, and far more effective for both the teacher and the student.

So what does this have to do with tech?

From my perspective, a classroom that exploits a wide range of assessment tools is a much richer environment within which to be able to integrate digital tools that can truly enhance and transform the way teachers teach and the way the students learn, and demonstrate the extent to which they have mastered the skills, knowledge and understanding that is truly the point, not just in ways that can be measured quantitatively on another test or a rubric. You don't have to look much further than an early childhood classroom to see this in action. Why? One thing their students can't do is demonstrate their understanding via tests or rubrics!

I've always found this matrix from the PYP to be particularly useful to illustrate this, although you may be surprised by the omission of tests from this grid, I believe they (somewhat disparagingly?) categorise these as 'check lists':

From Making the PYP Happen (IBO)

From the 'old days'—not new, but not common either.

If you really insist on using rubrics, a nice way to use them is for the teacher to define a central standard (eg a level 3 on a 5 point scale) and then ask the students to define and justify the level they feel their work sits in comparison to that, with examples.


More reading on the problems with rubrics, if you're so inclined: