Posts tagged assessment
Three Issues for Effective Development of Curriculum & Assessment
Oct 18th
At the 2011 Texas Community College Instructional Leaders annual conference in Fort Worth, October 5-6, I had the opportunity to present and discuss three issues I think are important to the effective development of curriculum and assessment. The three issues are those which I have identified over the past year as I’ve worked more in depth with my local institution’s curriculum and assessment initiatives. The highlights of the discussion and presentation: More >
Learning Outcomes ARE NOT Learning Objectives
Aug 8th
The simple fact that Learning Outcomes are NOT the same as Learning Objectives is a key principle to “Developing Effective Learning Outcomes & Objectives.” As noted in that presentation outline,
The differences lie in the level of specificity each provides and the relationship of each to assessment methods and instructional activities. Failure to understand and accommodate the differences can restrict academic freedom of faculty and complicate institutional efforts to manage curriculum and assessment.
Using the course I teach – COSC 1401 Introduction to Computers – I want to briefly illustrate the difference and the relationship between a learning outcome and a learning objective. More >
Assessing Online Discussions
Aug 4th
I recently re/developed the rubric I use to assess learner performance in the online discussion for my “Introduction to Computers” course; I wanted a more generic approach suitable for many of the discussions in the course – particularly with the course going through a Quality Matters review. I developed a holistic rubric with two primary criteria supported with a number of descriptors at each level of proficiency. More >
Problems with Bloom’s Taxonomy?
Jul 31st
Last week or so, I came across an older article (December, 2002) from International Society for Performance Improvement that challenged the utility of Bloom’s Taxonomy on several levels. In short, Dr. Brenda Sugrue argues that Bloom’s Taxonomy is not valid, reliable or practical. Dr. Sugrue offers two alternatives which both suggest an emphasis on the application and use of knowledge. I believe there’s a great deal of truth in Dr. Sugrue’s argument, and I have a few additional thoughts. More >
Developing Effective Learning Outcomes & Objectives
(If you’re landing on the individual post page directly, this is an abstract for a conference/professional development presentation. See the speaking page for more details.)
First things first : A learning outcome and a learning objective are two distinct concepts. The delineation of the two concepts is critical to effective design of learning and assessment for a course, and subsequently, the management of assessment practices.
Assessment of learner outcomes and performance has become increasingly important in a political and accreditation environment focused on evidence, data and accountability. While institutions work to establish procedures to ensure learner assessment results are documented, reported and used to improve instruction, the success of those improvements is dependent upon or assumes the identification of quality learning outcomes, learning objectives, and learning activities. Effective learning experiences begin and end with assessment derived from defined outcomes and objectives. The focus question then is, “How do we develop effective learning outcomes and objectives?” More >
Continuous Improvement of Assessment Methods
(If you’re landing on the individual post page directly, this is an abstract for a conference/professional development presentation. See the speaking page for more details.)
Assessment of learner outcomes and performance has become increasingly important in a political and accreditation environment focused on evidence, data and accountability. While institutions work to establish procedures to ensure learner assessment results are documented, reported and use to improve instruction, the demand for improving learners’ workplace readiness will drive the need for continuous improvement and innovation regarding how we assess learners. Assessment is the beginning and the end of designing and facilitating effective learning experiences. With that in mind, “How do we improve assessment methods to enhance the learning and teaching process?” More >
Where’s all the assessment specialists? learning analytics? and tweets?
Feb 23rd
EdTechatouille definitely will become more of a mixed bag of educationally related commentary over the coming months. I changed positions this past October and am no longer working day-to-day in EdTech. I’m still at the same higher ed institution, just a different position, office and location. My focus now is on curriculum development, innovation and assessment. I’ll explain that in more detail at some point, or it may become evident what that means exactly through some of the posts I’ll be writing.
In my new role, I spent the last three days in
College Station, Texas at the 11th Annual Texas A&M Assessment Conference. I will post more about individual sessions and thoughts as I have time, but I wanted to mention three things that struck me throughout the conference More >
WordPress Help! Private Comments/Posts & Aggregating Tags
Dec 17th
For the WordPress Mu gurus – or at least those more familiar with WP Mu than I (which does not require being a guru) – I have several questions. First, is there an available plugin that allows a post author to mark the post as private so that only they and a specific user or group of users can access/review the post? Second, is there an available plugin to allow a commenter to mark their comment as private so that only they and the post author (and system adminsitrators) can access/read the comment – even if the post isn’t private? Third, is there an available plugin that does site-wide aggregation of tags by user or tag?
That’s probably clear as mud, so I’ll explain what I’d like to do related to student portfolios and institutional assessment. I have italicized the parts of this scenario which are the source of my questions; the elements not italicized aren’t in question – I believe/know they can be done within WPMu. More >
What’s a test when you have a pocket encylopedia?
Nov 10th
Encyclopedia is “A complete copy of the Wikipedia encyclopedia on your iPhone/iPod. This app is the fastest and simplest way to browse Wikipedia on your device, and crucially, doesn’t require any internet connectivity . . . When you first launch Wikipedia, you will be required to download a copy of the database which will occupy about 2GB of space on your device.” I noticed this via LifeHacker and tracked through a Google Code page and the home page for the application. As an educator, think about this for a second. The entirety of Wikipedia on a mobile device no larger than a cell phone; that’s over 1 billion words in your pocket, literally. That’s over 25 times as many words as the next largest English-language encyclopedia, Encyclopedia Britannica. What does that mean to me? My daughter lives in a world in which she thinks “Daddy knows everything.” I’m not talking about the normal, narrow-world-view naivete of a child to whom it seems Mom or Dad knows everything; in reality, she’s never asked a question for which I didn’t or couldn’t provide an answer of some sort; even the less definitive answers to philosophical questions are still answers. Most recently, it was, “Why do we carve pumpkins at Halloween?” I have explained to my daughter that I don’t know the answer to every question; I just have a real good idea of how to find the answer to most any question. As an educator, that perspective and ability is a wonderful thing. As an educator, that perspective and ability creates a significant problem. It’s an incredible prospect to be able to find the answer to most any objective question given an internet connection and better than average internet search skills. But, what implications does that have for education, in it’s current, American incarnation? It may have been nearly 20 years since I last sat in an American History class, and many of the facts I learned then have long since escaped the clutches of my memory. However, if you were to put me in front of one of those same history tests along with a mobile device, could I not do fairly well on it? especially if I had a mobile device? In fact, why should I not have a mobile device available to me, as some Australian schools are now allowing? In terms of authentic tasks (see previous post), is remembering specific dates, facts, or information something I’ll ever have to do again? If I can use my iPod to help me answer almost every question on a test, what’s the value of the test?
Stop Quizzing Learners in Second Life!!!!
Apr 15th
Finally getting back to this post I started about two weeks ago . . .
This morning/afternoon I attended a workshop that demonstrated a variety of Teaching Tools for Second Life. I absolutely appreciated the workshop and those involved in making it happen: the host institution, the faculty moderator and the facilitator. It’s these kinds of activities that make Second Life of keen interest to educators; there’s simply not another technology that brings everyone into a common workspace like Second Life does.
With that said, as an instructional designer and technologist, I have several significant pedagogical issues with the tools that were demonstrated. Each of the tools I saw demonstrated have, in my opinion, little to no useful place in Second Life. Worse yet, I believe they may actually be counterproductive to the development of quality learning experiences in Second Life. I think this is at the core of the “quality use of Second Life” question. My opinion may be perceived as being too harsh, but I’ll explain.
I don’t want to refer to the tools specifically because I do not want to denigrate the individual tools or the individual who created them; the developer is a fantastic educator for whom I hav ea great deal of professional respect. What I do want to do is to discourage the transfer of traditional assessments and learning tools into a virtual environment which has much greater capabilities and potential.
By and large, our classrooms are much more limited than the real world; it’s not easy or in many cases possible at all for learners to perform a skill in the classroom in the same manner they would perform the same skill in a real-life situation outside of the classroom. For example, in a business entrepreneurship class, it’s not possible to have learners engage the process of actually starting a business; that requires too many actions and resources that lie beyond the capabilities of the classroom. So, we cover the concepts and processes in as much detail and in as innovative ways as possible afforded by textbooks, new media, interactive technologies, classroom activities and the online environment. We then use an assessment instrument of some sort that hopefully provides a valid and reliable estimate of how learners would actually perform if they were to in fact start a business. So, out of necessity, we resort to tools that estimate how a learner would perform in the real world – in an authentic environment once they’ve left the classroom.
The virtual environment, in contrast, creates a unique opportunity to abandon the estimates and the not-so-reasonable-facsimiles of performing real world skills in a real world, authentic environment. In the case of the business entrepreneurship class, it IS possible for learners to actually start a business within a virtual environment, Second Life in particular. They can conduct market research within an actual, living market; they can fabricate actual prototypes of a product; they can bootstrap the business or seek funding for the startup; they can have actual customers purchasing products. Given enough time, they can engage every phase of the business startup process. As an instructional designer, the transfer of classroom tools and assessments that estimate how learners will perform in the real world to the virtual environment is, at best, incongruous, and at worst, counterproductive. They do not belong.
But wait . . . many will say, “We have to have some sort of assessment?!” Right, but I argue that the manner in which we assess learners needs to change; we need to take advantage of the affordances of the new environment. BUT for now, I’ll concede that argument, for argument’s sake. Even if we MUST conduct traditional, exam-type assessment, I ask, “Why do we have to do that within the virtual environment when we already have internet-based tools that do the same thing and perhaps do it much better than any currently-available tool in the virtual space?” Any learner that can access a virtual environment can also access any web-based learning management system that is guaranteed to have an integrated assessment tool. The two environments aren’t and shouldn’t be mutually exclusive; even if we want to teach a class entirely through a virtual environment, that doesn’t mean that ALL activities have to occur within that space. In fact, it’s MUCH more efficient to use both environments; we should leverage the particular strengths of each application.
If that’s not enough, one of the other participants commented, “We need to keep this as simple as possible; many of our students are not strong computer users.” We know that’s true; even strong computer users engage a learning curve within Second Life. Even if there’s disagreement about my arguments above, should we not still leverage the assessment capabilities of LMS’ rather than developing less reliable and more clunky tools to do the same thing in Second Life? for the sake of our learners?

Hot Topics