Author Archives: Melissa A. Venable

Unknown's avatar

About Melissa A. Venable

Working at the intersection of instructional design and technology, social media, and career development.

Rubrics. Yes? No? Maybe…

Instructional design work is increasingly standardized. As this happens, data is collected to measure student learning outcomes and rubrics come into play. Lots of them. Instructors use these rubrics (charts with a rating scheme for each element of an assignment) to evaluate student work.

Rubrics provide a way in which the instructor can compare the quality of student work against a set of specific criteria. Ideally, if you have several sections of a course running, each with a different instructor, all will evaluate student work similarly using a standard rubric –  if two different instructors each evaluated Student A’s assignment using the same rubric, their individual evaluations would be the same.

There are pros and cons to the use of rubrics.

Rubrics can be helpful.

  • Rubrics encourage a more objective evaluation of a student’s work, reducing the possibility of comparing students to each other instead of the learning objectives.
  • Have you ever taken a course or submitted a paper and received a letter grade with no details about how that grade was determined? Rubrics can take some of the mystery away from the student’s perspective by clearly stating expectations making the grade seem less arbitrary.

Rubrics can be limiting.

  • Creating accurate ones that measure student learning of a specific outcome is not an easy thing to do. This process requires evaluation of the rubric itself to find out if it is reliable and valid.
  • The use of rubrics may result in less creativity from students working to check-the-box for each of the expectations presented in rubric categories and criteria.

Questions to consider:

  • Are rubrics always appropriate and effective? Think about types of assignments here – performance tasks, creative writing, etc. and context.
  • Who prepares the rubrics? I’ve experienced the hire of an assessment expert, assignment to instructional designer, and assignment to subject matter expert. Rubrics can also be found ready-made and there are online ‘rubric makers’.
  • What about reporting? Are rubric scores/ratings useful beyond the classroom to drive changes in curriculum at a higher level?

It could be argued that while rubrics can and do serve a real purpose, there is a point at which they can become too prescriptive. In this case, the focus becomes the measurement itself. There is a personal piece to learning, something more organic, where a student puts together knowledge and gains skill through his or her own unique set of experiences. Static rubrics can also reduce the ability of the instructors to assess student work from their unique perspectives and expertise. Difficult to capture these things via rating scale. What are your thoughts on pros and cons, your successes and challenges with rubrics?

Resources for your continued exploration of assessment and rubrics:

Image credit: stock.xchng

Jobs in Instructional Design and Technology

Months before finishing graduate school I set up several email search agents on job search/career sites in higher education and industry. That was over three years ago and I never shut them down. While I did find a job after graduation I like seeing what comes up each week. The fields of instructional design and technology are still pretty young, undefined, and evolving. This evolution comes through when you read these announcements over time. Setting up a search agent or alert allows you to set the parameters of the searches to meet your needs: location, salary range, etc.  You can also usually add a list of keywords.

Are you looking? Here are a few sites you might want to consider adding to your search:

  • Instructional Design Central – As promised in the name, a central site for all things instructional design. In addition to a jobs board, this site also provides info on conferences and organizations.
  • Chronicle of Higher Education – Jobs – For those interested in working specifically in a college or university setting, although there are a few industry and non-profit listings as well.
  • HigherEdJobs.com – Another good site for college/university positions – user friendly search agent feature.

Professional association job boards:

  • Association for Educational Communications and Technology (AECT)
  • Association for the Advancement of Computing in Education (AACE)
  • American Society for Training and Development (ASTD)
  • The eLearning Guild – Job Board

Some of the big job search sites – search specifically for instructional design. You can also set up advanced search filters.

If you like Twitter…consider following:

  • @InstrDesignJobs – This account posts multiple jobs daily. Most seem to be industry focused, but you’ll see other settings, too.

Not looking? Consider setting up a search or two to stay current – know what employers are looking for now in terms of experience, education, and skills. If you are thinking about continuing your education and training, check these posts first to see what is in demand.

Other recommendations? Please let me know your suggestions and I’ll add to the list. By the way, this post was inspired by Deb Ng’s post: 25 Places to Find Social Media Jobs. Interested in the use of social media in education? You might find her list interesting, too.

Photo credit: everything.in.blue, Flickr

A Listening Post

Listening is an important part of our practice as instructional designers – listening to clients, listening to SMEs, listening to our team members, listening to leaders in the field… Having an ear to the ground and an eye to the horizon allows us to have some knowledge of what’s coming next so we can prepare, position, and not just react. To actively listen we have to focus our attention away from ourselves and towards what is going on around us. 

As I sit in meeting after meeting (many of us suffer this to some degree, right?) I find myself wondering if anyone is listening. We seem to cover a lot of familiar ground and make decisions that were decided in previous sessions. It can be easy to get caught up in the need to be heard. It can be easy to get caught up in the need to meet our own individual deadlines.

When I went through military training (eons ago) I learned about establishing Listening Posts and Observation Posts (LP/OP).  These were strategically positioned outposts that allowed for the collection of information. In my memory one of the key characteristics of these posts is that if you were the LP/OP you had to be quiet. You had to take accurate notes about what you heard and saw (collecting data!) so that you could share the information once you got back to your unit. I have no idea if these LP/OPs are still part of the way military units operate, but I do think there’s an opportunity for all of us here. It’s a simple concept, yes, but not necessarily easy to implement.

Where are your Listening Posts?

For instructional design, I rely heavily these days on Twitter. I follow a mix of people and organizations involved in instructional design and technology at varying levels and from multiple perspectives: k-12, higher ed, corporate training, textbook publishers, open education resources, professional organizations, thinktanks, and journalists. Twitter allows me to customize my own kind of news feed – one in which I can participate as well, but it’s only one listening post. Others include conference attendance and networking events. What do you rely on?

You’ll find a lot of people talking about listening these days, too, not only in instructional design, but also in social media, marketing, and business circles.

What can we learn from listening to what’s going on in other fields? What can we learn from listening to what is going on within our own field, within our own organizations?

Image credit: gregwake, Flickr