Thursday, 26 November 2015

"Second class" lecturers

Business Schools teach about successful (and sometimes unsuccessful) businesses where strategic missions are fully supported by an appropriate mix of resources.  Taking Google as a success story we can see clearly the mix of technical, entrepreneurial, marketing , financial and people management expertise that combine to make the company a good place to build a career (so we are told) and a successful place to invest the pension pot.
So, you would expect that a Business School would balance in the mix of lecturers and professors in business education as suggested in AACSB Standard 15 ?
In brilliant business consultancy style AACSB identifies a 2 x 2 matrix of academic staff sorted by sustained activity (either scholarly / research or applied / practice) and point of entry (either PhD route or via a professional career).  This gives 4 "classes" of lecturer:


Key: SP = Scholarly Practitioner; IP = Instructional Practitioner; SA = Scholarly Academic and PA = Practice Academic.

Clearly SAs are the traditional model of Research focused academics, able to command the title "Professor", be feted in International conferences, draw high salaries...  If they can communicate with mere earthlings in order to be effective teachers then that's a bonus.  SP's can also gain this academic high ground, through embracing the SA career path.  Often SAs have enough about them to communicate well with students and teach effectively - "real world" experience it is called - as if Business School s are not actually "the real world".

IPs and PAs, however, are the second class lecturers.  These are often effective and popular teachers, charged with student satisfaction, programme management and delivery, recruitment and retention etc.  Typically they do not enjoy the title of "Professor", do not draw high salaries but quietly ensure that the main source of revenue for the School (its student fees) are maintained.  And, let's not forget the administrative and support staff who sweep up after all of the academics.

When a successful Business School needs a mix of resources you would expect to see equal incentives and rewards for all of the AACSB categories - wouldn't you?

Thursday, 19 November 2015

Quick and dirty beats slow but measured feedback

Let me warm to the theme started in my last blog - the need for lecturers and students to know where the "goalposts" are in relation to assessments in their HE studies.
Clearly lecturers need to develop a clear, consistent, relevant, appropriate and communicated set of assessment criteria to allow their students to achieve the learning outcomes for the lesson, course or programme.  These can often be expanded to a range of descriptors that explain a particular level of achievement - such as the example from a FHEQ Level 6 taught module for the assessment criterion "Analysis / Discussion / Evaluation":

By selecting the descriptor for the chosen criterion the marker can begin to indicate the level of performance of the individual student.  There is also good scope to add some "feed forward", a suggestion, or two, about how the work could be improved.

So, for an assignment scoring 60 - 69% the feedback could be:

A good attempt to analyse or prioritise issues and to draw conclusions.  The example of XYZ corporation's new JIT system showed the key costs and benefits clearly.  To improve the work an example of JIT failing to work would give a more rounded picture.

So, well considered and well designed marking criteria, communicated at the outset, become the basis for clear feedback that can be made to have an individual focus for each student - as the following continuum shows:

Contrast this will the in-line comments on a script, the careful summary of points at the end of a piece of work.  Yes, it is less focused on the individual, yes, it can look like the tutor is using a mechanical way of marking but it does have the advantage of quicker turnaround for the student, efficiency for the marker and a clear and consistent set of standards - whether the paper is marked on a Monday morning or a Friday evening.

Wednesday, 11 November 2015

"Goal Line Technology" in Higher Education

So was Geoff Hurst's wonder goal in the 1966 World Cup final actually a goal?  English (and Russian standards say - "yes" but German standards say "no") - and all that had to be decided was whether a ball had gone over a line...

So how much more tricky is it for the University teacher to decide whether a piece of work meets the standard when there's so much more to it than simply going over a line on the grass.

Standards for Higher Education are set by articulating learning outcomes (intended learning outcomes (ILOs) , that is) for particular courses of study.  Often learning theories such as Bloom's Taxonomy of Learning Outcomes is used to show progression of achievement and expectation as studies progress.  These can include the ability to describe or explain, apply a concept, analyse and evaluate data or information and synthesise information from a number of sources.

So, when ILOs are articulated, it becomes relatively simple to design assessment that has the aim of assessing a student's ability to - describe, apply, analyse etc.  It then becomes simple to set the "goalposts" by writing and sharing with students the clear criteria to be used in assessing their work.  Students know what to aim for and teachers know what they are looking for (this becomes very important when marking a large cohort of students' work as part of a team of markers).  Further, ranges of achievement against specific criteria can be articulated.

Then, and here's the beauty of the scheme, feedback can be structured to respond to the student's abilities in that particular aspect of the criteria.  Feed-forward can show students how marks can be improved in the future.

If the 1966 World Cup happened today we would (just) have goal-line technology to determine whether England's third goal was actually a goal.  So why do University teachers still resemble the Russian linesman in the way that they make decisions?  Vague, uncertain, subjective - in fact no help to the students who should be learning through the whole experience.


Thursday, 5 November 2015

But will I ever have to write an essay after University?

Assessment in Higher Education has had a familiar feel and look for many years.  Whilst many disciplines focus on exams - although these have more to do with memory and the examiners sure knowledge that it is the unadulterated work of the individual student - others favour coursework.  But how often does that coursework take the form of a knowledge based test, an academic essay masquerading as an assignment or some steps in the preparation of a dissertation or research project?

Business programmes need to prepare students for business careers - where knowledge will not be remembered but "googled" as it goes out of date so swiftly - and the analysis carried out in order to compile a report, briefing or presentation.

Clear parallels exist between the business report or presentation and an academic assignment:

  • Both must be focused on a key issue,
  • Both must communicate their key message clearly,
  • Both must provide evidence to support claims and contentions,
  • Both must analyse the data and information researched,
  • Both must provide evaluation of the evidence in the form of a conclusion or recommendation
Authentic business mechanisms can readily be used to illustrate academic learning outcomes by teachers and lecturers familiar with "industry", "business practice" and "the real world".  It just needs a little thought, a little embedding of real business skills in the curriculum and a move away from the academic comfort zone of the quasi-thesis or mini-research article.

Authentic assessment is capable of measuring learning outcomes but is business education really authentic?  Check out the Key Information Set (KIS) for any "top" UK Business School and ask if coursework values below about 50% really represent authenticity?


Wednesday, 28 October 2015

Games students play

In my last blog I extolled the virtues of group work and even group assessment in Higher Education. Profit for learning but Pain for tutors.
Part of the pain involves the setting up of a system or process that either monitors individual effort within the group or allows students, through a peer review process, to influence and moderate the group mark so that individual contributions are recognised.
But let's now consider the students, themselves, the natural competition between humans, especially young ones and the desire to "win", the strategic approach to learning and anything to do with it, and the opportunity that group work, however carefully it is designed, provides for the achievement of individual objectives. Let us also consider the natural sense of justice and fairness that is embedded in most human nature and the potential for both punishment and forgiveness for group members. In short, Games that students can play.

Consider the following:

Free riders - perhaps the most obvious beneficiaries of group work. These students rely on the efforts of group members and their unwillingness to punish too harshly.

Dominators - those able to select weaker group members, dominate the group effort but exact unequal benefit by negotiating favourable peer review scores in exchange for better than expected group marks.

Collaborators - these students join "friendship" groups and agree that all members of the group will score each other equally in the peer review - whether this is justified by effort or not.

Traitors - those who agree scores with their group as collaborators but then cheat their friends in order to gain higher marks individually.

To avoid these issues, which happen rarely in practice, group work is often reduced in scope and impact in later stages of degree programmes. No one single mechanism for peer review will iron out all problems but perhaps that is just the point. To avoid the "learning effect", whereby the above student types "game" the peer review system, tutors need to deploy a variety of methods over time.

Tutors need to "game" the " gamers" to achieve the full benefits that collaborative learning can bring.

Thursday, 22 October 2015

Group work in Higher Education - Pain or Profit?

In most areas of my life I rely on other people:

  • A Family, where my long suffering wife contributes skills and attributes that I never perfected.
  • A Team, where work colleagues combine resources, talents and ideas to ensure that 2 + 2 equals much more than 5.
  • A work group, where we all learn from each other and modify our ideas to produce effective outcomes.
In each case I hope that I contribute my skills, ideas, talents and learning too...

So why should working in a group be so alien in Higher Education where students have an excellent opportunity to combine their skills, produce better work together than alone and undertake learning from each other?

The answer, I fear, is in the twin fears of:
  1.  the complexity of managing groups - they can go horribly wrong!!, and
  2. the nagging suspicion that lazy students can free-ride on the efforts of others.
There is PAIN in setting up, managing, supervising, marking and allocating individual marks to groups of students.  And the PAIN is normally up-front whereas PAIN from marking a summative exam or assignment from individuals is deferred.

But there is PROFIT too in enhanced learning, enhanced skills such as organisation, communication, negotiation and compromise.  PROFIT comes in the quality of the work too.  Well designed pieces of group work and well considered mechanisms for reflection and peer review can deliver higher quality outcomes for all students.

So, don't deny students the PROFIT because of the PAIN for the tutor.

Thursday, 15 October 2015

Old is the New New

Teaching awards are sprinkled liberally around many of our Higher Education institutions.  They celebrate and give a pat on the head to "creative" and "innovative" teachers (they sure ain't going to get paid more for mere teaching - so give them a prize and tell them how important they are).  But just what are these innovations in Higher Education?

Technology Enhanced Learning - that was what happened when Guttenberg printed the first Bible - is it innovative to simply use the current technology?

Authentic assessment - actually measuring what you set out to measure  - isn't that "common sense"?

Flipped Classrooms - does this mean reading the book before going to the "lecture" - I was doing that in the 1970's

Activity based Learning - now I remember that from Primary School!!

Good teaching is undertaken by engaged, informed and passionate communicators who succeed when they transform the lives of their learners.  There's nothing truly innovative about that - good teaching has always been good teaching.

Is good teaching actually innovative in many Universities?