Advanced Evaluation

Advanced Evaluation According to the OSI Model

Graham Tritt 2002 - 2004

What is wrong with the usual way of evaluating?

The standard toastmasters method is a mixture of comments on all aspects of a presentation. It is only ordered by a theme or the desire to sequence the positive, constructive and motivating points.

However, it is awkward, for instance, to praise body language when speech organisation is poor, or to criticize voice usage when it would be much more useful to give advice related to the message of the speaker.

An advanced speaker often gives a meaningful and motivating speeceh, and wishes more feedback on the emotional aspects than on the technical quality.

We need a way to separate the evaluations of delivery, content and message, so that we can assist a speaker fairly in each, relative to their importance.

What is Advanced Evaluation

Advanced Evaluation, according to my definition, uses a standard model of communication to enable constructive comment on all aspects of a presentation.

I base my guidelines on the most well-known model of communication, the International Standards Organisation model for Open Systems Interconnection, called ISO OSI for short.

The ISO OSI Model

The layers of the ISO model are defined as the following.

1 physical
2 datalink
3 network
4 transport
5 presentation
6 session
7 application

Two systems communicate at each level.

Communication at any level requires that the link at the lower level is working, for instance, it is no use speaking to a large audience if the microphone is not working.

The ISO OSI Model in detail

For more information, consult any technical description of the OSI model. The above diagram is for instance from Novell.

Layers of Communication in the Scenario of Speech Presentation

We can relate the OSI layers to aspects of communication between speaker and audience. We can separate aspects of communication according to the OSI model and evauate them independently.

Using the list below, the advanced evaluator can make notes on a presentation, including good points, weak areas, and ideas to help improvement.

1 physical
- is the room ready, is all equipment working
- is the program schedule in order
- is the speaker dressed appropriately
2 datalink
- is the microphone working, are visual aids readable
- does the speaker use the podium and the available space well
- does he have eye contact with the audience
3 network
- are words chosen well, is pronunciation clear
- are the visual aids appropriate
- is the language appropriate to speaker and audience
- how is the use of voice and body language
4 transport
- is the presentation well structured
- does the opening make the organisation clear
- does the ending sum up and conclude well
- did the audience receive all of the presentation
5 presentation
- comment on the delivery - voice, body language, etc
- in the usual way
6 session
- was the introducton to the speaker and of the speech done well
- is the opening make the aim fof the speaker clear
- is the content well-organised, the planning clear
- was the speaker thanked appropriately
7 application
- is the aim clear and worthy
- does the message get across, does the speeceh have the desired effect
- is there persuasion or motivation of the audience

We give feedback on each aspect according to its importance to the speaker and our audience.

Note that this division assists to build a complete evaluation, however an evaluation speech may contain just the important points and may follow an overall theme.

Conclusion

By following the principles of Advanced Evaluation, and using the guidelines above, an evaluator can improve the quality of the evaluation, which then is more useful to advanced speakers.