Computer-based language assessment: The future is here

David Booth
David Booth
A blonde woman sat at a computer with headphones on in a room with more computers and desks in background

Many people are surprised at the idea of a computer program marking an exam paper. However, computer-based testing already exists in many different formats and many different areas. Many tests or exams that form part of our daily life are taken on computers. If you’ve ever learned to drive, sat a citizenship test, done a training course at work, or completed a placement test for a language course, the odds are that you’ve already taken an automated test.

Yet despite it being so common, there is still a lack of understanding when it comes to computer-based language assessment and how a computer can evaluate productive skills like speaking and writing.

Computer-based testing: a closer look

A common issue is that people have different ideas of what these tests entail. Computers can fulfill several essential roles in the testing process, but these often go unacknowledged. For example, a variety of test questions are needed to administer an exam, along with relevant data, and computers are used to store both the questions and the data. When it comes to creating randomized exams, computer software is used to select the exam questions, based on this data.

Computers can make complex calculations far more quickly and accurately than humans. This means that processes that previously took a long time are completed in days, rather than weeks.

Artificial intelligence (AI) technology is now capable of grading exam papers, for example. This means a shorter wait for exam results. In , candidates receive their results in an average of two days rather than waiting weeks for an examiner to mark their paper by hand.

The benefits for students and teachers

People take exams to prove their skills and abilities. Depending on their goals, the right result can open the door to many new opportunities, whether that is simply moving on to the next stage of a course, or something as life-changing as allowing you to take up your place on a university course in another country.

A qualification can act as a passport to a better career or an enhanced education, and for that reason, it’s important that both students and teachers can have faith in their results.

Computer programs have no inherent bias, which means that candidates can be confident that they will all be treated the same, regardless of their background, appearance or accent. , just one of 色猫AV’s computer-based exams, offers students the chance to score additional points on the exam with innovative integrated test items.

This integration means that the results are a far more accurate depiction of the candidate’s abilities and provide a truer reflection of their linguistic prowess.

More than questions on a screen

It’s not as easy as simply transferring the questions onto a computer screen. All that does is remove the need for pen and paper; this is a missed opportunity to harness the precision and speed of a computer, as well as its learning potential.

Tests that have been fully digitized, such as PTE Academic, benefit from that automation; eliminating examiner bias, making the test fairer and calculating the results more quickly. Automated testing builds on the technological tradition of opening doors for the future – not closing them.

How technology enhances language testing

The development of automated testing technologies doesn’t merely make the examination process quicker and more accurate – it also gives us the chance to innovate. Speaking assessments are an excellent example of this.

Previously, this part of a language exam involved an interview, led by an examiner, who asked questions and elicited answers. But now that we have the technological capability, using a computer offers students the chance to be tested on a much wider range of speaking skills, without worrying about the inherent bias of the examiner.

Indeed, the use of a computer-based system facilitates integrated skills testing. Traditionally, language exams had separate papers focusing on the four skills of reading, listening, speaking and writing. But the more modern concept of language testing aims to assess these linguistic skills used together, just as they are in real-life situations.

Afterwards, the various scores are categorized to allow learners an insight into their strengths and weaknesses, which helps both students and teachers identify areas which need improvement. This useful feedback is only possible because of the accuracy and detail of automated exam grading.

The space race on paper

Back in the 1960s, during the space race, computers were still a relatively new concept. Kathleen Johnson, one of the first African-American women to work for NASA as a scientist, was a mathematician with a reputation for doing incredibly complex manual calculations. Although computers had made the orbital calculations, the astronauts on the first space flight refused to fly until Kathleen had checked those calculations three times.

This anecdote reminds us that - although computer technology is an inherent part of everyday life - now and then, we still need to check that their systems are working as they should. Human error still comes into play – after all, humans program these systems.

PTE Academic – a fully digitized exam

Every stage of PTE Academic, from registration to practice tests to results (both receiving and sharing them with institutions) happens online. It may come as a surprise to learn that the test itself is not taken online. Instead, students attend one of over 295 test centers to take the exam, which comes with the highest levels of data security.

This means that each student can sit the exam in an environment designed for that purpose. It also allows the receiving institutions, such as universities and colleges, to be assured of the validity of the PTE Academic result.

The future is here

We created computers, but they have surpassed us in many areas – exam grading being a case in point. Computers can score more accurately and consistently than humans, and they don’t get tired late in the day, or become distracted by a candidate’s accent.

The use of AI technology to grade student responses represents a giant leap forward in language testing, leading to fairer and more accurate student results. It also means more consistency in grading which benefits the institutions, such as universities, which rely on these scores to accurately reflect ability.

And here at 色猫AV, we are invested in staying at the cutting edge of assessment. Our test developers are incorporating AI solutions now, using its learning capacity to create algorithms and build programs that can assess speaking and writing skills accurately and quickly. We’re expanding the horizons of English language assessment for students, teachers and all the other professionals involved in each stage of the language learning journey.

More blogs from 色猫AV

  • A overhead shot of a group of people working at a desk with papers and notebooks

    5 ways to make studying in a group work for you

    提交者 Steffanie Zazulak

    There are many benefits to studying in a group, ranging from reducing procrastination and boosting your confidence to gaining new perspectives and learning faster. Many English language learners enjoy working in a group, and many English language teachers recommend it. Here’s how to make studying in a group work for you or your students…

    1. Create an effective group

    Even though you love spending time with your friends, don’t base study partners on friendship. Instead, look for people who stay alert in class, take notes, ask questions, and respond to the teacher’s questions – and don’t make the group too big. An ideal size for a study group is three or four students.

    It’s a great idea to try to meet on the same day and time each week because treating the study session as you would a class helps you to keep to a schedule and ensure that everyone attends.

    Finally, hold study group sessions in a place free of distractions with room to spread out the materials. This will help to ensure that you don’t end up talking about the latest movies or songs instead of studying the future tense!

    2. Decide on the topics and set goals

    Before your study group, think about the topics you’d like to discuss – then agree on one. This will help you concentrate on that topic without straying away. Once you’ve decided on your subject, also consider what you want to achieve at each session – but don’t take on too much material for one session.

    For example, if you’re using a novel written in English to learn more about the language, just think about one aspect of it, such as a couple of the characters, rather than trying to discuss the entire book.

    3. Prepare effectively

    Before attending your study group, prepare by reading more about or researching the topic you’re all going to discuss.

    Also, make a list of anything you aren’t sure you understand so that you can discuss it with your fellow learners. There are sure to be different things you all need explaining in more detail, so you can help each other to understand. Which leads us on to…

    4. Learn from each other by communicating well

    Communicate openly – it doesn’t matter if one of you doesn’t understand something or needs more explanation. And don’t be shy about asking for your peers’ feedback: “Am I talking too much?” or “Did I present your point of view correctly?”. It is often said that it is best to teach other material you understand, and learn from others who understand the material better than you do.

    If your study session reveals points of disagreement or confusion that you cannot resolve as a group, make a note of it and ask your teacher.

    5. Make it enjoyable

    Last on the list, but very important: try to make studying enjoyable in whatever way you can by keeping it interesting. Pick novels about subjects you all really enjoy reading about. Go to see an English-speaking movie together and discuss it at your study group. Or try a quiz together (online or in person) to see how you've picked the subject matter up.?

  • a hand reaching for a book from a bookshelf

    9 great novels to help improve your English

    提交者 Steffanie Zazulak

    Reading is one of the most fun and effective ways to help improve your English language skills. It can help to expand your vocabulary and expose you to different sentence structures, all while you enjoy some wonderful stories.

    E-readers and tablets make learning English even easier because if you don’t know a word, you can click on it to read its definition. On the Kindle, you can even add new words you’ve learnt to its Vocabulary Builder feature, which is stored on the device. Others recommend listening to and reading text at the same time as an excellent way to enhance the learning process. Kindle’s Whispersync for Voice is designed for just this purpose and includes audio with selected books, so you can listen and follow the text as you read.

    9 great novels to help improve your English

    Below, we reveal nine novels, including William Golding’s Lord of the Flies and George Orwell’s Animal Farm, to help improve your English.

    1. The Wind in the Willows – Kenneth Grahame

    This classic tale takes place in the English countryside and shares the adventures of the animals that live by the river. Grahame’s simple use of language with imaginative stories makes this a pleasurable read for adults and children.

    2. Lord of the Flies – William Golding

    This book is a modern classic and a popular study text for schools all over the world. When a group of boys are isolated on a desert island, the society they create descends into ruthless behavior. Golding uses dramatic and descriptive language, almost like poetry, making you feel like you’re in the scenes yourself.

    3. The Old Man and the Sea – Ernest Hemingway

    Ernest Hemingway is well-known for his clear, straightforward writing style and short sentence structure, which is great for English language learners and many people have read it in school. It’s the courageous tale of a Cuban fisherman and his battle to land a giant marlin and it’s a perfect introduction to Hemingway as an author.

  • A Young woman smiling and gesturing at her friend

    Improve your English without saying a word

    提交者 Steffanie Zazulak

    Communicating in English goes far beyond simply learning English vocabulary. In fact, there are many non-verbal strategies you can leverage to appear more confident as you improve your English. Below you’ll find three of the most important aspects of non-verbal communication to work on:

    Make eye contact when you speak in English

    When you’re talking to someone, it’s best to look them in the eye as much as possible. This shows that you are engaged in the conversation and listening intently when not speaking. Especially in loud environments, you may find your eyes drawn to someone’s lips as they talk. While it may help you better understand what they’re saying in a noisy place, like a restaurant, aim to maintain eye contact as much as you can (but do remember to take a quick break away once in a while so as to not stare too intently).

    Be mindful of body language

    What you’re doing with your hands and the facial expressions you make can say a lot—sometimes more than words! Not only should you be aware of the body language of who you’re talking with, but you also need to know what your body language is saying about you. Different cultures see hand gestures differently so it's good to be mindful of what gestures you make with your hands. If you want to appear open and friendly you may want to keep your arms open and avoid closed body language like crossing your arms.

    If someone is leaning away from you slightly, this may indicate they aren’t interested in the topic you’re speaking about. They may lean in closer if more interested in what you're talking about. If they smile a lot, this may mean they agree with you.

    Prepare yourself for English conversations you may have

    If you are planning to practice talking in English, it’s OK to prepare yourself for the conversation. Create a script for yourself to speak from that allows you to practice difficult terms and phrases. Not only will this give you real-time experience bettering your skills, but it will allow you to speak English with confidence.

    Either in work situations or casual conversations, there’s more than just English words being exchanged so remember to dedicate your full attention. It’s an excellent opportunity to practice and improve your English skills and you’re likely to learn more than just studying on your own.