Computer-based language assessment: The future is here

David Booth
David Booth
A blonde woman sat at a computer with headphones on in a room with more computers and desks in background

Many people are surprised at the idea of a computer program marking an exam paper. However, computer-based testing already exists in many different formats and many different areas. Many tests or exams that form part of our daily life are taken on computers. If you’ve ever learned to drive, sat a citizenship test, done a training course at work, or completed a placement test for a language course, the odds are that you’ve already taken an automated test.

Yet despite it being so common, there is still a lack of understanding when it comes to computer-based language assessment and how a computer can evaluate productive skills like speaking and writing.

Computer-based testing: a closer look

A common issue is that people have different ideas of what these tests entail. Computers can fulfill several essential roles in the testing process, but these often go unacknowledged. For example, a variety of test questions are needed to administer an exam, along with relevant data, and computers are used to store both the questions and the data. When it comes to creating randomized exams, computer software is used to select the exam questions, based on this data.

Computers can make complex calculations far more quickly and accurately than humans. This means that processes that previously took a long time are completed in days, rather than weeks.

Artificial intelligence (AI) technology is now capable of grading exam papers, for example. This means a shorter wait for exam results. In , candidates receive their results in an average of two days rather than waiting weeks for an examiner to mark their paper by hand.

The benefits for students and teachers

People take exams to prove their skills and abilities. Depending on their goals, the right result can open the door to many new opportunities, whether that is simply moving on to the next stage of a course, or something as life-changing as allowing you to take up your place on a university course in another country.

A qualification can act as a passport to a better career or an enhanced education, and for that reason, it’s important that both students and teachers can have faith in their results.

Computer programs have no inherent bias, which means that candidates can be confident that they will all be treated the same, regardless of their background, appearance or accent. , just one of ɫèAV’s computer-based exams, offers students the chance to score additional points on the exam with innovative integrated test items.

This integration means that the results are a far more accurate depiction of the candidate’s abilities and provide a truer reflection of their linguistic prowess.

More than questions on a screen

It’s not as easy as simply transferring the questions onto a computer screen. All that does is remove the need for pen and paper; this is a missed opportunity to harness the precision and speed of a computer, as well as its learning potential.

Tests that have been fully digitized, such as PTE Academic, benefit from that automation; eliminating examiner bias, making the test fairer and calculating the results more quickly. Automated testing builds on the technological tradition of opening doors for the future – not closing them.

How technology enhances language testing

The development of automated testing technologies doesn’t merely make the examination process quicker and more accurate – it also gives us the chance to innovate. Speaking assessments are an excellent example of this.

Previously, this part of a language exam involved an interview, led by an examiner, who asked questions and elicited answers. But now that we have the technological capability, using a computer offers students the chance to be tested on a much wider range of speaking skills, without worrying about the inherent bias of the examiner.

Indeed, the use of a computer-based system facilitates integrated skills testing. Traditionally, language exams had separate papers focusing on the four skills of reading, listening, speaking and writing. But the more modern concept of language testing aims to assess these linguistic skills used together, just as they are in real-life situations.

Afterwards, the various scores are categorized to allow learners an insight into their strengths and weaknesses, which helps both students and teachers identify areas which need improvement. This useful feedback is only possible because of the accuracy and detail of automated exam grading.

The space race on paper

Back in the 1960s, during the space race, computers were still a relatively new concept. Kathleen Johnson, one of the first African-American women to work for NASA as a scientist, was a mathematician with a reputation for doing incredibly complex manual calculations. Although computers had made the orbital calculations, the astronauts on the first space flight refused to fly until Kathleen had checked those calculations three times.

This anecdote reminds us that - although computer technology is an inherent part of everyday life - now and then, we still need to check that their systems are working as they should. Human error still comes into play – after all, humans program these systems.

PTE Academic – a fully digitized exam

Every stage of PTE Academic, from registration to practice tests to results (both receiving and sharing them with institutions) happens online. It may come as a surprise to learn that the test itself is not taken online. Instead, students attend one of over 295 test centers to take the exam, which comes with the highest levels of data security.

This means that each student can sit the exam in an environment designed for that purpose. It also allows the receiving institutions, such as universities and colleges, to be assured of the validity of the PTE Academic result.

The future is here

We created computers, but they have surpassed us in many areas – exam grading being a case in point. Computers can score more accurately and consistently than humans, and they don’t get tired late in the day, or become distracted by a candidate’s accent.

The use of AI technology to grade student responses represents a giant leap forward in language testing, leading to fairer and more accurate student results. It also means more consistency in grading which benefits the institutions, such as universities, which rely on these scores to accurately reflect ability.

And here at ɫèAV, we are invested in staying at the cutting edge of assessment. Our test developers are incorporating AI solutions now, using its learning capacity to create algorithms and build programs that can assess speaking and writing skills accurately and quickly. We’re expanding the horizons of English language assessment for students, teachers and all the other professionals involved in each stage of the language learning journey.

More blogs from ɫèAV

  • a hand reaching for a book from a bookshelf

    9 great novels to help improve your English

    By Steffanie Zazulak

    Reading is one of the most fun and effective ways to help improve your English language skills. It can help to expand your vocabulary and expose you to different sentence structures, all while you enjoy some wonderful stories.

    E-readers and tablets make learning English even easier because if you don’t know a word, you can click on it to read its definition. On the Kindle, you can even add new words you’ve learnt to its Vocabulary Builder feature, which is stored on the device. Others recommend listening to and reading text at the same time as an excellent way to enhance the learning process. Kindle’s Whispersync for Voice is designed for just this purpose and includes audio with selected books, so you can listen and follow the text as you read.

    9 great novels to help improve your English

    Below, we reveal nine novels, including William Golding’s Lord of the Flies and George Orwell’s Animal Farm, to help improve your English.

    1. The Wind in the Willows – Kenneth Grahame

    This classic tale takes place in the English countryside and shares the adventures of the animals that live by the river. Grahame’s simple use of language with imaginative stories makes this a pleasurable read for adults and children.

    2. Lord of the Flies – William Golding

    This book is a modern classic and a popular study text for schools all over the world. When a group of boys are isolated on a desert island, the society they create descends into ruthless behavior. Golding uses dramatic and descriptive language, almost like poetry, making you feel like you’re in the scenes yourself.

    3. The Old Man and the Sea – Ernest Hemingway

    Ernest Hemingway is well-known for his clear, straightforward writing style and short sentence structure, which is great for English language learners and many people have read it in school. It’s the courageous tale of a Cuban fisherman and his battle to land a giant marlin and it’s a perfect introduction to Hemingway as an author.

  • A Young woman smiling and gesturing at her friend

    Improve your English without saying a word

    By Steffanie Zazulak

    Communicating in English goes far beyond simply learning English vocabulary. In fact, there are many non-verbal strategies you can leverage to appear more confident as you improve your English. Below you’ll find three of the most important aspects of non-verbal communication to work on:

    Make eye contact when you speak in English

    When you’re talking to someone, it’s best to look them in the eye as much as possible. This shows that you are engaged in the conversation and listening intently when not speaking. Especially in loud environments, you may find your eyes drawn to someone’s lips as they talk. While it may help you better understand what they’re saying in a noisy place, like a restaurant, aim to maintain eye contact as much as you can (but do remember to take a quick break away once in a while so as to not stare too intently).

    Be mindful of body language

    What you’re doing with your hands and the facial expressions you make can say a lot—sometimes more than words! Not only should you be aware of the body language of who you’re talking with, but you also need to know what your body language is saying about you. Different cultures see hand gestures differently so it's good to be mindful of what gestures you make with your hands. If you want to appear open and friendly you may want to keep your arms open and avoid closed body language like crossing your arms.

    If someone is leaning away from you slightly, this may indicate they aren’t interested in the topic you’re speaking about. They may lean in closer if more interested in what you're talking about. If they smile a lot, this may mean they agree with you.

    Prepare yourself for English conversations you may have

    If you are planning to practice talking in English, it’s OK to prepare yourself for the conversation. Create a script for yourself to speak from that allows you to practice difficult terms and phrases. Not only will this give you real-time experience bettering your skills, but it will allow you to speak English with confidence.

    Either in work situations or casual conversations, there’s more than just English words being exchanged so remember to dedicate your full attention. It’s an excellent opportunity to practice and improve your English skills and you’re likely to learn more than just studying on your own.

  • A group of young people sat at a table drinking and eating

    How the English language has changed over the decades

    By Steffanie Zazulak

    All languages change over time, and there can be many different reasons for this. The English language is no different – but why has it changed over the decades?

    Some of the main influences on the evolution of languages include:

    • The movement of people across countries and continents, for example, migration and, in previous centuries, colonization. For example, English speakers today would probably be comfortable using the Spanish word 'loco' to describe someone who is 'crazy'.
    • Speakers of one language coming into contact with those who speak a different one. No two individuals speak identically: people from different geographical places clearly speak differently and even within the same community there are variations according to a speaker’s age, gender, ethnicity and social and educational background. For example, the word 'courting' has become 'dating'.
    • New vocabulary required for inventions such as transport, domestic appliances and industrial equipment, or for sporting, entertainment, cultural and leisure reasons. For example, the original late 19th century term 'wireless' has become today’s 'radio'.

    Due to these influences, a language always embraces new words, expressions and pronunciations as people come across new words and phrases in their day-to-day lives and integrate them into their own speech.

    What changes has the English language seen?

    As the English language has changed, it’s been easy to pick out words that pass into common usage. Here at ɫèAV English, we have explored some of these recent changes to the English language. The rise in popularity of internet slang has seen phrases such as 'LOL' (Laugh Out Loud), 'FOMO' (Fear Of Missing Out) and 'fam' (an abbreviated form of family) become firmly embedded in the English language over the past ten years.

    Every decade sees new slang terms like these appearing in the English language. And while some words or abbreviations do come from internet or text conversations, others may appear as entirely new words, a new meaning for an existing word, or a word that becomes more generalized than its former meaning, brought about by any one of the reasons above. Decades ago, 'blimey' was a new expression of surprise, but more recently 'woah' is the word in everyday usage.

    Sentence structure is of course, another change to the English language. Decades ago, it would have been normal to ask 'Have you a moment?' Now, you might say 'D’you have a sec?' Similarly, 'How do you do?' has become 'How’s it going?' Not only have the sentences been abbreviated, but new words have been introduced to everyday questions.

    Connected to this is the replacement of certain words with other, more modern versions. It’s pretty noticeable that words like 'shall' and 'ought' are on the way out, but 'will', 'should' and 'can' are doing just fine.

    Other changes can be more subtle. Many verbs can take a compliment with another verb in either the '-ing' form or the 'to' form, for example, 'they liked painting/to paint', 'we tried leaving/to leave', or 'he didn’t bother calling/to call'. Both of these constructions are still used and have been for a long time, but there has been a steady shift over time from the 'to' to the '-ing' compliment.

    What do the changes mean?

    There are many other changes to the English language – what have you noticed? Have these changes affected your teaching or learning methods?Ìý

    Most contemporary linguistic commentators accept that change in language, like change in society, is inevitable. Some think that is regrettable, but others recognize it as a reinvigoration of a language, bringing alternatives that allow subtle differences of expression.

    Linguist, writer and lecturer David Crystal considers whether 'text speak' is undermining the English language. His response to the naysayers who claim it is damaging the English language is to point out that abbreviations have been around for a long time. While some, such as the ones we discussed above, are new, others, such as the use of 'u' for 'you' and the number 8 as a syllable in 'later', have been around for a century or more. Further to this, research shows that there is a correlation between the ability to use abbreviations and the ability to spell. After all, in order to abbreviate, you have to know which letters to abbreviate.

    As with everything, change isn’t necessarily a bad thing and, as the needs of English language users continue to change, so will the language.

    Fancy learning more about English? Check out our post 'How do English phrases travel across countries?'.