Computer-based language assessment: The future is here

David Booth
David Booth
A blonde woman sat at a computer with headphones on in a room with more computers and desks in background

Many people are surprised at the idea of a computer program marking an exam paper. However, computer-based testing already exists in many different formats and many different areas. Many tests or exams that form part of our daily life are taken on computers. If you’ve ever learned to drive, sat a citizenship test, done a training course at work, or completed a placement test for a language course, the odds are that you’ve already taken an automated test.

Yet despite it being so common, there is still a lack of understanding when it comes to computer-based language assessment and how a computer can evaluate productive skills like speaking and writing.

Computer-based testing: a closer look

A common issue is that people have different ideas of what these tests entail. Computers can fulfill several essential roles in the testing process, but these often go unacknowledged. For example, a variety of test questions are needed to administer an exam, along with relevant data, and computers are used to store both the questions and the data. When it comes to creating randomized exams, computer software is used to select the exam questions, based on this data.

Computers can make complex calculations far more quickly and accurately than humans. This means that processes that previously took a long time are completed in days, rather than weeks.

Artificial intelligence (AI) technology is now capable of grading exam papers, for example. This means a shorter wait for exam results. In , candidates receive their results in an average of two days rather than waiting weeks for an examiner to mark their paper by hand.

The benefits for students and teachers

People take exams to prove their skills and abilities. Depending on their goals, the right result can open the door to many new opportunities, whether that is simply moving on to the next stage of a course, or something as life-changing as allowing you to take up your place on a university course in another country.

A qualification can act as a passport to a better career or an enhanced education, and for that reason, it’s important that both students and teachers can have faith in their results.

Computer programs have no inherent bias, which means that candidates can be confident that they will all be treated the same, regardless of their background, appearance or accent. , just one of ɫèAV’s computer-based exams, offers students the chance to score additional points on the exam with innovative integrated test items.

This integration means that the results are a far more accurate depiction of the candidate’s abilities and provide a truer reflection of their linguistic prowess.

More than questions on a screen

It’s not as easy as simply transferring the questions onto a computer screen. All that does is remove the need for pen and paper; this is a missed opportunity to harness the precision and speed of a computer, as well as its learning potential.

Tests that have been fully digitized, such as PTE Academic, benefit from that automation; eliminating examiner bias, making the test fairer and calculating the results more quickly. Automated testing builds on the technological tradition of opening doors for the future – not closing them.

How technology enhances language testing

The development of automated testing technologies doesn’t merely make the examination process quicker and more accurate – it also gives us the chance to innovate. Speaking assessments are an excellent example of this.

Previously, this part of a language exam involved an interview, led by an examiner, who asked questions and elicited answers. But now that we have the technological capability, using a computer offers students the chance to be tested on a much wider range of speaking skills, without worrying about the inherent bias of the examiner.

Indeed, the use of a computer-based system facilitates integrated skills testing. Traditionally, language exams had separate papers focusing on the four skills of reading, listening, speaking and writing. But the more modern concept of language testing aims to assess these linguistic skills used together, just as they are in real-life situations.

Afterwards, the various scores are categorized to allow learners an insight into their strengths and weaknesses, which helps both students and teachers identify areas which need improvement. This useful feedback is only possible because of the accuracy and detail of automated exam grading.

The space race on paper

Back in the 1960s, during the space race, computers were still a relatively new concept. Kathleen Johnson, one of the first African-American women to work for NASA as a scientist, was a mathematician with a reputation for doing incredibly complex manual calculations. Although computers had made the orbital calculations, the astronauts on the first space flight refused to fly until Kathleen had checked those calculations three times.

This anecdote reminds us that - although computer technology is an inherent part of everyday life - now and then, we still need to check that their systems are working as they should. Human error still comes into play – after all, humans program these systems.

PTE Academic – a fully digitized exam

Every stage of PTE Academic, from registration to practice tests to results (both receiving and sharing them with institutions) happens online. It may come as a surprise to learn that the test itself is not taken online. Instead, students attend one of over 295 test centers to take the exam, which comes with the highest levels of data security.

This means that each student can sit the exam in an environment designed for that purpose. It also allows the receiving institutions, such as universities and colleges, to be assured of the validity of the PTE Academic result.

The future is here

We created computers, but they have surpassed us in many areas – exam grading being a case in point. Computers can score more accurately and consistently than humans, and they don’t get tired late in the day, or become distracted by a candidate’s accent.

The use of AI technology to grade student responses represents a giant leap forward in language testing, leading to fairer and more accurate student results. It also means more consistency in grading which benefits the institutions, such as universities, which rely on these scores to accurately reflect ability.

And here at ɫèAV, we are invested in staying at the cutting edge of assessment. Our test developers are incorporating AI solutions now, using its learning capacity to create algorithms and build programs that can assess speaking and writing skills accurately and quickly. We’re expanding the horizons of English language assessment for students, teachers and all the other professionals involved in each stage of the language learning journey.

More blogs from ɫèAV

  • A  silohuette of a side profile of a womans head inside her head space is a ocean sunset

    Being bilingual can help keep your brain in good condition

    By Steffanie Zazulak

    Learning and understanding a new language is one of the most challenging things that your brain can do. But as well as the advantage of acquiring another language, it appears that the effort of giving your brain a good workout today by being bilingual could keep it in better condition in later life.

    Research led by Dr. Daniela Perani, a professor of psychology at in Milan, found that people who speak two or more languages seem to weather the ravages of Alzheimer’s disease better compared to people who have only mastered one language. Alzheimer’s is a progressive mental deterioration that can begin in middle or old age due to generalized brain degeneration.

    The study involved 85 people with Alzheimer’s – half of whom spoke both German and Italian and half who spoke only one language. The researchers found that bilingual patients had greater connectivity in key brain areas. This was especially in the part of the brain that governs “executive control” – a set of necessary behavioral cognitive processes that include problem-solving, working memory, reasoning and attentional control. The study also noted that the bilingual Alzheimer’s patients showed less severe symptoms of the disease.

    The study concluded: “Our findings suggest that the effects of speaking two languages are more powerful than both age and education in providing a protection against cognitive decline.”

    Bilingualism and the brain

    Although Alzheimer’s disease is currently incurable, the study supports a popular theory that people who have higher levels of education function longer with little manifestation of the illness. Part of the reason why bilingual brains may be better at resisting Alzheimer’s could be due to a lifetime of switching between languages daily.

    Learning and speaking more than one language changes how the brain carries out tasks that require focus and concentration on a certain piece of information without being distracted. It can also increase the density of white matter (connections) in the brain, meaning that there are more connections between brain parts, thus making this part of the brain more resistant to degeneration.

    This is supported by a study conducted by a team led by Professor Ana Inés Ansaldo at the , which suggests that bilingual people have more robust and more efficient brains compared to those who only speak one language. This is one of the reasons why a bilingual brain can be a buffer against aging and dementia.

    They recruited elderly people, half of whom spoke only one language and the other half who had learned a second language between the ages of 11 and 18. All performed equally well on a task that involved focusing on an object's color while ignoring its position, but brain scans revealed a big difference in how they processed the task.

    “While bilinguals were recruiting very specific brain areas and a small number of areas to perform the task, monolinguals were recruiting a much larger number of areas that were consuming much more resources. And the networks they were using were very, very complex,” says Professor Ansaldo. “That led us to think that the bilingual brain was more efficient in terms of the amount of resources that bilingual people require to do complex tasks as opposed to the monolingual brain.”

    The study concludes that bilingualism shapes the brain in a different way or how people approach complex tasks. It could be because bilinguals must inhibit the language they are not using to focus on the one that they are using.

  • A woman with glasses thinking with her hand to her mouth, stood in front of a pink background

    5 of the strangest English phrases explained

    By Steffanie Zazulak

    Here, we look at what some of the strangest English phrases mean – and reveal their origins…

    Bite the bullet

    Biting a bullet? What a strange thing to do! This phrase means you’re going to force yourself to do something unpleasant or deal with a difficult situation. Historically, it derives from the 19th century when a patient or soldier would clench a bullet between their teeth to cope with the extreme pain of surgery without anesthetic. A similar phrase with a similar meaning, “chew a bullet”, dates to the late 18th century.

    Use it: “I don’t really want to exercise today, but I’ll bite the bullet and go for a run.”

    Pigs might fly

    We all know that pigs can’t fly, so people use this expression to describe something that is almost certain never to happen. It is said that this phrase has been in use since the 1600s, but why pigs? An early version of the succinct “pigs might fly” was “pigs fly with their tails forward”, which is first found in a list of proverbs in the 1616 edition of John Withals’s English-Latin dictionary, A Shorte Dictionarie for Yonge Begynners: “Pigs fly in the ayre with their tayles forward.” Other creatures have been previously cited in similar phrases – “snails may fly”, “cows might fly”, etc, but it is pigs that have stood the test of time as the favored image of an animal that is particularly unsuited to flight! This phrase is also often used as a sarcastic response to mock someone’s credulity.

    Use it: “I might clean my bedroom tomorrow.” – “Yes, and pigs might fly.”

    Bob’s your uncle

    Even if you don’t have an uncle called Bob, you might still hear this idiom! Its origin comes from when Arthur Balfour was unexpectedly promoted to Chief Secretary for Ireland by the Prime Minister of Britain, Lord Salisbury, in 1900. Salisbury was Arthur Balfour’s uncle (possibly his reason for getting the job!) – and his first name was Robert. This phrase is used when something is accomplished or successful – an alternative to “…and that’s that”.

    Use it: “You’re looking for the station? Take a left, then the first right and Bob’s your uncle – you’re there!”

    Dead ringer

    This phrase commonly refers to something that seems to be a copy of something – mainly if someone looks like another person. The often-repeated story about the origin of this phrase is that many years ago, people were sometimes buried alive because they were presumed dead – when actually they were still alive. To prevent deaths by premature burial, a piece of string would supposedly be tied to the finger of someone being buried – and the other end would be attached to a bell above ground. If the person woke up, they would ring the bell – and the “dead” ringer would emerge looking exactly like someone buried only a few hours ago! Other stories point to the practice of replacing slower horses with faster horses – “ringers”. In this case, “dead” means “exact”.

    Use it: “That guy over there is a dead ringer for my ex-boyfriend.”

    Off the back of a lorry

    This is a way of saying that something was acquired that is probably stolen, or someone is selling something that’s stolen or illegitimate. It can also be used humorously to emphasize that something you bought was so cheap that it must have been stolen! “Lorry” is the British version – in the US, things fall off the back of “trucks”. An early printed version of this saying came surprisingly late in The Times in 1968. However, there are many anecdotal reports of the phrase in the UK from much earlier than that, and it is likely to date back to at least World War II. It’s just the sort of language that those who peddled illegal goods during and after WWII would have used.

    Use it: “I can’t believe these shoes were so cheap – they must have fallen off the back of a lorry.”

  • Two ladies in a pottery studio, one with a clipboard, both looking at a laptop together

    11 ways you can avoid English jargon at work

    By Steffanie Zazulak

    From “blue-sky thinking” to “lots of moving parts”, there are many phrases used in the office that sometimes seem to make little sense in a work environment. These phrases are known as ‘work jargon’ – or you might hear it referred to as ‘corporate jargon’, ‘business jargon’ or ‘management speak’. It’s a type of language generally used by a profession or group in the workplace, and has been created and evolved over time. And whether people use this work jargon to sound impressive or to disguise the fact that they are unsure about the subject they are talking about, it’s much simpler and clearer to use plain English. This will mean that more people understand what they are saying –both fluent and second-language English speakers.

    The preference for plain English stems from the desire for communication to be clear and concise. This not only helps fluent English speakers to understand things better, but it also means that those learning English pick up a clearer vocabulary. This is particularly important in business, where it’s important that all colleagues feel included as part of the team and can understand what is being said. This, in turn, helps every colleague feel equipped with the information they need to do their jobs better, in the language they choose to use.

    Here, we explore some of the most common examples of English jargon at work that you might hear and suggest alternatives you can use…

    Blue-sky thinking

    This refers to ideas that are not limited by current thinking or beliefs. It’s used to encourage people to be more creative with their thinking. The phrase could be confusing as co-workers may wonder why you’re discussing the sky in a business environment.

    Instead of: “This is a new client, so we want to see some blue-sky thinking.”

    Try saying: “This is a new client, so don’t limit your creativity.”

    Helicopter view

    This phrase is often used to mean a broad overview of the business. It comes from the idea of being a passenger in a helicopter and being able to see a bigger view of a city or landscape than if you were simply viewing it from the ground.Second-language English speakers might take the phrase literally, and be puzzled as to why someone in the office is talking about taking a helicopter ride.

    Instead of: “Here’s a helicopter view of the business.”

    Try saying: “This is a broad view of the business.”

    Get all your ducks in a row

    This is nothing to do with actual ducks; it simply means to be organized. While we don’t exactly know the origin of this phrase, it probably stems from actual ducklings that walk in a neat row behind their parents.

    Instead of: “This is a busy time for the company, so make sure you get all your ducks in a row.”

    Try saying: “This is a busy time for the company, so make sure you’re as organized as possible.”

    Thinking outside the box

    Often used to encourage people to use novel or creative thinking. The phrase is commonly used when solving problems or thinking of a new concept. The idea is that, if you’re inside a box, you can only see those walls and that might block you from coming up with the best solution.

    Instead of: “The client is looking for something extra special, so try thinking outside the box.”

    Try saying: “The client is looking for something extra special, so try thinking of something a bit different to the usual work we do for them.”

    IGUs (Income Generating Units)

    A college principal alerted us to this one – it refers to his students. This is a classic example of jargon when many more words are used than necessary.

    Instead of: “This year, we have 300 new IGUs.”

    Try saying: “This year, we have 300 new students.”

    Run it up the flagpole

    Often followed by “…and see if it flies” or “…and see if anyone salutes it”, this phrase is a way of asking someone to suggest an idea and see what the reaction is.

    Instead of: “I love your idea, run it up the flagpole and see if it flies.”

    Try saying: “I love your idea, see what the others think about it.”

    Swim lane

    A visual element – a bit like a flow chart –  that distinguishes a specific responsibility in a business organization. The name for a swim lane diagram comes from the fact that the information is broken up into different sections – or “lanes” – a bit like in our picture above.

    Instead of: “Refer to the swim lanes to find out what your responsibilities are.”

    Try saying: “Refer to the diagram/chart to find out what your responsibilities are.”

    Bleeding edge

    A way to describe something that is innovative or cutting edge. It tends to imply an even greater advancement of technology that is almost so clever that it is unbelievable in its current state.

    Instead of: “The new technology we have purchased is bleeding edge.”

    Try saying: “The new technology we have purchased is innovative.”

    Tiger team

    A tiger team is a group of experts brought together for a single project or event. They’re often assembled to assure management that everything is under control, and the term suggests strength.

    Instead of: “The tiger team will solve the problem.” 

    Try saying: “The experts will solve the problem.” 

    Lots of moving parts

    When a project is complicated, this phrase is sometimes used to indicate lots is going on.

    Instead of: “This project will run for several months and there are lots of moving parts to it.”

    Try saying: “This project will run for several months and it will be complicated.”

    A paradigm shift

    Technically, this is a valid way to describe changing how you do something and the model you use. The word “paradigm” (pronounced “para-dime”) is an accepted way or pattern of doing something. So the “shift” part means that a possible new way has been discovered. Second-language English speakers however, might not be familiar with the meaning and might be confused about what it actually means.

    Instead of: “To solve this problem, we need a paradigm shift.”

    Try saying: To solve this problem; we need to think differently.”