Computer-based language assessment: The future is here

David Booth
David Booth
A blonde woman sat at a computer with headphones on in a room with more computers and desks in background

Many people are surprised at the idea of a computer program marking an exam paper. However, computer-based testing already exists in many different formats and many different areas. Many tests or exams that form part of our daily life are taken on computers. If you’ve ever learned to drive, sat a citizenship test, done a training course at work, or completed a placement test for a language course, the odds are that you’ve already taken an automated test.

Yet despite it being so common, there is still a lack of understanding when it comes to computer-based language assessment and how a computer can evaluate productive skills like speaking and writing.

Computer-based testing: a closer look

A common issue is that people have different ideas of what these tests entail. Computers can fulfill several essential roles in the testing process, but these often go unacknowledged. For example, a variety of test questions are needed to administer an exam, along with relevant data, and computers are used to store both the questions and the data. When it comes to creating randomized exams, computer software is used to select the exam questions, based on this data.

Computers can make complex calculations far more quickly and accurately than humans. This means that processes that previously took a long time are completed in days, rather than weeks.

Artificial intelligence (AI) technology is now capable of grading exam papers, for example. This means a shorter wait for exam results. In , candidates receive their results in an average of two days rather than waiting weeks for an examiner to mark their paper by hand.

The benefits for students and teachers

People take exams to prove their skills and abilities. Depending on their goals, the right result can open the door to many new opportunities, whether that is simply moving on to the next stage of a course, or something as life-changing as allowing you to take up your place on a university course in another country.

A qualification can act as a passport to a better career or an enhanced education, and for that reason, it’s important that both students and teachers can have faith in their results.

Computer programs have no inherent bias, which means that candidates can be confident that they will all be treated the same, regardless of their background, appearance or accent. , just one of 色猫AV’s computer-based exams, offers students the chance to score additional points on the exam with innovative integrated test items.

This integration means that the results are a far more accurate depiction of the candidate’s abilities and provide a truer reflection of their linguistic prowess.

More than questions on a screen

It’s not as easy as simply transferring the questions onto a computer screen. All that does is remove the need for pen and paper; this is a missed opportunity to harness the precision and speed of a computer, as well as its learning potential.

Tests that have been fully digitized, such as PTE Academic, benefit from that automation; eliminating examiner bias, making the test fairer and calculating the results more quickly. Automated testing builds on the technological tradition of opening doors for the future – not closing them.

How technology enhances language testing

The development of automated testing technologies doesn’t merely make the examination process quicker and more accurate – it also gives us the chance to innovate. Speaking assessments are an excellent example of this.

Previously, this part of a language exam involved an interview, led by an examiner, who asked questions and elicited answers. But now that we have the technological capability, using a computer offers students the chance to be tested on a much wider range of speaking skills, without worrying about the inherent bias of the examiner.

Indeed, the use of a computer-based system facilitates integrated skills testing. Traditionally, language exams had separate papers focusing on the four skills of reading, listening, speaking and writing. But the more modern concept of language testing aims to assess these linguistic skills used together, just as they are in real-life situations.

Afterwards, the various scores are categorized to allow learners an insight into their strengths and weaknesses, which helps both students and teachers identify areas which need improvement. This useful feedback is only possible because of the accuracy and detail of automated exam grading.

The space race on paper

Back in the 1960s, during the space race, computers were still a relatively new concept. Kathleen Johnson, one of the first African-American women to work for NASA as a scientist, was a mathematician with a reputation for doing incredibly complex manual calculations. Although computers had made the orbital calculations, the astronauts on the first space flight refused to fly until Kathleen had checked those calculations three times.

This anecdote reminds us that - although computer technology is an inherent part of everyday life - now and then, we still need to check that their systems are working as they should. Human error still comes into play – after all, humans program these systems.

PTE Academic – a fully digitized exam

Every stage of PTE Academic, from registration to practice tests to results (both receiving and sharing them with institutions) happens online. It may come as a surprise to learn that the test itself is not taken online. Instead, students attend one of over 295 test centers to take the exam, which comes with the highest levels of data security.

This means that each student can sit the exam in an environment designed for that purpose. It also allows the receiving institutions, such as universities and colleges, to be assured of the validity of the PTE Academic result.

The future is here

We created computers, but they have surpassed us in many areas – exam grading being a case in point. Computers can score more accurately and consistently than humans, and they don’t get tired late in the day, or become distracted by a candidate’s accent.

The use of AI technology to grade student responses represents a giant leap forward in language testing, leading to fairer and more accurate student results. It also means more consistency in grading which benefits the institutions, such as universities, which rely on these scores to accurately reflect ability.

And here at 色猫AV, we are invested in staying at the cutting edge of assessment. Our test developers are incorporating AI solutions now, using its learning capacity to create algorithms and build programs that can assess speaking and writing skills accurately and quickly. We’re expanding the horizons of English language assessment for students, teachers and all the other professionals involved in each stage of the language learning journey.

More blogs from 色猫AV

  • Two ladies in a pottery studio, one with a clipboard, both looking at a laptop together

    11 ways you can avoid English jargon at work

    提交者 Steffanie Zazulak

    From “blue-sky thinking” to “lots of moving parts”, there are many phrases used in the office that sometimes seem to make little sense in a work environment. These phrases are known as ‘work jargon’ – or you might hear it referred to as ‘corporate jargon’, ‘business jargon’ or ‘management speak’. It’s a type of language generally used by a profession or group in the workplace, and has been created and evolved over time. And whether people use this work jargon to sound impressive or to disguise the fact that they are unsure about the subject they are talking about, it’s much simpler and clearer to use plain English. This will mean that more people understand what they are saying –?both fluent and second-language English speakers.

    The preference for?plain English?stems from the desire for communication to be clear and concise. This not only helps fluent English speakers to understand things better, but it also means that those learning English pick up a clearer vocabulary. This is particularly?important in business, where it’s important that all colleagues feel included as part of the team and can understand what is being said. This, in turn, helps every colleague feel equipped with the information they need to do their jobs better, in the language they choose to use.

    Here, we explore some of the most common examples of English jargon at work that you might hear and suggest alternatives you can use…

    Blue-sky thinking

    This refers to ideas that are not limited by current thinking or beliefs. It’s used to encourage people to be more creative with their thinking. The phrase could be confusing as co-workers may wonder why you’re discussing the sky in a business environment.

    Instead of:?“This is a new client, so we want to see some blue-sky thinking.”

    Try saying:?“This is a new client, so don’t limit your creativity.”

    Helicopter view

    This phrase is often used to mean a broad overview of the business. It comes from the idea of being a passenger in a helicopter and being able to see a bigger view of a city or landscape than if you were simply viewing it from the ground.?Second-language English speakers might take the phrase literally, and be puzzled as to why someone in the office is talking about taking a helicopter ride.

    Instead of:?“Here’s a helicopter view of the business.”

    Try saying:?“This is a broad view of the business.”

    Get all your ducks in a row

    This is nothing to do with actual ducks; it simply means to be organized. While we don’t exactly know the origin of this phrase, it probably stems from actual ducklings that walk in a neat row behind their parents.

    Instead of:?“This is a busy time for the company, so make sure you get all your ducks in a row.”

    Try saying:?“This is a busy time for the company, so make sure you’re as organized as possible.”

    Thinking outside the box

    Often used to encourage people to use novel or creative thinking. The phrase is commonly used when solving problems or thinking of a new concept. The idea is that, if you’re inside a box, you can only see those walls and that might block you from coming up with the best solution.

    Instead of:?“The client is looking for something extra special, so try thinking outside the box.”

    Try saying:?“The client is looking for something extra special, so try thinking of something a bit different to the usual work we do for them.”

    IGUs (Income Generating Units)

    A college principal alerted us to this one – it refers to his students. This is a classic example of jargon when many more words are used than necessary.

    Instead of:?“This year, we have 300 new IGUs.”

    Try saying:?“This year, we have 300 new students.”

    Run it up the flagpole

    Often followed by “…and see if it flies” or “…and see if anyone salutes it”, this phrase is a way of asking someone to suggest an idea and see what the reaction is.

    Instead of:?“I love your idea, run it up the flagpole and see if it flies.”

    Try saying:?“I love your idea, see what the others think about it.”

    Swim lane

    A visual element – a bit like a flow chart –? that distinguishes a specific responsibility in a business organization. The name for a?swim lane?diagram comes from the fact that the information is broken up into different sections – or “lanes” – a bit like in our picture above.

    Instead of:?“Refer to the swim lanes to find out what your responsibilities are.”

    Try saying:?“Refer to the diagram/chart to find out what your responsibilities are.”

    Bleeding edge

    A way to describe something that is innovative or cutting edge. It tends to imply an even greater advancement of technology that is almost so clever that it is unbelievable in its current state.

    Instead of:?“The new technology we have purchased is bleeding edge.”

    Try saying:?“The new technology we have purchased is innovative.”

    Tiger team

    A tiger team is a group of experts brought together for a single project or event. They’re often assembled to assure management that everything is under control, and the term suggests strength.

    Instead of:?“The tiger team will solve the problem.”?

    Try saying:?“The experts will solve the problem.”?

    Lots of moving parts

    When a project is complicated, this phrase is sometimes used to indicate lots is going on.

    Instead of:?“This project will run for several months and there are lots of moving parts to it.”

    Try saying:?“This project will run for several months and it will be complicated.”

    A paradigm shift

    Technically, this is a valid way to describe changing how you do something and the model you use. The word “paradigm” (pronounced “para-dime”) is an accepted way or pattern of doing something. So the “shift” part means that a possible new way has been discovered. Second-language English speakers however, might not be familiar with the meaning and might be confused about what it actually means.

    Instead of:?“To solve this problem, we need a paradigm shift.”

    Try saying:?To solve this problem; we need to think differently.”