Computer-based language assessment: The future is here

David Booth
David Booth
A blonde woman sat at a computer with headphones on in a room with more computers and desks in background

Many people are surprised at the idea of a computer program marking an exam paper. However, computer-based testing already exists in many different formats and many different areas. Many tests or exams that form part of our daily life are taken on computers. If you’ve ever learned to drive, sat a citizenship test, done a training course at work, or completed a placement test for a language course, the odds are that you’ve already taken an automated test.

Yet despite it being so common, there is still a lack of understanding when it comes to computer-based language assessment and how a computer can evaluate productive skills like speaking and writing.

Computer-based testing: a closer look

A common issue is that people have different ideas of what these tests entail. Computers can fulfill several essential roles in the testing process, but these often go unacknowledged. For example, a variety of test questions are needed to administer an exam, along with relevant data, and computers are used to store both the questions and the data. When it comes to creating randomized exams, computer software is used to select the exam questions, based on this data.

Computers can make complex calculations far more quickly and accurately than humans. This means that processes that previously took a long time are completed in days, rather than weeks.

Artificial intelligence (AI) technology is now capable of grading exam papers, for example. This means a shorter wait for exam results. In , candidates receive their results in an average of two days rather than waiting weeks for an examiner to mark their paper by hand.

The benefits for students and teachers

People take exams to prove their skills and abilities. Depending on their goals, the right result can open the door to many new opportunities, whether that is simply moving on to the next stage of a course, or something as life-changing as allowing you to take up your place on a university course in another country.

A qualification can act as a passport to a better career or an enhanced education, and for that reason, it’s important that both students and teachers can have faith in their results.

Computer programs have no inherent bias, which means that candidates can be confident that they will all be treated the same, regardless of their background, appearance or accent. , just one of ɫèAV’s computer-based exams, offers students the chance to score additional points on the exam with innovative integrated test items.

This integration means that the results are a far more accurate depiction of the candidate’s abilities and provide a truer reflection of their linguistic prowess.

More than questions on a screen

It’s not as easy as simply transferring the questions onto a computer screen. All that does is remove the need for pen and paper; this is a missed opportunity to harness the precision and speed of a computer, as well as its learning potential.

Tests that have been fully digitized, such as PTE Academic, benefit from that automation; eliminating examiner bias, making the test fairer and calculating the results more quickly. Automated testing builds on the technological tradition of opening doors for the future – not closing them.

How technology enhances language testing

The development of automated testing technologies doesn’t merely make the examination process quicker and more accurate – it also gives us the chance to innovate. Speaking assessments are an excellent example of this.

Previously, this part of a language exam involved an interview, led by an examiner, who asked questions and elicited answers. But now that we have the technological capability, using a computer offers students the chance to be tested on a much wider range of speaking skills, without worrying about the inherent bias of the examiner.

Indeed, the use of a computer-based system facilitates integrated skills testing. Traditionally, language exams had separate papers focusing on the four skills of reading, listening, speaking and writing. But the more modern concept of language testing aims to assess these linguistic skills used together, just as they are in real-life situations.

Afterwards, the various scores are categorized to allow learners an insight into their strengths and weaknesses, which helps both students and teachers identify areas which need improvement. This useful feedback is only possible because of the accuracy and detail of automated exam grading.

The space race on paper

Back in the 1960s, during the space race, computers were still a relatively new concept. Kathleen Johnson, one of the first African-American women to work for NASA as a scientist, was a mathematician with a reputation for doing incredibly complex manual calculations. Although computers had made the orbital calculations, the astronauts on the first space flight refused to fly until Kathleen had checked those calculations three times.

This anecdote reminds us that - although computer technology is an inherent part of everyday life - now and then, we still need to check that their systems are working as they should. Human error still comes into play – after all, humans program these systems.

PTE Academic – a fully digitized exam

Every stage of PTE Academic, from registration to practice tests to results (both receiving and sharing them with institutions) happens online. It may come as a surprise to learn that the test itself is not taken online. Instead, students attend one of over 295 test centers to take the exam, which comes with the highest levels of data security.

This means that each student can sit the exam in an environment designed for that purpose. It also allows the receiving institutions, such as universities and colleges, to be assured of the validity of the PTE Academic result.

The future is here

We created computers, but they have surpassed us in many areas – exam grading being a case in point. Computers can score more accurately and consistently than humans, and they don’t get tired late in the day, or become distracted by a candidate’s accent.

The use of AI technology to grade student responses represents a giant leap forward in language testing, leading to fairer and more accurate student results. It also means more consistency in grading which benefits the institutions, such as universities, which rely on these scores to accurately reflect ability.

And here at ɫèAV, we are invested in staying at the cutting edge of assessment. Our test developers are incorporating AI solutions now, using its learning capacity to create algorithms and build programs that can assess speaking and writing skills accurately and quickly. We’re expanding the horizons of English language assessment for students, teachers and all the other professionals involved in each stage of the language learning journey.

Explore our use of AI for our exams

More blogs from ɫèAV

  • Students sat together in a classroom working together

    Exploring the four Cs: Using future skills to unlock young learners’ potential

    By Annie Altamirano
    Reading time: 5 minutes

    What do we mean by future skills?

    The skills students will need in their future studies and careers are dramatically different from those required previously. Times are changing rapidly and educational institutions and teachers have a critical role to play in developing those skills in our young learners so that they are able to fulfill their potential and have bright futures ahead of them.

    These skills are referred to as future skills. There is no common consensus on how to define these skills but, broadly speaking, they can be grouped into four categories:

    1. Ways of thinking

    Skills in this category include critical thinking, creativity, innovation, problem solving, metacognition and learning skills.

    2. Ways of working

    Here, we’re talking about the skills of communication and collaboration.

    3. Tools for working

    Information literacy is an important 21st-century skill, as well as ICT literacy and citizenship, both global and local.

    4. Life skills

    The final category covers life and career skills, and is all about personal and social responsibility.

    One way you can encourage young learners to build these skills is through STEAM subjects (that’s science, technology, engineering, arts and math), which will equip them with functional skills such as organizing, planning, cognitive flexibility and self-regulation.

    The four Cs

    The four Cs refer to four important skills for young learners to master: communication, collaboration, critical thinking and creativity. These are essential, not just in an educational context, but in everyday life.

    Falling into the first two categories of future skills (ways of thinking and ways of working), these can help children build confidence and self-esteem. They also encourage healthy emotional development.

    So let’s take a closer look at the theory behind them.

    1. Communication

    We usually think of communication as speaking and listening, but it’s actually much broader than that. Communication encapsulates telling stories, reading, sharing ideas and experiences, body language, facial expression, eye contact and tone. Children learn to decipher the world around them by learning and practicing these skills.

    Strong communication skills, developed early, are directly related to their literacy success. These skills allow children to articulate their thoughts and ideas effectively, and listen to decode meaning. Students then begin to use communication for a range of purposes, and communicate effectively in diverse environments. Furthermore, developing strong patterns of verbal and non-verbal communication also fosters self-esteem and social skills.

    2. Collaboration

    Collaboration is how young children begin to build friendships with others. At first, young children will watch what others do and say, before moving on to playing together. As they get older, they become aware of other children’s feelings and ideas. Friendships become motivating and they learn how to make compromises and respect each other’s perspectives and skills.

    Collaboration is enhanced through group work and project-based activities, sharing time with peers. Children thrive when they feel valued by the people around them, not just adults but their peers too.

  • Business people stood together around a laptop in a office

    Learning English and employability

    By Tas Viglatzis
    Reading time: 4 minutes

    English not only opens up career opportunities beyond national borders; it is a key requirement for many jobs. It’s also no longer a case of just learning English for employability, but mastering English for business – and that means an on-going commitment to learn.

    My experience is consistent with this trend. If I had to estimate the value that being fluent in English has had on my career, I'd say it was my entire life’s earnings. Learning English has offered me educational options beyond the borders of my own country and enabled me to develop the skills to work for global companies that operate across national boundaries. I have been privileged to work in different countries in roles that have spanned functions, geographies and markets – and my ability to learn and evolve my English skills has been an underlying factor throughout.

  • A teacher showing her students a globe, with her students looking at the globe, one with a magnifying glass in hand.

    What’s it like to teach English in Turkey?

    By Steffanie Zazulak
    Reading time: 3 minutes

    Alice Pilkington qualified as a CELTA (Certificate in Teaching English to Speakers of Other Languages) certified teacher in October 2009. She started working in Rome before moving to Istanbul, where she’s spent the past three and a half years teaching English to “everyone from 8-year-olds to company executives; students to bored housewives”. Having taught in two very different countries to a diverse range of English learners, Alice shares with us the five lessons she’s learned:

    1. Don't take things personally when you're teaching English

    "I am probably not emotionally suited for this job. I take everything very personally and if a lesson goes wrong or an activity I have taken time and energy to plan doesn’t work, I feel like a complete failure. It’s a trial and error experience but when things go wrong, they can go very wrong, and it really makes you doubt your abilities as a teacher.

    Having said that, the lessons that do go well can make up for these negative feelings. I shouldn’t take things personally; the majority of my colleagues don’t and it saves them a lot of sleepless nights"

    2. Teaching English is incredibly rewarding

    "There are very few feelings that I’ve experienced that compare to seeing a student use a word that you have taught them – it makes you feel like a proud parent. Equally, seeing a student improve over a series of months is so joyful.I have been teaching English university preparation students for the past year.

    In September, they could barely say what their name was and what they did over the weekend. Nine months on and they’re capable of reading academic texts and speaking at length about marketing strategies and environmental problems. It’s a wonderful thing to observe"

    3. Teach more than just English

    "Turkish students love hearing about how you appreciate their food and cultural traditions. Equally, they are genuinely interested in understanding how things operate in the UK and enjoy hearing personal anecdotes.I tend to be very open with my students – even about my personal life.I think it is partly because I have striven from the very beginning of my career to be seen as their equal.

    Turkish students are used to having a huge respect for teachers, and there is a hierarchical system in schools here, which I can never go along with. In my first lesson with most students, I tell them that they must call me by my first name (usually you refer to teachers here as ‘hocam’ which means ‘my teacher’ and shows respect) and this can take a long while for them to get used to."

    4. Failure to prepare is to prepare for failure... or is it?

    "Lessons that you spend hours preparing for generally don’t go as well as you had hoped. There were several times when I’d spend hours cutting and sticking things on pieces of card and placing pictures all over the classroom, hoping it would get some vocabulary action going, only to start the class and receive no response from the students.

    Conversely, lessons where you don’t feel very motivated or have no idea what you are going to do until you get into the classroom (which I call the ‘flying by the seat of your pants’ lessons) can turn out to be the best ones. I once had a lesson in which I was, admittedly, rather hungover. On the way to the lesson, I grabbed a book called ‘Taboos and Issues’, full of discussion topics, which I used as a basis for a rather impromptu lesson on addictions, which was very successful indeed."

    5. Teaching English isn't easy

    "Teaching English is a love/hate profession. There are weeks when you absolutely loathe it and want to quit, but then within the space of a lesson or two, you get inspired by something completely unexpected, rediscover your joy for it and love it again."