The role of AI in English assessment

Jennifer Manning
A woman holding a tablet stood in a server room

Digital assessment is becoming more and more widespread in recent years. But what¡¯s the role of digital assessment in teaching today? We¡¯d like to give you some insight into digital assessment and automated scoring.

Just a few years ago, there may have been doubts about the role of AI in English assessment and the ability of a computer to score language tests accurately. But today, thousands of teachers worldwide use automated language tests to assess their students¡¯ language proficiency.

For example, ɫèAV¡¯s suite of Versant tests have been delivering automated language assessments for nearly 25 years. And since its launch in 1996, over 350 million tests have been scored. The same technology is used in ɫèAV¡¯s Benchmark and Level tests.

So what makes automated scoring systems so reliable?

Huge data sets of exam answers and results are used to train artificial intelligence machine learning technology to score English tests the same way that human markers do. This way, we¡¯re not replacing human judgment; we¡¯re just teaching computers to replicate it.

Of course, computers are much more efficient than humans. They don¡¯t mind monotonous work and don¡¯t make mistakes (the standard marking error of an AI-scored test is lower than that of a human-scored test). So we can get unbiased, accurate, and consistent scores.

The top benefits of automated scoring are speed, reliability, flexibility, and free from bias.

Speed

The main advantage computers have over humans is that they can quickly process complex information. Digital assessments can often provide an instant score turnaround. We can get accurate, reliable results within minutes. And that¡¯s not just for multiple-choice answers but complex responses, too.

The benefit for teachers and institutions is that they can have hundreds, thousands, or tens of thousands of learners taking a test simultaneously and instantly receive a score.

The sooner you have scores, the sooner you can make decisions about placement and students¡¯ language level or benchmark a learner¡¯s strengths and weaknesses and make adjustments to learning that drive improvement and progress.

Flexibility

The next biggest benefit of digital assessment is flexible delivery models. This has become increasingly more important since online learning has become more prominent.

Accessibility became key: how can your institution provide access to assessment for your learners, if you can¡¯t deliver tests on school premises?

The answer is digital assessment.

For example, Versant, our web-based test can be delivered online or offline, on-site or off-site. All test-takers need is a computer and a headset with a microphone. They can take the test anywhere, any time of day, any day of the week, making it very flexible to fit into someone's schedule or situation.?

Free from bias

Impartiality is another important benefit of AI-based scoring. The AI engine used to score digital proficiency tests is completely free from bias. It doesn¡¯t get tired, and it doesn¡¯t have good and bad days like human markers do. And it doesn¡¯t have a personality.

While some human markers are more generous and others are more strict, AI is always equally fair. Thanks to this, automated scoring provides consistent, standardized scores, no matter who¡¯s taking the test.

If you¡¯re testing students from around the world, with different backgrounds, they will be scored solely on their level of English, in a perfectly objective way.

Additional benefits of automated scoring are security and cost.

Security

Digital assessments are more difficult to monitor than in-person tests, so security is a valid concern. One way to deal with this is remote monitoring.

Remote proctoring adds an extra layer of security, so test administrators can be confident that learners taking the test from home don¡¯t cheat.

For example, our software captures a video of test takers, and the AI detection system automatically flags suspicious test-taker behavior. Test administrators can access the video anytime for audits and reviews, and easily find suspicious segments highlighted by our AI.

Here are a few examples of suspicious behavior that our system might flag:

Image monitoring:

  • A different face or multiple faces appearing in the frame
  • Camera blocked

Browser monitoring:

  • Navigating away from the test window or changing tabs multiple times

Video monitoring:

  • Test taker moving out of camera view
  • More than one person in the camera view
  • Looking away from the camera multiple times

Cost

Last but not least, the cost of automated English certifications are a benefit. Indeed, automated scoring can be a more cost-effective way of monitoring tests, primarily because it saves time and resources.

ɫèAV English proficiency assessments are highly scalable and don¡¯t require extra time from human scorers, no matter how many test-takers you have.

Plus, there¡¯s no need to spend time and money on training markers or purchasing equipment.

AI is helping to lead the way with efficient, accessible, fair and cost-effective English test marking/management. Given time it should develop even further, becoming even more advanced and being of even more help within the world of English language learning and assessments.?

More blogs from ɫèAV

  • A group of business people stood around a board with sticky notes on smiling

    Craft the perfect job description: Ensure your candidates have the right English proficiency

    By Samantha Ball
    Reading time: 3 minutes

    English is the international language of business and a foundational skill for many roles. The right level of English proficiency is key for individuals and businesses to excel.

    But what is the ¡°right¡± level?

    English is not a one-size-fits-all skill. Customer Service Representatives need different English skills to IT Systems Managers. Senior staff will often need more advanced English skills than junior staff.

  • A group of students sat together in a library around a laptop smiling

    Forgetting to remember ¨C What active recall is all about

    By Heath Pulliam
    Reading time: 5 minutes

    Heath Pulliam is an independent education writer with a focus on the language learning space. He¡¯s taught English in South Korea and various subjects in the United States to a variety of ages. He¡¯s also a language learning enthusiast and studies Spanish in his free time.

    Almost everyone has studied for a test at some point in their life. Have you ever studied a lot for a test and still not received a great grade? Probably so. This is because not all study methods are created equal. Just because you¡¯ve ¡®studied¡¯ doesn¡¯t necessarily mean that the material has stuck in your brain.

    Some common study methods don¡¯t do as much as you might think. One technique, however, stands out for its efficiency and effectiveness. It¡¯s called active recall, and it¡¯s regarded by many as the best way to study.

    What is active recall?

    In short, active recall is the process of pulling information from your brain without prompts. The idea is that when you force yourself to remember something, you memorize it much faster than you would by only reading material or passively studying.

    When you¡¯re taking a test and you¡¯re not sure about an answer, you search your brain for the answer; that¡¯s active recall. The action of trying to remember is what essentially crystallizes the information in your head for the long term. Multiple study methods use active recall or the action of searching your brain for an answer.

    Active recall forces you to pull information from your mind. It¡¯s not just for doing well on tests but also for long-term retention.

    Active recall is praised for its effectiveness, but it is also mentally taxing. Attempting to recall things that are not in the front of your mind is tiring, which is part of why some opt out of using it.

    Dr. Cal Newport, author of Deep Work, says:

    ¡°It¡¯s almost like you have a pseudo-photographic memory when you study this way.¡±

    Passive and active study

    Most people are taught to study, but less about how to study. People end up using passive study techniques, like rereading material or rewatching lectures. Although not particularly effective, studies show that reading and rereading notes remains university students¡¯ most common study method. (Dunlosky, 2013).

    These methods might feel like effective studying but aren¡¯t really helping much. Yes, passive study methods such as reading, highlighting, or watching can help, but can also give you a false sense of understanding.

    With these methods, when the time comes to retrieve the information, you struggle to recall it because it is not in your long-term memory.

    The first step to becoming excellent at studying is understanding how important active study methods are, such as flashcards, practice testing, or practice teaching ¨C all methods that use active recall.

    Spaced repetition

    If you¡¯re researching study methods, you¡¯ve probably encountered the term spaced repetition. This technique can be incorporated into active recall study methods, primarily flashcards.

    Spaced repetition involves reviewing information at increasingly longer intervals in order to improve long-term memory. You are using this technique when you learn something, so review it a day later, then a week later and then a month later. It helps fight your brain¡¯s natural process of forgetting things.

    Combining spaced repetition with active recall is always a recipe for successful study.

    So, what methods can you use to employ active recall in your study sessions?

    Summarize what you know

    The simplest way to practice active recall is to try to remember the material actively. To do this, read or reread some material, then take some time away¡ªtake a walk, snack break, or whatever you like to do to take a break.

    During this break, try to replicate in your mind as much about the topic from scratch as if you had to teach about it. Don¡¯t be discouraged if you have trouble remembering; part of the learning process is forgetting material and then remembering it.

    When using this for language acquisition, make up relevant sentences and translate them into your target language. What type of vocabulary were you learning? What grammatical structures were new to you?

    Take a mental note of which elements you were able to remember and which ones gave you trouble.

    When finished, go back to the material and review. Were you able to remember things? Whether you could or not, you¡¯ve helped yourself. Your attempt to remember is you practicing active recall.

    When you do successfully remember something, you¡¯ll realize that it is locked in your long-term memory. This method is as simple as it is productive.

    Teach a friend

    Similar to mental summarizing, after studying, find a friend and do your best to explain the topic to them. Language learning could involve explaining how a new grammar pattern works in your target language or taking sentences and phrases and translating them to a friend.

    As a teacher, your best lessons are the ones where you know the material inside and out. If you can effectively explain and teach someone about your target language, you are that much closer to mastering the information yourself.

    Flashcards

    Flashcards, especially when combined with spaced repetition, are the king of study methods for language acquisition.

    Between all that they can be used for, they are especially good for language learning, no matter what part of the language you¡¯re studying. This is one of the best ways to learn sentence structure that does not mirror your native tongue, conjugations for speedy use and general vocabulary.

    I have found that using a spaced repetition-based flashcard program is the best way to study a language. This way, you don¡¯t have to schedule a bunch of paper flashcards manually.

    Among the most popular programs for language learners is Anki. Anki is a spaced repetition flashcard program. With it, you create your cards and the program schedules them at increasingly longer intervals. It is also used widely among students studying for large tests, like medical and law exams.

    To make the best flashcards, make them yourself. Downloading a big set of flashcards for your target language is tempting but not particularly helpful. Instead, after each study session, make a few flashcards yourself covering the new vocabulary/grammar you¡¯ve just learned about.

    One more thing: do not use multiple-choice answers for your cards. Active recall happens when you produce information without prompts or assistance.

    Personally, I use flashcards every day to learn Spanish through . This program has a learning curve, but the payoff makes it worth it.

    Test yourself

    The goal of studying for a test is to be able to answer questions about a topic or, even better, know the material for real-world application. As stated earlier, active recall happens during testing, so why not use this form of active recall before testing?

    Use your materials to make a mock exam in this method, then take it. Through actively remembering to answer each question, the ones you get right will stick in your brain. Review the questions that you couldn¡¯t remember and retake the test focusing on them.

    While not particularly complicated, these tips and methods¡¯ effectiveness comes from their use of active recall. As you forget information and pull it from the depths of your memory, you solidify it for yourself.

    Forgetting plays an important role in learning something for long-term memory.

    Now, get to studying; how are you going to use the power of active recall in your routine?

    References

    Dunlosky, J. "Improving Students¡¯ Learning With Effective Learning Techniques: Promising Directions From Cognitive and Educational Psychology." Association for Psychological Science, 2013, 1-6

  • placeholder

    Understanding your GSE score

    By Samantha Ball
    Reading time: 3 minutes

    For many students, navigating the world of English language proficiency tests can be a daunting experience. Whether you're preparing for university, looking to enhance your career prospects, or simply aiming to improve your communication skills, understanding what your Global Scale of English (GSE) score means is crucial.

    In this blog post, we'll break down the GSE, explain what your score represents and provide you with actionable steps to improve it.