The role of AI in English assessment

Jennifer Manning
A woman holding a tablet stood in a server room

Digital assessment is becoming more and more widespread in recent years. But what鈥檚 the role of digital assessment in teaching today? We鈥檇 like to give you some insight into digital assessment and automated scoring.

Just a few years ago, there may have been doubts about the role of AI in English assessment and the ability of a computer to score language tests accurately. But today, thousands of teachers worldwide use automated language tests to assess their students鈥 language proficiency.

For example, 色猫AV鈥檚 suite of Versant tests have been delivering automated language assessments for nearly 25 years. And since its launch in 1996, over 350 million tests have been scored. The same technology is used in 色猫AV鈥檚 Benchmark and Level tests.

So what makes automated scoring systems so reliable?

Huge data sets of exam answers and results are used to train artificial intelligence machine learning technology to score English tests the same way that human markers do. This way, we鈥檙e not replacing human judgment; we鈥檙e just teaching computers to replicate it.

Of course, computers are much more efficient than humans. They don鈥檛 mind monotonous work and don鈥檛 make mistakes (the standard marking error of an AI-scored test is lower than that of a human-scored test). So we can get unbiased, accurate, and consistent scores.

The top benefits of automated scoring are speed, reliability, flexibility, and free from bias.

Speed

The main advantage computers have over humans is that they can quickly process complex information. Digital assessments can often provide an instant score turnaround. We can get accurate, reliable results within minutes. And that鈥檚 not just for multiple-choice answers but complex responses, too.

The benefit for teachers and institutions is that they can have hundreds, thousands, or tens of thousands of learners taking a test simultaneously and instantly receive a score.

The sooner you have scores, the sooner you can make decisions about placement and students鈥 language level or benchmark a learner鈥檚 strengths and weaknesses and make adjustments to learning that drive improvement and progress.

Flexibility

The next biggest benefit of digital assessment is flexible delivery models. This has become increasingly more important since online learning has become more prominent.

Accessibility became key: how can your institution provide access to assessment for your learners, if you can鈥檛 deliver tests on school premises?

The answer is digital assessment.

For example, Versant, our web-based test can be delivered online or offline, on-site or off-site. All test-takers need is a computer and a headset with a microphone. They can take the test anywhere, any time of day, any day of the week, making it very flexible to fit into someone's schedule or situation.听

Free from bias

Impartiality is another important benefit of AI-based scoring. The AI engine used to score digital proficiency tests is completely free from bias. It doesn鈥檛 get tired, and it doesn鈥檛 have good and bad days like human markers do. And it doesn鈥檛 have a personality.

While some human markers are more generous and others are more strict, AI is always equally fair. Thanks to this, automated scoring provides consistent, standardized scores, no matter who鈥檚 taking the test.

If you鈥檙e testing students from around the world, with different backgrounds, they will be scored solely on their level of English, in a perfectly objective way.

Additional benefits of automated scoring are security and cost.

Security

Digital assessments are more difficult to monitor than in-person tests, so security is a valid concern. One way to deal with this is remote monitoring.

Remote proctoring adds an extra layer of security, so test administrators can be confident that learners taking the test from home don鈥檛 cheat.

For example, our software captures a video of test takers, and the AI detection system automatically flags suspicious test-taker behavior. Test administrators can access the video anytime for audits and reviews, and easily find suspicious segments highlighted by our AI.

Here are a few examples of suspicious behavior that our system might flag:

Image monitoring:

  • A different face or multiple faces appearing in the frame
  • Camera blocked

Browser monitoring:

  • Navigating away from the test window or changing tabs multiple times

Video monitoring:

  • Test taker moving out of camera view
  • More than one person in the camera view
  • Looking away from the camera multiple times

Cost

Last but not least, the cost of automated English certifications are a benefit. Indeed, automated scoring can be a more cost-effective way of monitoring tests, primarily because it saves time and resources.

色猫AV English proficiency assessments are highly scalable and don鈥檛 require extra time from human scorers, no matter how many test-takers you have.

Plus, there鈥檚 no need to spend time and money on training markers or purchasing equipment.

AI is helping to lead the way with efficient, accessible, fair and cost-effective English test marking/management. Given time it should develop even further, becoming even more advanced and being of even more help within the world of English language learning and assessments.听

More blogs from 色猫AV

  • Students sat together in a classroom working together

    Exploring the four Cs: Using future skills to unlock young learners鈥 potential

    Por Annie Altamirano
    Reading time: 5 minutes

    What do we mean by future skills?听

    The skills students will need in their future studies and careers are dramatically different from those required previously. Times are changing rapidly and educational institutions and teachers have a critical role to play in developing those skills in our young learners so that they are able to fulfill their potential and have bright futures ahead of them.听

    These skills are referred to as future skills. There is no common consensus on how to define these skills but, broadly speaking, they can be grouped into four categories:听

    1. Ways of thinking

    Skills in this category include critical thinking, creativity, innovation, problem solving, metacognition and learning skills.

    2. Ways of working

    Here, we鈥檙e talking about the skills of communication and collaboration.

    3. Tools for working

    Information literacy is an important 21st-century skill, as well as ICT literacy and citizenship, both global and local.听

    4. Life skills

    The final category covers life and career skills, and is all about personal and social responsibility.听

    One way you can encourage young learners to build these skills is through STEAM subjects (that鈥檚 science, technology, engineering, arts and math), which will equip them with functional skills such as organizing, planning, cognitive flexibility and self-regulation.听

    The four Cs听

    The four Cs refer to four important skills for young learners to master: communication, collaboration, critical thinking and creativity. These are essential, not just in an educational context, but in everyday life.听

    Falling into the first two categories of future skills (ways of thinking and ways of working), these can help children build confidence and self-esteem. They also encourage healthy emotional development.听听

    So let鈥檚 take a closer look at the theory behind them.

    1. Communication

    We usually think of communication as speaking and listening, but it鈥檚 actually much broader than that. Communication encapsulates telling stories, reading, sharing ideas and experiences, body language, facial expression, eye contact and tone. Children learn to decipher the world around them by learning and practicing these skills.

    Strong communication skills, developed early, are directly related to their literacy success. These skills allow children to articulate their thoughts and ideas effectively, and listen to decode meaning. Students then begin to use communication for a range of purposes, and communicate effectively in diverse environments. Furthermore, developing strong patterns of verbal and non-verbal communication also fosters self-esteem and social skills.听

    2. Collaboration

    Collaboration is how young children begin to build friendships with others. At first, young children will watch what others do and say, before moving on to playing together. As they get older, they become aware of other children鈥檚 feelings and ideas. Friendships become motivating and they learn how to make compromises and respect each other鈥檚 perspectives and skills.听

    Collaboration is enhanced through group work and project-based activities, sharing time with peers. Children thrive when they feel valued by the people around them, not just adults but their peers too.听

  • Business people stood together around a laptop in a office

    Learning English and employability

    Por Tas Viglatzis
    Reading time: 4 minutes

    English not only opens up career opportunities beyond national borders; it is a key requirement for many jobs. It鈥檚 also no longer a case of just learning English for employability, but mastering English for business 鈥 and that means an on-going commitment to learn.

    My experience is consistent with this trend. If I had to estimate the value that being fluent in English has had on my career, I'd say it was my entire life鈥檚 earnings. Learning English has offered me educational options beyond the borders of my own country and enabled me to develop the skills to work for global companies that operate across national boundaries. I have been privileged to work in different countries in roles that have spanned functions, geographies and markets 鈥 and my ability to learn and evolve my English skills has been an underlying factor throughout.

  • A teacher showing her students a globe, with her students looking at the globe, one with a magnifying glass in hand.

    What鈥檚 it like to teach English in Turkey?

    Por Steffanie Zazulak
    Reading time: 3 minutes

    Alice Pilkington qualified as a CELTA (Certificate in Teaching English to Speakers of Other Languages) certified teacher in October 2009. She started working in Rome before moving to Istanbul, where she鈥檚 spent the past three and a half years teaching English to 鈥渆veryone from 8-year-olds to company executives; students to bored housewives鈥. Having taught in two very different countries to a diverse range of English learners, Alice shares with us the five lessons she鈥檚 learned:

    1. Don't take things personally when you're teaching English

    "I am probably not emotionally suited for this job. I take everything very personally and if a lesson goes wrong or an activity I have taken time and energy to plan doesn鈥檛 work, I feel like a complete failure. It鈥檚 a trial and error experience but when things go wrong, they can go very wrong, and it really makes you doubt your abilities as a teacher.

    Having said that, the lessons that do go well can make up for these negative feelings. I shouldn鈥檛 take things personally; the majority of my colleagues don鈥檛 and it saves them a lot of sleepless nights"

    2. Teaching English is incredibly rewarding

    "There are very few feelings that I鈥檝e experienced that compare to seeing a student use a word that you have taught them 鈥 it makes you feel like a proud parent. Equally, seeing a student improve over a series of months is so joyful.听I have been teaching English university preparation students for the past year.

    In September, they could barely say what their name was and what they did over the weekend. Nine months on and they鈥檙e capable of reading academic texts and speaking at length about marketing strategies and environmental problems. It鈥檚 a wonderful thing to observe"

    3. Teach more than just English

    "Turkish students love hearing about how you appreciate their food and cultural traditions. Equally, they are genuinely interested in understanding how things operate in the UK and enjoy hearing personal anecdotes.听I tend to be very open with my students 鈥 even about my personal life.听I think it is partly because I have striven from the very beginning of my career to be seen as their equal.

    Turkish students are used to having a huge respect for teachers, and there is a hierarchical system in schools here, which I can never go along with. In my first lesson with most students, I tell them that they must call me by my first name (usually you refer to teachers here as 鈥榟ocam鈥 which means 鈥榤y teacher鈥 and shows respect) and this can take a long while for them to get used to."

    4. Failure to prepare is to prepare for failure... or is it?

    "Lessons that you spend hours preparing for generally don鈥檛 go as well as you had hoped. There were several times when I鈥檇 spend hours cutting and sticking things on pieces of card and placing pictures all over the classroom, hoping it would get some vocabulary action going, only to start the class and receive no response from the students.

    Conversely, lessons where you don鈥檛 feel very motivated or have no idea what you are going to do until you get into the classroom (which I call the 鈥榝lying by the seat of your pants鈥 lessons) can turn out to be the best ones. I once had a lesson in which I was, admittedly, rather hungover. On the way to the lesson, I grabbed a book called 鈥楾aboos and Issues鈥, full of discussion topics, which I used as a basis for a rather impromptu lesson on addictions, which was very successful indeed."

    5. Teaching English isn't easy

    "Teaching English is a love/hate profession. There are weeks when you absolutely loathe it and want to quit, but then within the space of a lesson or two, you get inspired by something completely unexpected, rediscover your joy for it and love it again."