The role of AI in English assessment

Jennifer Manning
A woman holding a tablet stood in a server room

Digital assessment is becoming more and more widespread in recent years. But what¡¯s the role of digital assessment in teaching today? We¡¯d like to give you some insight into digital assessment and automated scoring.

Just a few years ago, there may have been doubts about the role of AI in English assessment and the ability of a computer to score language tests accurately. But today, thousands of teachers worldwide use automated language tests to assess their students¡¯ language proficiency.

For example, ɫèAV¡¯s suite of Versant tests have been delivering automated language assessments for nearly 25 years. And since its launch in 1996, over 350 million tests have been scored. The same technology is used in ɫèAV¡¯s Benchmark and Level tests.

So what makes automated scoring systems so reliable?

Huge data sets of exam answers and results are used to train artificial intelligence machine learning technology to score English tests the same way that human markers do. This way, we¡¯re not replacing human judgment; we¡¯re just teaching computers to replicate it.

Of course, computers are much more efficient than humans. They don¡¯t mind monotonous work and don¡¯t make mistakes (the standard marking error of an AI-scored test is lower than that of a human-scored test). So we can get unbiased, accurate, and consistent scores.

The top benefits of automated scoring are speed, reliability, flexibility, and free from bias.

Speed

The main advantage computers have over humans is that they can quickly process complex information. Digital assessments can often provide an instant score turnaround. We can get accurate, reliable results within minutes. And that¡¯s not just for multiple-choice answers but complex responses, too.

The benefit for teachers and institutions is that they can have hundreds, thousands, or tens of thousands of learners taking a test simultaneously and instantly receive a score.

The sooner you have scores, the sooner you can make decisions about placement and students¡¯ language level or benchmark a learner¡¯s strengths and weaknesses and make adjustments to learning that drive improvement and progress.

Flexibility

The next biggest benefit of digital assessment is flexible delivery models. This has become increasingly more important since online learning has become more prominent.

Accessibility became key: how can your institution provide access to assessment for your learners, if you can¡¯t deliver tests on school premises?

The answer is digital assessment.

For example, Versant, our web-based test can be delivered online or offline, on-site or off-site. All test-takers need is a computer and a headset with a microphone. They can take the test anywhere, any time of day, any day of the week, making it very flexible to fit into someone's schedule or situation.?

Free from bias

Impartiality is another important benefit of AI-based scoring. The AI engine used to score digital proficiency tests is completely free from bias. It doesn¡¯t get tired, and it doesn¡¯t have good and bad days like human markers do. And it doesn¡¯t have a personality.

While some human markers are more generous and others are more strict, AI is always equally fair. Thanks to this, automated scoring provides consistent, standardized scores, no matter who¡¯s taking the test.

If you¡¯re testing students from around the world, with different backgrounds, they will be scored solely on their level of English, in a perfectly objective way.

Additional benefits of automated scoring are security and cost.

Security

Digital assessments are more difficult to monitor than in-person tests, so security is a valid concern. One way to deal with this is remote monitoring.

Remote proctoring adds an extra layer of security, so test administrators can be confident that learners taking the test from home don¡¯t cheat.

For example, our software captures a video of test takers, and the AI detection system automatically flags suspicious test-taker behavior. Test administrators can access the video anytime for audits and reviews, and easily find suspicious segments highlighted by our AI.

Here are a few examples of suspicious behavior that our system might flag:

Image monitoring:

  • A different face or multiple faces appearing in the frame
  • Camera blocked

Browser monitoring:

  • Navigating away from the test window or changing tabs multiple times

Video monitoring:

  • Test taker moving out of camera view
  • More than one person in the camera view
  • Looking away from the camera multiple times

Cost

Last but not least, the cost of automated English certifications are a benefit. Indeed, automated scoring can be a more cost-effective way of monitoring tests, primarily because it saves time and resources.

ɫèAV English proficiency assessments are highly scalable and don¡¯t require extra time from human scorers, no matter how many test-takers you have.

Plus, there¡¯s no need to spend time and money on training markers or purchasing equipment.

AI is helping to lead the way with efficient, accessible, fair and cost-effective English test marking/management. Given time it should develop even further, becoming even more advanced and being of even more help within the world of English language learning and assessments.?

More blogs from ɫèAV

  • A teacher stood in front of his class with students looking at him,

    Designing new learning experiences for your English language learners

    By Ehsan Gorji
    Reading time: 6 minutes

    Ehsan Gorji is an Iranian teacher and educator with 18 years of experience in English language education. He collaborates on various ELT projects with different language schools around the globe. Ehsan currently owns and manages THink? Languages and also works as a TED-Ed Student Talks Leader.

    Learning has always been an interesting topic to explore in the language education industry. Every week, a lot of webinars are delivered on how learning another language could be more successful, lots of articles are written on how to maximize learning, and many discussions take place between teaching colleagues about how they could surprise their language learners with more amazing tasks and games. In our lesson plans, too, we put learners into focus and try to write learning objectives that will benefit them in the real world.

  • A young child smiling in a classroom with a crayon in his hand.

    Young learners of English deserve more

    By Ehsan Gorji
    Reading time: 3 minutes

    Imagine a class of English language students aged 8?¨C 9 taught by a dynamic teacher they love. The young learners sit together for two hours, three times a week to learn English as a Foreign Language (EFL). The vibe they bring with them to the class, plus the dynamic teacher and the creativity she develops in her lesson plans, is fantastic.

    I have been observing trends in teaching EFL to young learners, and it is clear to me that school directors, syllabus generators, teachers, parents and learners are all satisfied with this image¡­ ¡°Hooray! Young learners sit together for two hours, three times a week to learn English as a Foreign Language. And the teacher is able to manage the class. Bravo!¡± But is it enough?

    What causes the lack of focus?

    It all begins with the coursebooks. If you take a coursebook for young learners and thumb through the ¡®Scope and Sequence¡¯ pages, you¡¯ll see holistic definitions of language input in each unit. The school authorities then design a course based on the coursebook, and the snowball effect happens, whereby they design a course without specific details on what exactly to focus on.

    It is the teacher¡¯s turn now. The creative and dynamic teacher provides an excellent classroom experience through which young learners can learn English together. She also assigns a piece of homework: write an email to a friend and tell her about your last holiday.

    When the teacher reviews the emails, she smiles as she finds many uses of the simple past tense¡ªboth in affirmative and negative forms. She then drafts an email thanking everyone and praising them generously. She includes a link to a PDF of other exercises to reinforce the grammar (the next day in class, they will review the completed handouts).

    This hardworking teacher tries to blend her style with digital literacy and applies creativity along the way. Everything seems perfect in her class, and she regularly receives emails from parents thanking her. Nevertheless, some questions remain: What was the task? What was the learning outcome? Which learning objective should have been tracked?

    Let¡¯s reconsider the task ¨C this time with our critic¡¯s hat on ¨C and analyze what has been taking place in this class. It is very nice that young learners sit together to learn English, and the teacher is able to manage the class successfully, but having fun and ease alone is not enough. We should aim for ¡°fun, ease and outcomes¡±.*

    *Assessing Young Learners of English: Global and Local Perspectives,?Dr Marianne Nikolov, 2016.

    Which important dynamics should be considered?

    The assigned piece of homework said: write an email to a friend and tell her about your last holiday. However, what actually occurred was a shift from this task to the students¡¯ best performance in producing simple past-tense sentences. There are other important dynamics that have migrated out of the teacher¡¯s focus. Did the students begin their emails appropriately? Was the tone appropriate? Did they pay attention to organizing their thoughts into sentences and paragraphs? Was the punctuation correct? Did they end their emails in the right way?

    If the coursebook had been equipped with clear and concrete learning objectives, the course directors would have employed them while designing study syllabuses, and the teacher would have used them when lesson planning. Consequently, the student¡¯s formative and summative progress would have been evaluated against those detailed learning objectives rather than according to what some did better than the average.

    How can learning objectives be applied to tasks?

    With the Global Scale of English (GSE), publishers, course designers, teachers, and even parents can access a new world of English language teaching and testing. This global English language standard provides specific learning objectives for young learners that can be applied to tasks.

    For example, for our task, the GSE suggests the following learning objectives:

    • Can write short, simple personal?emails/letters about familiar topics, given prompts or a model.?(GSE 40/A2+)
    • Can use appropriate standard greetings and closings in simple, informal personal messages (e.g., postcards or emails). (GSE: 37/A2+)

    By applying language learning chunks ¨C learning objectives, grammar and vocabulary ¨C and identifying the can-do mission each one is supposed to accomplish, teaching and testing become more tangible, practical and measurable. Going back to my original scenario, it is excellent that young learners sit together for two hours, three times a week to learn English as a Foreign Language ¨C provided that we know in detail which learning objectives to focus on, which skills to grow and what learning outcomes to expect.

  • A teacher stood at the front of the class talking to her class

    English for employability: Why teaching general English is not enough

    By Ehsan Gorji
    Reading time: 4 minutes

    Many English language learners are studying English with the aim of getting down to the nitty-gritty of the language they need for their profession. Whether the learner is an engineer, a lawyer, a nanny, a nurse, a police officer, a cook, or a salesperson, simply teaching general English or even English for specific purposes is not enough. We need to improve our learners¡¯ skills for employability.

    The four maxims of conversation

    In his article Logic and Conversation, Paul Grice, a philosopher of language, proposes that every conversation is based on four maxims: quantity, quality, relation and manner. He believes that if these maxims combine successfully, then the best conversation will take place and the right message will be delivered to the right person at the right time.

    The four maxims take on a deeper significance when it comes to the workplace, where things are often more formal and more urgent. Many human resources (HR) managers have spent hours fine-tuning workplace conversations simply because a job candidate or employee has not been adequately educated to the level of English language that a job role demands. This, coupled with the fact that many companies across the globe are adopting English as their official corporate language, has resulted in a new requirement in the world of business: mastery of the English language.

    It would not be satisfactory for an employee to be turned down for a job vacancy, to be disqualified after a while; or fail to fulfil his or her assigned tasks, because their English language profile either does not correlate with what the job fully expects or does not possess even the essential must-have can-dos of the job role.

    How the GSE Job Profiles can help

    The Job Profiles within the can help target those ¡®must-have can-dos¡¯ related to various job roles. The ¡®Choose Learner¡¯ drop-down menu offers the opportunity to view GSE Learning Objectives for four learner types: in this case, select ¡®Professional Learners¡¯. You can then click on the ¡®Choose Job Role¡¯ button to narrow down the objectives specific for a particular job role ¨C for example, ¡®Office and Administrative Support¡¯ and then ¡®Hotel, Motel and Resort Desk Clerks¡¯.

    Then, I can choose the GSE/CEFR range I want to apply to my results. In this example, I would like to know what English language skills a hotel desk clerk is expected to master for B1-B1+/GSE: 43-58.