The role of AI in English assessment

Jennifer Manning
A woman holding a tablet stood in a server room

Digital assessment is becoming more and more widespread in recent years. But what’s the role of digital assessment in teaching today? We’d like to give you some insight into digital assessment and automated scoring.

Just a few years ago, there may have been doubts about the role of AI in English assessment and the ability of a computer to score language tests accurately. But today, thousands of teachers worldwide use automated language tests to assess their students’ language proficiency.

For example, 色猫AV’s suite of Versant tests have been delivering automated language assessments for nearly 25 years. And since its launch in 1996, over 350 million tests have been scored. The same technology is used in 色猫AV’s Benchmark and Level tests.

So what makes automated scoring systems so reliable?

Huge data sets of exam answers and results are used to train artificial intelligence machine learning technology to score English tests the same way that human markers do. This way, we’re not replacing human judgment; we’re just teaching computers to replicate it.

Of course, computers are much more efficient than humans. They don’t mind monotonous work and don’t make mistakes (the standard marking error of an AI-scored test is lower than that of a human-scored test). So we can get unbiased, accurate, and consistent scores.

The top benefits of automated scoring are speed, reliability, flexibility, and free from bias.

Speed

The main advantage computers have over humans is that they can quickly process complex information. Digital assessments can often provide an instant score turnaround. We can get accurate, reliable results within minutes. And that’s not just for multiple-choice answers but complex responses, too.

The benefit for teachers and institutions is that they can have hundreds, thousands, or tens of thousands of learners taking a test simultaneously and instantly receive a score.

The sooner you have scores, the sooner you can make decisions about placement and students’ language level or benchmark a learner’s strengths and weaknesses and make adjustments to learning that drive improvement and progress.

Flexibility

The next biggest benefit of digital assessment is flexible delivery models. This has become increasingly more important since online learning has become more prominent.

Accessibility became key: how can your institution provide access to assessment for your learners, if you can’t deliver tests on school premises?

The answer is digital assessment.

For example, Versant, our web-based test can be delivered online or offline, on-site or off-site. All test-takers need is a computer and a headset with a microphone. They can take the test anywhere, any time of day, any day of the week, making it very flexible to fit into someone's schedule or situation.?

Free from bias

Impartiality is another important benefit of AI-based scoring. The AI engine used to score digital proficiency tests is completely free from bias. It doesn’t get tired, and it doesn’t have good and bad days like human markers do. And it doesn’t have a personality.

While some human markers are more generous and others are more strict, AI is always equally fair. Thanks to this, automated scoring provides consistent, standardized scores, no matter who’s taking the test.

If you’re testing students from around the world, with different backgrounds, they will be scored solely on their level of English, in a perfectly objective way.

Additional benefits of automated scoring are security and cost.

Security

Digital assessments are more difficult to monitor than in-person tests, so security is a valid concern. One way to deal with this is remote monitoring.

Remote proctoring adds an extra layer of security, so test administrators can be confident that learners taking the test from home don’t cheat.

For example, our software captures a video of test takers, and the AI detection system automatically flags suspicious test-taker behavior. Test administrators can access the video anytime for audits and reviews, and easily find suspicious segments highlighted by our AI.

Here are a few examples of suspicious behavior that our system might flag:

Image monitoring:

  • A different face or multiple faces appearing in the frame
  • Camera blocked

Browser monitoring:

  • Navigating away from the test window or changing tabs multiple times

Video monitoring:

  • Test taker moving out of camera view
  • More than one person in the camera view
  • Looking away from the camera multiple times

Cost

Last but not least, the cost of automated English certifications are a benefit. Indeed, automated scoring can be a more cost-effective way of monitoring tests, primarily because it saves time and resources.

色猫AV English proficiency assessments are highly scalable and don’t require extra time from human scorers, no matter how many test-takers you have.

Plus, there’s no need to spend time and money on training markers or purchasing equipment.

AI is helping to lead the way with efficient, accessible, fair and cost-effective English test marking/management. Given time it should develop even further, becoming even more advanced and being of even more help within the world of English language learning and assessments.?

Read the blog post 'Versant English language test: Assessment tools for business'.

Learn about our tests

More blogs from 色猫AV

  • Children sat at desks in a classroom, with one in the middle smiling with her hand up

    Teaching young learners: all just fun and games?

    By Jill Leighton
    Reading time: 5 minutes

    We want lots of fun in our lessons, with a good balance of activities and games with strong educational value. But in my opinion, today’s young learners need more than just fun and games to stay motivated. Fun and games can quickly become meaningless and boring for some students.

    How do we create fun and engaging lessons for young learners aged 6-14?

    • Have a strong relationship with your students. Know about their natural talents, their weaker points and where they are in their development.
    • Encourage them to be active learners and engage them in learning that is meaningful to all of them. E.g. through project work.
    • Provide opportunities for students to use technology and develop success skills. E.g. collaboration, communication, critical thinking, creativity and self-learning.

    Most teachers agree that we have to assume the responsibility of preparing students for life as well as helping them to acquire a language – and this is what I aim to demonstrate in this blog. Using , I want to demonstrate how you can learn more about your students and care for individual needs in one classroom.

    The students will also learn about themselves and their classmates. They will acquire vocabulary and language (at their level) in a dynamic way and create a project to explore their interests and demonstrate their talents. They will use technology and develop their success skills. Assessment will be fun and engaging. I hope you will be able to adapt the ideas and put them into practice with children aged 6-14.

    Howard Gardner’s Model of Multiple Intelligences

    prompts us to ask: How is this child intelligent? He identified eight different types of intelligence which guide the way students learn:

    • Verbal-Linguistic Intelligence (Word Smart)
    • Logical-Mathematical Intelligence (Maths Smart)
    • Spatial Intelligence (Picture Smart)
    • Musical Intelligence (Music Smart)
    • Bodily-Kinesthetic Intelligence (Body Smart)
    • Naturalistic-Environmentalist Intelligence (Nature Smart)
    • Interpersonal Intelligence (People Smart)
    • Intrapersonal Intelligence (Self-Smart)
    • (He later went on to identify Existential Intelligence – Life Smart, and Pedagogical Intelligence -Teacher Smart)

    Lesson 1: Outline the student’s learning goals

    Explain to the students that they are going to learn about Howard Gardner’s Model of Multiple Intelligences and that you want them to achieve learning goals on completion of the project. Write the goals on a poster and discuss them with your students. Take a digital photo of the poster to use during the assessment.

    Student learning goals – you will be able to:

    • Identify different intelligences and what they mean. Name eight different intelligences you have
    • Communicate ideas clearly through a project to demonstrate your talents and interests
    • Use your success skills more effectively.

    Tip: Video parts of lesson 1, especially discussion of the learning goals, to use as part-assessment and reflection on completion of the project.

    What do you know about the Multiple Intelligences? How are you smart?

    • Ask children what they know about multiple intelligences. Teach key language and vocabulary as necessary, depending on level.
    • Ask, “What does it mean be intelligent?” (They will probably say, good grades, be good at maths, English, reading, writing, computers...)
    • Tell them being intelligent or smart (get the younger children to repeat the word smart several times) isn’t only about getting good grades. Ask them to think of more ways to be smart.
    • Elicit the eight ways to be smart according to Gardner. (You may need to mime). E.g. mime playing the piano or clap a rhythm to elicit Music Smart.
    • Discuss what the different intelligences mean. (E.g. Word Smart (Linguistic Intelligence): you like reading, writing or speaking, you are probably good at languages…)
    • Teach career vocabulary associated with the different intelligences. (E.g. Word Smart: journalist, teacher, lawyer, editor, TV announcer, web editor.)

    Lesson 2: Find out your smarts quiz

    Tell students they are going to do a quiz to discover how they are smart. Model each stage of the activity and do the quiz with them to find out about your own strengths. Give each student a piece of paper.

    • Take your paper and show the students how to fold it into eight sections, then unfold it and draw lines along the folds to make a grid.
    • Write the different smarts in each section. (Use small handwriting to leave room to illustrate each smart with a picture).
    • Give a picture dictation to illustrate each smart. Here are some examples:

    Word Smart:?Draw a dictionary and children reading, writing and speaking.

    Logic/Number Smart: Draw sums on a computer, a scientist with test tube.

    Music Smart: Draw children singing and playing musical instruments.

    Body Smart: Draw children playing a sport, dancing or cooking.

    Nature Smart:?Draw trees, animals, insects, child watering a plant.

    Spatial/Picture Smart: Draw children drawing, painting or taking photos and a pilot in a plane.

    People Smart:?Draw a child helping or leading a group or a group of children holding hands.

    Self-Smart: Draw children keeping a journal, researching on a computer, or meditating.

    Encourage students to order their smarts from 1-8. For example, if you love music, write number 1 in the Music Smart section and continue to 8 in order of preference. (You may wish to model this first and order your smarts from 1-8 and then encourage the children to order their smarts.)

    After the quiz

    • Encourage students to compare and discuss their results. Collect the papers and make notes about each student’s results. This will help you reach all your students when planning activities.
    • Explain that we have all the intelligences in different degrees and that all of the intelligences are equal (no intelligence is better than another). Also point out that it is important to know our strengths in order to help in all subjects. (E.g. a music smart student who finds maths challenging may want to sing multiplication tables). Remind students that we usually use several intelligences to do something and we can explore and develop all our smarts.

    Tip: Video lesson 2 to use as part of assessment.

    Lesson 3: Beginning the project

    Encourage the students to create a project for enjoyment. Explain that you want them to collaborate in groups that share the same smarts and interests and using their creativity you want them come up with an interesting topic to explore. (Remind students to concentrate on developing their success skills when they are working with others and mention that you will also be monitoring this as part of the assessment).

    Organize the students into groups of no more than five students in each. Give students time to brainstorm in their groups and come up with the best topic for the project, using their critical thinking skills. (E.g. Picture Smart students may decide to create a project about a famous artist, such as Salvador Dali).

    You may wish to give each student a ?(Know, Want-to-know, and Learned) to complete during the project process, asking questions such as: What do you know? What do you want to know? What have you learned?

    Lesson 4: Planning the project

    Inform students about the timing of the project. Encourage each group to make a project mind map, which will encourage them to be more creative and organized.

    Remind all the groups to keep the following questions in mind:

    • What are you going to do/make? (Presentation, PowerPoint, website, video, posters.)
    • How will you research it? (Internet, tech tools, library.)
    • How will you delegate responsibilities?
    • How will you check that your audience has understood the message of your project? What questions will you ask?

    Decide on how many lessons are needed to prepare the project and how much will be done in school or at home, depending on the age groups and timing.

    Encourage the students to share their work with the rest of the class (or in assembly.)

    Tip: Video the different groups sharing their work.

    Can assessment also be fun and engaging?

    Yes, it can; here are some tips and suggestions.

    • Show the videos you have recorded and ask the students to compare and contrast their knowledge in Lesson 1 and how it developed over the lessons. Encourage them to observe and comment on their success skills.
    • Display the photo of the Student Learning Goals poster from Lesson 1. Get the students to self-assess and decide whether they have achieved the goals that were set in Lesson 1. (You may wish to give the students three small pieces of colored paper: red to represent I understand quite well, orange to represent I understand well and green to represent I understand very well). Ask: Can you identify the different intelligences and say what they mean? Encourage the students to hold up a colored piece of paper according to their understanding. (Make a mental note of all red pieces of paper to be ready to give extra help to those students). Check understanding by getting several students to answer the question.
    • Get the children to reflect on the learning experience. What have they learned about the different intelligences? How can they develop weaker points using their strengths to help them? Can they use all eight intelligences inside and outside school? Did they manage to get along well with their classmates? Did they communicate the message of their project so that the audience understood?
    • Give individual feedback to each student. E.g. congratulate them on their attitude and effort or identify areas for improvement: “You managed to use vocabulary and language effectively when you shared your project, we understood your message perfectly.” Or “You need to work on being more collaborative.” “You weren’t on task during the project.” “How do you think you can improve that?”
    • Ask students to give you feedback on the activities they enjoyed. Get them to draw happy and sad face cards. Go through all the activities and get the students to show a happy or sad face according to whether or not they liked the activity. E.g. say “Did you like the ‘Find out your smarts’ quiz?” and ask them to hold up the happy or sad face depending on whether they liked the activity or not.

    Create fun lessons to engage all your students keeping this model in mind: traditional activities such as short fun activities and games + Howard Gardner’s model of Multiple Intelligences + PBL (Project Based Learning) + success skills + meaningful assessment. Enjoy the results with your students.

    How the Global Scale of English can help

    The?Global Scale of English (GSE) Learning Objectives for provides ready-made learning objectives that can help with planning curriculums and lesson and benchmarking learners’ progress. They are great for young learners because they describe language functions in a granular way, enabling educators to give their learners credit for small achievements. They also clearly show the language functions to target next in order to take learners to the next level.