Computer-based language assessment: The future is here

David Booth
David Booth
A blonde woman sat at a computer with headphones on in a room with more computers and desks in background

Many people are surprised at the idea of a computer program marking an exam paper. However, computer-based testing already exists in many different formats and many different areas. Many tests or exams that form part of our daily life are taken on computers. If you’ve ever learned to drive, sat a citizenship test, done a training course at work, or completed a placement test for a language course, the odds are that you’ve already taken an automated test.

Yet despite it being so common, there is still a lack of understanding when it comes to computer-based language assessment and how a computer can evaluate productive skills like speaking and writing.

Computer-based testing: a closer look

A common issue is that people have different ideas of what these tests entail. Computers can fulfill several essential roles in the testing process, but these often go unacknowledged. For example, a variety of test questions are needed to administer an exam, along with relevant data, and computers are used to store both the questions and the data. When it comes to creating randomized exams, computer software is used to select the exam questions, based on this data.

Computers can make complex calculations far more quickly and accurately than humans. This means that processes that previously took a long time are completed in days, rather than weeks.

Artificial intelligence (AI) technology is now capable of grading exam papers, for example. This means a shorter wait for exam results. In , candidates receive their results in an average of two days rather than waiting weeks for an examiner to mark their paper by hand.

The benefits for students and teachers

People take exams to prove their skills and abilities. Depending on their goals, the right result can open the door to many new opportunities, whether that is simply moving on to the next stage of a course, or something as life-changing as allowing you to take up your place on a university course in another country.

A qualification can act as a passport to a better career or an enhanced education, and for that reason, it’s important that both students and teachers can have faith in their results.

Computer programs have no inherent bias, which means that candidates can be confident that they will all be treated the same, regardless of their background, appearance or accent. , just one of ɫèAV’s computer-based exams, offers students the chance to score additional points on the exam with innovative integrated test items.

This integration means that the results are a far more accurate depiction of the candidate’s abilities and provide a truer reflection of their linguistic prowess.

More than questions on a screen

It’s not as easy as simply transferring the questions onto a computer screen. All that does is remove the need for pen and paper; this is a missed opportunity to harness the precision and speed of a computer, as well as its learning potential.

Tests that have been fully digitized, such as PTE Academic, benefit from that automation; eliminating examiner bias, making the test fairer and calculating the results more quickly. Automated testing builds on the technological tradition of opening doors for the future – not closing them.

How technology enhances language testing

The development of automated testing technologies doesn’t merely make the examination process quicker and more accurate – it also gives us the chance to innovate. Speaking assessments are an excellent example of this.

Previously, this part of a language exam involved an interview, led by an examiner, who asked questions and elicited answers. But now that we have the technological capability, using a computer offers students the chance to be tested on a much wider range of speaking skills, without worrying about the inherent bias of the examiner.

Indeed, the use of a computer-based system facilitates integrated skills testing. Traditionally, language exams had separate papers focusing on the four skills of reading, listening, speaking and writing. But the more modern concept of language testing aims to assess these linguistic skills used together, just as they are in real-life situations.

Afterwards, the various scores are categorized to allow learners an insight into their strengths and weaknesses, which helps both students and teachers identify areas which need improvement. This useful feedback is only possible because of the accuracy and detail of automated exam grading.

The space race on paper

Back in the 1960s, during the space race, computers were still a relatively new concept. Kathleen Johnson, one of the first African-American women to work for NASA as a scientist, was a mathematician with a reputation for doing incredibly complex manual calculations. Although computers had made the orbital calculations, the astronauts on the first space flight refused to fly until Kathleen had checked those calculations three times.

This anecdote reminds us that - although computer technology is an inherent part of everyday life - now and then, we still need to check that their systems are working as they should. Human error still comes into play – after all, humans program these systems.

PTE Academic – a fully digitized exam

Every stage of PTE Academic, from registration to practice tests to results (both receiving and sharing them with institutions) happens online. It may come as a surprise to learn that the test itself is not taken online. Instead, students attend one of over 295 test centers to take the exam, which comes with the highest levels of data security.

This means that each student can sit the exam in an environment designed for that purpose. It also allows the receiving institutions, such as universities and colleges, to be assured of the validity of the PTE Academic result.

The future is here

We created computers, but they have surpassed us in many areas – exam grading being a case in point. Computers can score more accurately and consistently than humans, and they don’t get tired late in the day, or become distracted by a candidate’s accent.

The use of AI technology to grade student responses represents a giant leap forward in language testing, leading to fairer and more accurate student results. It also means more consistency in grading which benefits the institutions, such as universities, which rely on these scores to accurately reflect ability.

And here at ɫèAV, we are invested in staying at the cutting edge of assessment. Our test developers are incorporating AI solutions now, using its learning capacity to create algorithms and build programs that can assess speaking and writing skills accurately and quickly. We’re expanding the horizons of English language assessment for students, teachers and all the other professionals involved in each stage of the language learning journey.

More blogs from ɫèAV

  • A teacher stood in front of her class with her students raising their hands

    What is rapid prototyping and how can it apply to the ELT classroom?

    By Nicole Kyriacou
    Reading time: 5 minutes

    Tom Chi is an internet veteran with quite a resumé. His roles have been many and varied – from astrophysical researcher to Fortune 500 consultant and corporate executive, developing new hardware and software products and services.

    He worked on Microsoft Outlook when it was in its infancy, was a major influence in taking Yahoo Search from 0 to 90 million users and is now Head of Product Experience at Google X – Alphabet’s secretive division focused on creating technological innovations for the future. It has produced the self-driving car and Google Glass, and its Project Loon aims to provide internet to every square inch of the earth.

    At Google X, Tom was in a unique position – always having to think five, ten or even more years ahead in order to conceptualize and build the technology of the future. As you might imagine, this is far from an easy task; not only do the ideas have to be original, but they have to meet people’s future needs – something that is not easy to predict.

    So, how does Tom and the others at Google X deliver their vision for the future using today's materials and technology?

    That’s where Rapid Prototyping comes in. It’s a concept that allows teams to experiment, learn and adjust prototypes quickly and cheaply, so that projects (and products) get off the ground. Failure is seen as a starting block and an inevitable part of the learning process. Following his workshop, we are going to look further at rapid prototyping and how it can relate to the ELT classroom.

  • three teachers sat at a table discussing

    4 career moves for enthusiastic teachers

    By Nicole Kyriacou

    Have you been teaching for a number of years and are looking for ways to challenge yourself and share your experience and passion with others?

    Many would love the opportunity to progress in their careers and try new things but have no idea how to get started.

    So, let's look at several potential jobs for English language teachers, find out what they involve and how you can improve your chances of getting a foot in the door.

    1. Materials Writing

    For those with a passion for writing and an eye for detail, ELT materials development could be for you. While writing can be hard to get into, there are several ways to get involved - especially if you are persistent and build a portfolio.

    Here are some of our top tips for aspiring materials writers:

    • Create your own materials in class and think of ways of adapting the current materials you use for different ages or levels.
    • Share the materials you make with other teachers and get them to give you feedback.
    • Review materials for a publisher. Not only will you start to think more critically, but if you do a good job they might commission you to do some writing for them. One way to discover these opportunities is by signing up for their newsletters or following them on Facebook or .
    • Start a blog and share lesson tips, advice and activities with other teachers. If it becomes popular enough someone from a publisher might spot you and invite you along for an interview.
    • Join the , where you can create an account and publishers can contact you directly if they are interested in your profile.
    • Finally, write as much as possible - and get people to read your work. Listen to their feedback and take steps to constantly improve your output. You get better and faster at it at the same time.

    2. Examining

    If you like teaching exam classes, there's a good chance you'll enjoy examining too. Training to be a speaking examiner is a great way to earn some extra money and can also help you better understand test formats and mark schemes. This will certainly also benefit your students in the future too.

    Specific requirements for examiners vary depending on the exam board. However, as a rule of thumb, you need a lot of experience teaching the level you wish to examine at. Here is an from ɫèAV outlining the expertise and competencies required to be a PTE General Examiner.

    You can also check out the recruitment sites from , and to get more of an idea if you are eligible.

    Like materials writing, examining can be very competitive, so here is some advice to help you get started:

    • Teach more exam classes. The more variety and levels you do, the more opportunities you'll have.
    • Familiarize yourself with the mark schemes to give you a deeper understanding of how examiners think. Most of this information can be found in teacher handbooks like this one for .
    • Help organize mock exams at your school. This will give you valuable experience examining as well as organizing students and materials.
    • Start as an invigilator for written exams. If you do a good job, it'll show that you are competent and you'll learn more about how exam days are structured.
    • Contact your local exam center and introduce yourself. And who knows? They might even be recruiting.

    3. Academic Management

    Another common career goal for long-term English teachers is to become an Academic Manager or Director of Studies (DoS). A successful DoS assumes many roles; often having to organize teachers' schedules, deal with students' concerns, develop new courses, and find cover (or teach) classes at the last minute. They may also need to help with the school's marketing and business side, too. Ìý

    Many academic managers are employed internally, so get involved with what is going on at your school and apply for smaller coordination positions to see if it's something you enjoy.

    You can also try:

    • Offering to help with placement testing of new students. This will help you get to know the type of students at your school and the objectives they have, and also learn more about the levels and courses on offer.
    • Not limiting yourself to teaching one kind of course. If you work at an academy that offers courses for young learners, teens, adults, exam preparation, business etc., try them all. A good DoS should be able to offer advice to all the teachers.
    • Taking a course - most academic managers will be expected to have an advanced TEFL qualification like a DELTA, an MA TESOL or something similar. Specific leadership and management courses are available for those who want to specialize in this area, such as Leadership in ELT.
    • Offering creative ideas or constructive criticism to the current management team about how the school runs and what you think could be even better.
    • Organizing an event for teachers and students to show you are interested and have the type of skills that are needed.
    • Apply for academic management positions in summer schools to give you a taste of what's to come.

    4. Teacher Training

    If you are interested in teaching methodologies and sharing your knowledge with others but not keen on the admin side, then teacher training might be for you.

    As a teacher trainer, you may be required to run workshops on various topics, observe teachers and offer feedback and help with lesson planning. This means it's vital that you can listen to others carefully and clearly explain things.

    Here are some ideas to give you a better chance of finding work as a teacher trainer:

    • Organize informal workshops at your school. Encourage teachers to share ideas that have worked well for them with the rest of the staff.
    • Try team teaching where you and a colleague teach a class together. It's a great way to learn from each other and give your students a new experience.
    • Practice giving feedback by doing peer observations with other teachers.
    • Submit a proposal for a conference to see if you enjoy presenting.
    • Mentor a new teacher at your school.
    • Take an advanced teaching qualification to boost your knowledge.
    • Find teaching work in a school that also run their own initial teaching qualifications like the CELTA or Trinity CertTESOL. If you impress the DoS with your teaching skills - they may recommend you get involved with the teacher training department.

    Where to apply for jobs

    The best place to look for new opportunities is often at the school where you currently work. Start by trying new things and showing an interest in the day-to-day running of the organization. Once you've got the attention of the management it will be easier to negotiate a new position. However, if you work at a small school with fewer chances to grow professionally, think about moving to a new school.

    Other good places to look for new positions include:

    • Linkedin (don't forget to update your profile and ask for recommendations from colleagues)
    • Local teaching Facebook groups
  • A teacher leaning on a table where students are working on various activities

    6 tips for planning your first English classes

    By Nicole Kyriacou

    You are nervous, yet excited. You want to appear relaxed and fun, but still be taken seriously. Most of all, you are keen to make an excellent first impression.

    With all that in mind - planning your first English classes of the year can be a daunting experience.

    Here are six things to consider when planning your first classes:

    1. Set clear aims

    Whether you are teaching young learners, teenagers or adults, it’s important you discuss the aims and objectives of the course from day one. You’ll need to learn more about your students' needs to do this. Why are they learning English? Do they want to prepare for an official exam? What activities do they enjoy? What things do they need to improve the most?

    The way you do this will depend on the age of your learners. For example, with adults and teens, you could get them to interview each other and write a report about what they found out. With younger children, do a survey they can complete using smiley faces.

    2. Find out students’ interests

    Although you should understand your students' needs and why they want to learn English - to help make your classes relevant and engaging - you should also discover what they enjoy doing outside of class.

    To do this, get students to write mini bios you can stick around the classroom. Or have them prepare presentations where they share something they are passionate about with the rest of the class - using coursebooks. As a class, go through the contents page, vote on which topics students find most interesting, and start with those.

    3. Break the ice

    You want your first class to be fun so that students are motivated, and associate English language learning with something they can enjoy. Ice-breakers can also be an excellent way to get to know each other and learn about your students' current level of English.

    Activities where students have to ask each other questions work well.

    4. Provide a comfortable environment

    Young learners and teenagers tend to be shy at the start of a course - especially if they don’t know each other. Develop a rapport and break down boundaries by including team-building activities in your first class.ÌýYour aim is to have all the students feeling more comfortable with each other before the end of the lesson so that there are no awkward silences in future lessons.

    5. Manage expectations

    Managing expectations is an essential part of a teacher's job. Make sure in the first class you are clear about what you expect from your students and what they can expect from you.

    Have students brainstorm the rules for the class and then make a big poster or ‘class contract’ which all students have to sign. Display the poster on the wall so you can always refer to it if someone misbehaves.

    Try to keep the rules as positive as possible. Instead of writing: 'Don’t speak your first language', write: 'Try to always speak English and ask if you don’t know a word'. If you are feeling really brave, you can even get your students to devise a list of rules for you which you can display on the wall next to theirs.

    6. Make it challenging

    It’s great making your first lesson fun - but there’s nothing more motivating than leaving a new class and feeling like you’ve made a good decision and you are going to learn lots (and you aren’t wasting your time or money). This is especially important for adult learners.

    So, as well as getting to know each other and finding out their needs, teach them something new. This could be 10 new pieces of vocabulary, how to structure a letter or report, or a list of resources they can use at home to practice their English.