ɫèAV

Research has shown that automated scoring can give more reliable and objective results than human examiners when evaluating a person’s mastery of English. This is because an automated scoring system is impartial, unlike humans, who can be influenced by irrelevant factors such as a test taker’s appearance or body language. Additionally, automated scoring treats regional accents equally, unlike human examiners who may favor accents they are more familiar with. Automated scoring also allows individual features of a spoken or written test question response to be analyzed independent of one another, so that a weakness in one area of language does not affect the scoring of other areas.

was created in response to the demand for a more accurate, objective, secure and relevant test of English. Our automated scoring system is a central feature of the test, and vital to ensuring the delivery of accurate, objective and relevant results – no matter who the test-taker is or where the test is taken.

Development and validation of the scoring system to ensure accuracy

PTE Academic’s automated scoring system was developed after extensive research and field testing. A prototype test was developed and administered to a sample of more than 10,000 test takers from 158 different countries, speaking 126 different native languages. This data was collected and used to train the automated scoring engines for both the written and spoken PTE Academic items.

To do this, multiple trained human markers assess each answer. Those results are used as the training material for machine learning algorithms, similar to those used by systems like Google Search or Apple’s Siri. The model makes initial guesses as to the scores each response should get, then consults the actual scores to see well how it did, adjusts itself in a few directions, then goes through the training set over and over again, adjusting and improving until it arrives at a maximally correct solution – a solution that ideally gets very close to predicting the set of human ratings.

Once trained up and performing at a high level, this model is used as a marking algorithm, able to score new responses just like human markers would. Correlations between scores given by this system and trained human markers are quite high. The standard error of measurement between ɫèAV’s system and a human rater is less than that between one human rater and another – in other words, the machine scores are more accurate than those given by a pair of human raters, because much of the bias and unreliability has been squeezed out of them. In general, you can think of a machine scoring system as one that takes the best stuff out of human ratings, then acts like an idealized human marker.

ɫèAV conducts scoring validation studies to ensure that the machine scores are consistently comparable to ratings given by skilled human raters. Here, a new set of test-taker responses (never seen by the machine) are scored by both human raters and by the automated scoring system. Research has demonstrated that the automated scoring technology underlying PTE Academic produces scores comparable to those obtained from careful human experts. This means that the automated system “acts” like a human rater when assessing test takers’ language skills, but does so with a machine's precision, consistency and objectivity.

Scoring speaking responses with ɫèAV’s Ordinate technology

The spoken portion of PTE Academic is automatically scored using ɫèAV’s Ordinate technology. Ordinate technology results from years of research in speech recognition, statistical modeling, linguistics and testing theory. The technology uses a proprietary speech processing system that is specifically designed to analyze and automatically score speech from fluent and second-language English speakers. The Ordinate scoring system collects hundreds of pieces of information from the test takers’ spoken responses in addition to just the words, such as pace, timing and rhythm, as well as the power of their voice, emphasis, intonation and accuracy of pronunciation. It is trained to recognize even somewhat mispronounced words, and quickly evaluates the content, relevance and coherence of the response. In particular, the meaning of the spoken response is evaluated, making it possible for these models to assess whether or not what was said deserves a high score.

Scoring writing responses with Intelligent Essay Assessor™ (IEA)

The written portion of PTE Academic is scored using the Intelligent Essay Assessor™ (IEA), an automated scoring tool powered by ɫèAV’s state-of-the-art Knowledge Analysis Technologies™ (KAT) engine. Based on more than 20 years of research and development, the KAT engine automatically evaluates the meaning of text, such as an essay written by a student in response to a particular prompt. The KAT engine evaluates writing as accurately as skilled human raters using a proprietary application of the mathematical approach known as Latent Semantic Analysis (LSA). LSA evaluates the meaning of language by analyzing large bodies of relevant text and their meanings. Therefore, using LSA, the KAT engine can understand the meaning of text much like a human.

What aspects of English does PTE Academic assess?

Are you or your students preparing for an exam like ? If so, you might find that things are more stressful than usual or that motivation is starting to lack. When preparing to take an exam, it’s easy to overlook the fact that people also need to destress and relax a little.

Exam preparation is an important period. That’s why we’ve come up with some tips and advice that will help increase happiness and well-being. It will also help develop good study habits and ensure you or your students remain happy right up to their exams and beyond.

1. Create a study plan

A clear plan can help you get off to a positive start. At the same time, it will inevitably lead to more confidence and better results on the big day. Make sure to gather all the materials and equipment you will need (or provide your students with a list of what they need to gather). Once prepared, set up a comfortable workspace where you will feel happy to spend time. If you’re a teacher, you can ask your students to describe their ideal study spaces in class – this will help them visualize what they need to do at home!

It's also helpful to create a schedule where you write down what you need to work on and when. Try to include all areas of the exam but prioritize those areas that may need more work and improvement.

2. Take time out

If you're starting to feel anxious or stressed as the exam day comes nearer, here are some ideas to help manage:

Take a break

It’s better to study for short periods rather than spending hours on end at their desk. It’s a good idea to break up study periods and take a short break at regular intervals. If possible, also go outside and get some fresh air at least once a day.

Try mindfulness techniques

Guided meditation apps such as or can help reduce stress and prepare learners to focus better on their studies. You can also find guided meditation videos and audio tracks on Youtube or Spotify.

Be positive

Remember how far you’ve progressed and celebrate what you can do, and if you’re an educator encourage them to visualize themselves confidently completing the exam.

3. Have fun!

Although exam practice and reviewing are important parts of preparing for an exam, you can also have some fun. Play games and base activities around a variety of different media, including short videos and podcasts and other forms of entertainment.

Make English a part of your leisure time. Watch series or films in English, listen to music or choose podcasts related to your interests. A good tip is to look for English-language alternatives to any materials or media usually consumed.

4. Stay healthy

The stress caused by exams can result in bad habits, and eating unhealthily – fast food, snacks and caffeine can provide a false sense of energy. However, the food we eat and drink can greatly affect our body and mind. A healthy diet can improve our mood, our memory and our levels of concentration:

• Healthy carbs such as brown rice, pasta, whole grain bread and cereals will provide the necessary energy to allow students to keep working through the day.
• Oily fish like salmon and sardines are great for the brain, heart and joints, as well as increasing serotonin which makes us feel good!
• Other sources of Omega 3 such as nuts and seeds are a great substitute for vegans.
• A variety of fruits and vegetables will ensure that students have a balanced diet that will improve memory, brainpower and mental agility.

5. Get a good night’s sleep

Sleep is essential for learning to take place. The time you spend asleep is just as important as the time you spend awake. You should aim to sleep for 8 hours a night. This will help your brain to recharge, allowing you to start the day with energy and focus.

It’s especially important that you sleep well the day before the exam. This will help you relax and ensure that you are alert and ready to give your best performance.

6. Offer incentives

If you are studying intensively or for a long time, motivation levels may start to drop. If you’re a teacher and you see this is the case, your class will need some additional support and encouragement to help them keep going. Small rewards can help with this.

Teacher: You can offer rewards in class by allowing students to choose an activity they enjoy, but it’s also useful for students to give themselves rewards for any goals they set and accomplish. This personalization will make the reward even more satisfying.

Self-learner: When you get to certain checkpoints of your study make sure to reward yourself with something small that you enjoy. Small rewards include things like listening to your favorite song, eating a sweet treat or watching a funny video.

7. Reduce the workload

As the exam approaches, make sure to gradually slow down. Rather than trying to learn something new, spend the last few days reviewing what you’ve studied and practice English as much as you can. On the day before the exam, do something completely different, like go for a long walk or watch a good film. Just to get your mind to wind down and relax before your exam, which will likely be quite demanding on the brain.

Managers and HR professionals have a global workforce at their fingertips – and now, . This makes adopting a secure English language test for employment more important than ever.

An online English test enables organizations to assess candidates’ language proficiency from anywhere in the world, screen more applicants, and standardize the hiring process. They also help HR professionals and managers to save time – ensuring only people with the right language skills advance to the interview stage.

But how can employers be certain these tests are safe? And how easy is it for people to cheat? In this article, we’ll explore a few of the top security concerns we hear, and share what features make online language tests secure.

What is an online English test?

An online English test measures how well a job applicant can communicate in English, focusing on speaking, listening, reading and writing skills. They also assess a candidate’s specific English for business skills – for example, how clearly someone can communicate on the phone with clients, or understand what is being said during a conference call.

Online tests can be taken in a controlled environment – in a testing center with in-person proctors – but also from a job applicant’s personal computer or mobile phone at home. When tests are taken at home, they can be made more secure using virtual proctors or powerful AI monitoring technology.

Cheating, grading and data security

When many people think of taking a language test, they imagine the traditional way: students in a large testing center scribbling away with pen and paper. No mobile phones are allowed, and if test-takers are caught cheating, they’ll be flagged by a proctor walking around the room.

So when managers or HR professionals consider the option of an online English test – taken digitally and often without human supervision – it’s no surprise that many have questions about security. Let’s take a look at some common concerns:

Is cheating a problem?

A large number of test takers admit to cheating on their tests. According to research by the International Center for Academic Integrity, 68% of undergraduate students say they’ve cheated on a writing assignment or test, while 43% of graduate students say they have.

But how easy is it to cheat during a Versant test?

The truth is, not very. With Versant, exam cheating is actually quite difficult, and test takers would have to outsmart a range of AI monitoring technologies.

If a verified photo is uploaded to the platform, HirePro’s face recognition technology can compare the live test taker with it. This ensures test takers are who they say they are, and haven’t asked someone else to sit the exam for them. It is the institution’s responsibility to verify the original photo.

And since Versant tests are monitored using specialized AI algorithms – without a human present – even the slightest suspicious behaviors are flagged for review. For example, Versant notices if a different face appears in the video, or if the camera goes dark. With video monitoring, our platform also flags if the test taker moves from the camera, or looks away multiple times. And we’ll see if someone changes tabs on their computer.

Finally, the entire test is recorded. When suspicious behavior arises, HR professionals will decide whether to accept or reject the results – or have the candidate retake the test.

Are scores accurate?

We’ve all had frustrating experiences with AI. Chatbots don’t always understand what we’re trying to say, and speech recognition technology sometimes isn’t up to par. This leaves many wondering if they should trust AI to grade high-stakes tests – especially when the results could be the difference between someone getting the job, or not.

Versant uses patented AI technology to grade tests that are trained and optimized for evaluating English language proficiency. It evaluates speaking, listening, reading, writing, and even intelligibility.

Our AI is trained using thousands of fluent and second-language English speakers. With these models, we’re able to not only evaluate how someone should be assessed but also understand when they’ve mispronounced words or have made another mistake. Using all this information, a candidate’s final score is evaluated based on more than 2000 data points.

Do online tests follow GDPR standards?

HR professionals and managers deal with sensitive personal information every day. This includes each job applicant’s name, full address, date of birth, and sometimes even their social security number. The HR tools they implement therefore must also keep this data secure.

Most importantly, it must follow GDPR standards. The data must be gathered with consent and protected from exploitation. With Versant, test-taker data is securely stored and follows all .

All our data is encrypted at rest and in transmission. Versant assessment data is stored in the US and HirePro, our remote monitoring partner, stores the proctoring data in either Singapore or Europe, depending on customer needs. Both systems are GDPR compliant.

Versant: a secure English language test

�ճ�� Versant automated language test is powered by patented AI technology to ensure the most accurate results for test takers and employers alike. Even better, our remote testing lets HR professionals securely and efficiently assess candidates worldwide, 24/7 – and recruit top global talent to help more companies scale.