The age of artificial intelligence is finally here. With the advent of technology, a lot of work is being automated and it is creating an impact in every sector. Chatgpt made a public debut in November and since then has been the top headline of every tech blog.

Let’s learn about the various uses of ChatGPT in hiring, how it is making manual work easy, and how it is scary and efficient at the same time.

A note about LLMs

LLM stands for Large Language Model, which is a type of machine learning model designed to process and generate human-like Natural Language. LLMs are typically built using neural networks and deep learning algorithms. They are trained on vast amounts of text data to learn patterns and relationships between words and phrases.

The goal of LLMs is to generate coherent and relevant responses to natural language inputs, such as questions, statements, or commands. This makes them useful for a wide range of applications, including language translation, chatbots, content generation, sentiment analysis, and answering questions.

LLMs have become increasingly popular in recent years due to advances in deep learning algorithms and the availability of large datasets. Some of the most well-known LLMs include GPT (Generative Pre-trained Transformer), BERT (Bidirectional Encoder Representations from Transformers), and T5 (Text-to-Text Transfer Transformer).

The growing demand for LLMs like ChatGPT is increasing day by day across sectors. Some burning questions need to be answered like what is the future with the usage of LLMs increasing in the industry or how can these LLMs be used efficiently to make a business more profitable.

Here at HackerEarth, we have been working on different features to combat the usage of ChatGPT in Hiring Assessments. But before that, let’s learn about LLMs and their usage in modern industries.

LLMs and their use in coding

LLMs represent a significant advancement in the field of natural language processing and have the potential to transform the way we interact with computers and other digital devices.

1. Language translation: You can use LLMs to automatically translate text from one language to another. This is particularly useful for businesses operating in multiple countries and trying to reach a global audience.
2. Chatbots: Power chatbots through LLMs that can respond to customer inquiries in natural language. This can save businesses a significant amount of time and money by automating customer service tasks.
3. Content generation: Use LLMs to generate content for websites or social media. For example, an LLM could be trained to write news articles or social media posts based on a given topic.
4. Sentiment analysis: Analyze text data and determine the sentiment behind it with LLMs. This is useful for businesses looking to monitor customer feedback or social media activity.
5. Answering questions: You can leverage LLMs to answer questions in natural language. For example, an LLM could be trained to answer questions about a company’s products or services.
6. Summarization: Automatically summarize long documents or articles with LLMs. This is useful for businesses looking to quickly extract key information from large volumes of text.

What is ChatGPT?

ChatGPT is a Large Language Model (LLM) based on the GPT (Generative Pre-trained Transformer) architecture. It is one of the most advanced LLMs available and is capable of generating human-like responses to natural language inputs.

ChatGPT is trained on vast amounts of text data and uses a deep learning algorithm to generate responses to user inputs. It can engage in conversations on a wide range of topics and is capable of providing contextually relevant and coherent responses.

One of the key advantages of ChatGPT is its ability to generate natural language responses in real time. This makes it a useful tool for a variety of applications, including chatbots, virtual assistants, and customer service platforms.

OpenAI, a leading AI research organization, developed ChatGPT. It is based on the GPT-3 architecture, which was trained on a massive dataset of over 45 terabytes of text data. Overall, ChatGPT represents a significant advancement in the field of Natural Language Processing and has the potential to transform the way we interact with computers and other digital devices.

It is a powerful tool that is being used in a variety of applications and has the potential to drive innovation and growth in a wide range of industries.

How to use ChatGPT in answering technical assessments?

Various industries use ChatGPT for various purposes. Many developers use this tool to write accurate code snippets that work according to their preferences. If they can define their parameters and conditions, ChatGPT can produce a working code that can be used in the functions.

Moreover, ChatGPT can answer complex technical questions which are both theoretical and practical. One of the shortcomings of ChatGPT is that it is not able to answer some logical reasoning questions or takes the question literally instead of contextually. This means that ChatGPT is also not able to answer context-based questions with great accuracy.

ChatGPT can also answer technical questions that are theoretical. Even with easy coding questions, ChatGPT provides excellent results but with complex scenario-based questions, it fails to provide the right solution sometimes. It cannot create complete modules for a full-stack question.

Despite its limitations, it is the right step in Natural Language Processing and the future of AI in the technology industry.

Also read: 8 Unconsciously Sexist Interview Questions You’re Asking Your Female Candidates

How does HackerEarth plan to detect plagiarism via ChatGPT in hiring assessments?

With the increasing usage of ChatGPT, a lot of our customers have written to us to ask how we plan to combat the usage of ChatGPT in hiring assessments. HackerEarth Assessments is known for its robust proctoring settings. We have added new features to detect the recent spate of plagiarism via ChatGPT.

Let me walk you through these new additions:

1. Smart Browser

One of our newer advanced proctoring features includes a Smart Browser that comes with HackerEarth’s desktop application. Enhance the proctoring of your hiring assessments. Read this article to learn more about the Smart Browser.

You need to request access to the advanced proctoring feature. To request access to Smart Browser, get in touch with your Customer Success Manager or contact  [email protected].

The various features of advanced proctoring help HackerEarth to combat the usage of ChatGPT in our hiring assessments. The smart browser includes the following features that can work against the usage of ChatGPT:

• Candidates cannot keep other applications open during the test
• Disables resizing of the test window
• Cannot use multiple monitors during the test
• Disables screen share of the test window
• Not allowed to take screenshots of the test window
• Disables recording of the test window
• Cannot use restricted keystrokes
• Disables viewing of OS notifications
• Not allowed to run the test window within a Virtual Machine
• Cannot use browser developer tools

All these features are helpful to detect the use of ChatGPT in hiring challenges. Candidates cannot resize the test window to open any other tab or application that can help them with the answers to the questions.

Also, candidates cannot use multiple monitors. It restricts them from using ChatGPT in hiring assessments to find the answers. Nor can they use any plugins. The smart browser disables copy-pasting during the test.

Also read: 3 Things To Know About Remote Proctoring

2. Tab switch proctoring setting

Use HackerEarth’s tab switch proctoring setting for hiring challenges. This setting allows you to set the number of times a candidate can move out of the test environment. The default ideal number of warnings is 5. You can change this if required.

When this is enabled, the system gives the candidate a warning each time they move out of the test environment. The following actions include but are not limited to actions that are considered as ‘moving out of the test environment’:

• Switching tabs
• Switching windows
• Opening new applications on the computer including system popups like anti-virus notifications, Lync notifications, Skype notifications, etc.
• Moving out of the test environment to close notifications is also counted as leaving the test environment.

This helps HackerEarth to flag the use of ChatGPT. As candidates are not allowed to switch tabs during the assessment. This means that they cannot switch tabs more than the given number of times or they will be logged out of the test automatically.

Additionally, they cannot use any third party web-apps to check for answers thereby curbing cheating.

3. Full-screen proctoring setting

Enable this feature to enhance the proctoring of a hiring assessment and allow your candidates to take the assessment only in a full-screen mode. As soon as the candidate opens up the assessment, the screen goes into full screen and candidates cannot exit this mode. If they try to exit the mode, they will be logged out of the assessment.

Reduce ChatGPT usage in your assessments by not allowing candidates to open any new tabs while giving the assessment. To learn more about HackerEarth’s proctoring settings, read this article.

4. Various question types

ChatGPT cannot answer logical reasoning questions with accuracy as it does not understand contextual questions.

At HackerEarth, we have a rich library of logical reasoning questions that you can use when creating assessments. ChatGPT will not be able to help answer these questions in this scenario as most of the logical answers it provides are inaccurate.

Apart from that, ChatGPT cannot answer complete full-stack questions. HackerEarth has several full-stack questions in the library that you can use to assess candidates. While ChatGPT can help in writing the code for some of the modules, it cannot answer a full stack question completely with all the functions. Even if the candidate tries to compile all the functions to create a single module, it will take a lot of time.

Similarly, recruiters can use file upload questions too which have complex scenarios and functions. ChatGPT will not be able to help answer these questions completely.

Essential insights about using ChatGPT in hiring

• LLM stands for Large Language Model. It is a type of machine learning model designed to process and generate human-like natural language.
• ChatGPT is a Large Language Model (LLM) based on the GPT (Generative Pre-trained Transformer) architecture. It is one of the most advanced LLMs available and is capable of generating human-like responses to natural language inputs.
• You can use ChatGPT to answer easy coding questions and MCQs. It can help write accurate code snippets for function modules.
• Recruiters, avoid using MCQs with direct answers as candidates can easily answer them through ChatGPT.
• HackerEarth provides various different solutions that help us to combat the usage of ChatGPT in hiring assessments. These are as follows:
  • Smart browser
  • Tab switch proctoring setting
  • Full-screen mode
  • Complex question types

Doing away with using ChatGPT in hiring assessments

The world has gradually started understanding the power of AI and this is just a mere start. No one is sure about what the future holds but we all should be ready to embrace the power of AI.

Having said that, technical assessments can still be curated without the interference of ChatGPT. Use better proctoring settings like Smart browser, tab switch, and full-screen mode. Additionally, create complex question types that are not easily answerable by ChatGPT.

Here, at HackerEarth we continuously try to improve our product so that we can efficiently fight any threats to technical hiring.

Frequently Asked Questions (FAQs)

#1 Where does HackerEarth see pre-interview tests and interviewing to be moving to in a world where ChatGPT exists?

ChatGPT’s usage is increasing day by day and candidates are getting smarter at cheating on technical assessments. You have to be proactive to combat the usage of ChatGPT. To reduce the impact on the world of interviewing and pre-interview tests.

Hopefully, in the near future, advanced proctoring settings and new question types that will not be easily answerable using ChatGPT can help improve pre-interview tests. Plagiarism detection is also one of the solutions. Currently, any code generated by ChatGPT is difficult to detect.

#2 With ChatGPT being able to solve MCQs, programming, etc. in a few minutes, does HackerEarth have a different set of problems that can be used? 

Yes, HackerEarth has a wide variety of questions that you can use to flag the usage of ChatGPT in hiring assessments. We have a rich library of full-stack question types. As previously discussed, it will be difficult for a candidate to search for different modules and compile them to complete the question. It is a time taking and complex process and hence candidates will prefer to do these questions on their own.

Moreover, ChatGPT cannot understand logical real-life scenarios. The accuracy of such answers is poor. Use a mix of logical reasoning MCQs, DevOps, and Selenium questions to check the versatility of a candidate.

The post How Does HackerEarth Combat The Use Of ChatGPT And Other LLMs In Tech Hiring Assessments? appeared first on HackerEarth Blog.