Home
/
Blog
/
DEI Hiring
/
Data-Driven Recruiting: All You Need To Know

Data-Driven Recruiting: All You Need To Know

Author
Kumari Trishya
Calendar Icon
June 7, 2022
Timer Icon
8 min read
Share

Hiring and talent acquisition are the cornerstones of business growth. When you need to scale your business, you look at the recruiting teams to bring in the talent needed for success. Hiring at scale is not an easy feat, and doing it well without having an analytical and data-driven recruiting approach is even harder.

Why is data important in tech recruiting? Let’s break this down logically. When you hire in large numbers – say thousands of tech hires in a year; you want to be as efficient as possible. To do so you need to know which channels are working better than others. Are most of your hires responding to your LinkedIn ad, or is GitHub the platform of choice for new hires? Conversely, are the channels different when it comes to hiring interns versus lateral hires?

What is data-driven recruiting?

TTH (Time To Hire) is a metric every recruiter is familiar with. Ideally, recruiters like to keep their TTH low. You cannot, however, do this if you’re not aware of what works and what doesn’t. This is possible only when you have looked at the hiring data and found patterns that work, and those that don’t. Data-driven recruiting makes this possible.

In the simplest of terms, data-driven recruiting is a scientific method of collecting, analyzing, and using analytical data about candidate behavior to make inferences that are used to drive decisions throughout the tech hiring funnel.

What are the benefits of data-driven recruitment?

We know that tech recruiting is a multi-dimensional process. There are a number of elements that affect every stage of the recruitment funnel. Being aware of the right metrics enables tech recruiters in streamlining and optimizing every step of the funnel to increase overall effectiveness.

Also Read: How To Get Your Recruiting Metrics Right In 2022

There is a singular goal to this process: to hire better and get the best possible ROI for the time that a recruiter spends trying to fill a vacant role. In many ways, data-driven recruitment empowers recruiters to make educated opinions and change their hiring strategy (if needed) through the long-winding process of developer recruitment.

Data driven recruiting insights | HackerEarth

What kind of data should I be tracking?

One of the most important aspects of using data for decision making is to know which data to look at, and which is irrelevant. Let’s take a look at some of the key recruitment metrics related to tech hiring that every recruiter needs to keep an eye on.

These metrics would provide a good launch platform to optimize your recruiting and onboarding process with available data:

1. Cost To Hire (CTH)

The end result of hiring is onboarding a developer with a definite CTC. That, however, is not the only expense involved in hiring said developer.

The CTH of hiring a developer can be split into two halves:

a. Internal recruiting costs: This involves any and every internal expense including (but not limited to) employee referral incentives, recruiters’ salaries, and interviewing costs. You can calculate interviewing costs by the following formula:

Interviewing Cost = Number of hours of interviews X Hourly salary of involved employees

Since tech recruiting can involve interviews with engineering managers and CTOs, hence the interviewing cost for every developer would take into account all shareholders across the process.

b. External recruiting costs: This includes expenses incurred as part of banding and marketing costs, recruitment software and events, and external recruiter agency fees.

Your final CTH or cost per hire would then be calculated as:

CPH = Total internal cost + Total external cost / Total number of hires

2. Time To Fill (TTF) and Time To Hire (TTH)

While both these terms sound similar, the difference is very important for recruiters.

‘Time To Fill’ refers to the time taken to fill a position from the moment the position was advertised, until a candidate accepts the job offer, and the position is filled.

‘Time To Hire’ on the other hand only estimates the time it takes from first contact (i.e. the first phone call or meeting) until the job offer is accepted.

If a position is taking longer to fill, then you must take a look at the strategy for advertising and outreach. Is the job position easily noticeable and searchable on the website? Has there been enough efforts on the social handles to promote the role?

However, if your TTH is on the higher side, then you have to consider if your interviews are longer than needed. Are you spending too much time on assignments, or are there any other stages of the hiring process that you can cut down? Sometimes, a lot of time goes by in trying to get all stakeholders on the same page, and getting feedback post-interview. If these are the steps that are inflating your TTH, then you should have a talk with all involved team members.

3. Candidate Experience Metrics

In recent years, the term candidate experience has gained notoriety in tech hiring circles. It refers to candidates’ overall impression of your company’s recruitment processes. This takes into account all the various touch points right from the moment a candidate browses your careers page, the emails and other communiques sent out to them, the process of assessments and interviews, up until they receive a job offer or rejection email (or are ghosted in some cases).

At every step of the way, candidates are forming an opinion not just about your company, but also about how you treat a prospective employee. Many developers choose to share their opinions on sites like Glassdoor or with their friends and colleagues, and these reviews and word-of-mouth opinions can impact your reputation as an employer.

Candidate experience survey sample | HackerEarth

In order to understand what candidates think about your brand, get the data from the horses’ mouth (figuratively speaking!). Hiring a third-party research company to create anonymous, objective measurements and surveys is a great idea. Alternatively, you can create a candidate experience survey yourself, and send it to a large pool of candidates and new hires. Remember to include candidates that have rejected your offer, or dropped off after the initial chat. The more diverse the sample pool, the better your insights.

4. Quality Of Hire (QoH)

Quality is indeed a subjective metric, but there are ways in which you can compare the quality of a current hire with past hires. Look at the value the new hire is adding to the organization i.e. the new hire’s performance as compared to pre-hire expectations. The QoH of any hire should be determined within the first year of their joining the organization. Doing so helps you understand the outcomes delivered by your current recruitment practices.

Sometimes, a candidate can check all the right boxes during assessments and interviews, only to find that they are not up to the daily work routine. Research says that as many as 1 in 4 new hires will quit a job in their first six months. If this is an issue you are grappling with, then it’s time to question the quality of your hires and find out ways to improve your QoH.

There is no exact formula to define QoH, but some recruiters like to define it as:

QoH = (Indicator A% + Indicator B% + Indicator C%…) ÷ Number of Indicators

This formula uses agreed upon indicators of performance to calculate QoH. For a tech hire, these indicators can be the number of projects they complete in a month, or their code quality.

Another way to calculate QoH is by using the Net Hiring Score. This is a scale of 0-10 (with 0 being poor, and 10 being excellent), which managers can use to rate a new hire. The employee is also given a similar scorecard which they can use to rate job fit and whether the company meets their expectations.

Your Net Hiring Score is therefore defined as:

Net Hiring Score = Percentage of poor fits (0-6) – Percentage of great fits (scaled 9 or 10) X 100

If the result is <0, too many poor fits are being hired, but a number greater than 0 indicates more great fits are being hired, which is what recruiters should be aiming for.

5. Diversity and inclusion metrics

For a long time, diversity was limited to having an equal ratio of men and women in the workplace. Today, the definition of diversity extends beyond gender to include race, nationality, education level, age, disability, family status, employment status (full-time, part-time, flexible), immigration status, and much more.

Monitoring these metrics should be contextual to an organization’s local milieu. Recruiters should look at the issues being highlighted by the tech community in their area and try to address those. Every nation has different legal, political, historical, and cultural environments which determine relevant diversity metrics. While gender inequality is a global issue, some locations may have an additional religious or ethnical bias, which you would need to correct.

While we agree that developing a multicultural organization with all-inclusive policies can be challenging, this is where data analytics can play a huge role in creating awareness. By identifying patterns of behavior and bias, we can highlight the areas where a company, or an individual who’s also a decision maker, is being exclusive or prejudiced. Identifying these voids is the first step to adapting and developing diversity in recruitment. You can then use these insights to create a process that sidesteps these challenges and promotes equity and equality.

How to implement a data-driven recruiting process?

There is an apt idiom in the tech world -Data in, Data out. To fuel a data-driven hiring process, you need to first ensure you are collecting data efficiently. Choose the metrics you want to measure, and create a streamlined methods of collecting these data points.

A data-driven recruiting strategy can be designed using the following steps:

  • Create Applicant Funnels
  • Evaluate At Scale
  • Improve Close Rate
  • Post-Hiring Evaluations

At HackerEarth, we like to use the following funnel:

Engage > Source > Assess > Interview > Onboard > Upskill

This allows us to have a bird’s eye view of the entire hiring and retention funnel, while being able to break it down into segments and measure each effectively. For instance, if the Source > Assess segment is showing a huge time lag, then we know that we have to increase the speed at which we create and send assessments to candidates. Or if the Assess > Interview segment is what is slowing us down, then we can improve on how we gather feedback and action upon it, and connect with the hiring managers to ensure their availability for interviews.

Whether you are evaluating thousands of developers for a role, or talking to passive candidates for a lateral role, the larger your data set and the more detailed your report, the stronger your process will be. Keep details of every candidate interaction and action. How long did it take candidates to submit a coding assessment? How long for feedback, or interviews? Having these metrics on paper will help you point out the gaps in your process and improve your close rate.

And yes! Don’t forget about the post-hiring evaluations. Many recruiters think their job ends the moment says yes to a role. However, once you have closed a role you can then ask the developer for feedback and improve your data-driven recruiting process. Or, you can look at the segments of the funnel where you think you lost time and figure out to make those time sinks disappear.

Tech recruiting is known to be tedious, and I hope these tips will help you make the long hours more productive. Happy hiring!

Subscribe to The HackerEarth Blog

Get expert tips, hacks, and how-tos from the world of tech recruiting to stay on top of your hiring!

Author
Kumari Trishya
Calendar Icon
June 7, 2022
Timer Icon
8 min read
Share

Hire top tech talent with our recruitment platform

Access Free Demo
Related reads

Discover more articles

Gain insights to optimize your developer recruitment process.

Vibe Coding: Shaping the Future of Software

A New Era of CodeVibe coding is a new method of using natural language prompts and AI tools to generate code. I have seen firsthand that this change makes software more accessible to everyone. In the past, being able to produce functional code was a strong advantage for developers. Today,...

A New Era of Code

Vibe coding is a new method of using natural language prompts and AI tools to generate code. I have seen firsthand that this change makes software more accessible to everyone. In the past, being able to produce functional code was a strong advantage for developers. Today, when code is produced quickly through AI, the true value lies in designing, refining, and optimizing systems. Our role now goes beyond writing code; we must also ensure that our systems remain efficient and reliable.

From Machine Language to Natural Language

I recall the early days when every line of code was written manually. We progressed from machine language to high-level programming, and now we are beginning to interact with our tools using natural language. This development does not only increase speed but also changes how we approach problem solving. Product managers can now create working demos in hours instead of weeks, and founders have a clearer way of pitching their ideas with functional prototypes. It is important for us to rethink our role as developers and focus on architecture and system design rather than simply on typing code.

The Promise and the Pitfalls

I have experienced both sides of vibe coding. In cases where the goal was to build a quick prototype or a simple internal tool, AI-generated code provided impressive results. Teams have been able to test new ideas and validate concepts much faster. However, when it comes to more complex systems that require careful planning and attention to detail, the output from AI can be problematic. I have seen situations where AI produces large volumes of code that become difficult to manage without significant human intervention.

AI-powered coding tools like GitHub Copilot and AWS’s Q Developer have demonstrated significant productivity gains. For instance, at the National Australia Bank, it’s reported that half of the production code is generated by Q Developer, allowing developers to focus on higher-level problem-solving . Similarly, platforms like Lovable enable non-coders to build viable tech businesses using natural language prompts, contributing to a shift where AI-generated code reduces the need for large engineering teams. However, there are challenges. AI-generated code can sometimes be verbose or lack the architectural discipline required for complex systems. While AI can rapidly produce prototypes or simple utilities, building large-scale systems still necessitates experienced engineers to refine and optimize the code.​

The Economic Impact

The democratization of code generation is altering the economic landscape of software development. As AI tools become more prevalent, the value of average coding skills may diminish, potentially affecting salaries for entry-level positions. Conversely, developers who excel in system design, architecture, and optimization are likely to see increased demand and compensation.​
Seizing the Opportunity

Vibe coding is most beneficial in areas such as rapid prototyping and building simple applications or internal tools. It frees up valuable time that we can then invest in higher-level tasks such as system architecture, security, and user experience. When used in the right context, AI becomes a helpful partner that accelerates the development process without replacing the need for skilled engineers.

This is revolutionizing our craft, much like the shift from machine language to assembly to high-level languages did in the past. AI can churn out code at lightning speed, but remember, “Any fool can write code that a computer can understand. Good programmers write code that humans can understand.” Use AI for rapid prototyping, but it’s your expertise that transforms raw output into robust, scalable software. By honing our skills in design and architecture, we ensure our work remains impactful and enduring. Let’s continue to learn, adapt, and build software that stands the test of time.​

Ready to streamline your recruitment process? Get a free demo to explore cutting-edge solutions and resources for your hiring needs.

Guide to Conducting Successful System Design Interviews in 2025

What is Systems Design?Systems Design is an all encompassing term which encapsulates both frontend and backend components harmonized to define the overall architecture of a product.Designing robust and scalable systems requires a deep understanding of application, architecture and their underlying components like networks, data, interfaces and modules.Systems Design, in its...

What is Systems Design?

Systems Design is an all encompassing term which encapsulates both frontend and backend components harmonized to define the overall architecture of a product.

Designing robust and scalable systems requires a deep understanding of application, architecture and their underlying components like networks, data, interfaces and modules.

Systems Design, in its essence, is a blueprint of how software and applications should work to meet specific goals. The multi-dimensional nature of this discipline makes it open-ended – as there is no single one-size-fits-all solution to a system design problem.

What is a System Design Interview?

Conducting a System Design interview requires recruiters to take an unconventional approach and look beyond right or wrong answers. Recruiters should aim for evaluating a candidate’s ‘systemic thinking’ skills across three key aspects:

How they navigate technical complexity and navigate uncertainty
How they meet expectations of scale, security and speed
How they focus on the bigger picture without losing sight of details

This assessment of the end-to-end thought process and a holistic approach to problem-solving is what the interview should focus on.

What are some common topics for a System Design Interview

System design interview questions are free-form and exploratory in nature where there is no right or best answer to a specific problem statement. Here are some common questions:

How would you approach the design of a social media app or video app?

What are some ways to design a search engine or a ticketing system?

How would you design an API for a payment gateway?

What are some trade-offs and constraints you will consider while designing systems?

What is your rationale for taking a particular approach to problem solving?

Usually, interviewers base the questions depending on the organization, its goals, key competitors and a candidate’s experience level.

For senior roles, the questions tend to focus on assessing the computational thinking, decision making and reasoning ability of a candidate. For entry level job interviews, the questions are designed to test the hard skills required for building a system architecture.

The Difference between a System Design Interview and a Coding Interview

If a coding interview is like a map that takes you from point A to Z – a systems design interview is like a compass which gives you a sense of the right direction.

Here are three key difference between the two:

Coding challenges follow a linear interviewing experience i.e. candidates are given a problem and interaction with recruiters is limited. System design interviews are more lateral and conversational, requiring active participation from interviewers.

Coding interviews or challenges focus on evaluating the technical acumen of a candidate whereas systems design interviews are oriented to assess problem solving and interpersonal skills.

Coding interviews are based on a right/wrong approach with ideal answers to problem statements while a systems design interview focuses on assessing the thought process and the ability to reason from first principles.

How to Conduct an Effective System Design Interview

One common mistake recruiters make is that they approach a system design interview with the expectations and preparation of a typical coding interview.
Here is a four step framework technical recruiters can follow to ensure a seamless and productive interview experience:

Step 1: Understand the subject at hand

  • Develop an understanding of basics of system design and architecture
  • Familiarize yourself with commonly asked systems design interview questions
  • Read about system design case studies for popular applications
  • Structure the questions and problems by increasing magnitude of difficulty

Step 2: Prepare for the interview

  • Plan the extent of the topics and scope of discussion in advance
  • Clearly define the evaluation criteria and communicate expectations
  • Quantify constraints, inputs, boundaries and assumptions
  • Establish the broader context and a detailed scope of the exercise

Step 3: Stay actively involved

  • Ask follow-up questions to challenge a solution
  • Probe candidates to gauge real-time logical reasoning skills
  • Make it a conversation and take notes of important pointers and outcomes
  • Guide candidates with hints and suggestions to steer them in the right direction

Step 4: Be a collaborator

  • Encourage candidates to explore and consider alternative solutions
  • Work with the candidate to drill the problem into smaller tasks
  • Provide context and supporting details to help candidates stay on track
  • Ask follow-up questions to learn about the candidate’s experience

Technical recruiters and hiring managers should aim for providing an environment of positive reinforcement, actionable feedback and encouragement to candidates.

Evaluation Rubric for Candidates

Facilitate Successful System Design Interview Experiences with FaceCode

FaceCode, HackerEarth’s intuitive and secure platform, empowers recruiters to conduct system design interviews in a live coding environment with HD video chat.

FaceCode comes with an interactive diagram board which makes it easier for interviewers to assess the design thinking skills and conduct communication assessments using a built-in library of diagram based questions.

With FaceCode, you can combine your feedback points with AI-powered insights to generate accurate, data-driven assessment reports in a breeze. Plus, you can access interview recordings and transcripts anytime to recall and trace back the interview experience.

Learn how FaceCode can help you conduct system design interviews and boost your hiring efficiency.

How Candidates Use Technology to Cheat in Online Technical Assessments

Impact of Online Assessments in Technical Hiring In a digitally-native hiring landscape, online assessments have proven to be both a boon and a bane for recruiters and employers. The ease and...

Impact of Online Assessments in Technical Hiring


In a digitally-native hiring landscape, online assessments have proven to be both a boon and a bane for recruiters and employers.

The ease and efficiency of virtual interviews, take home programming tests and remote coding challenges is transformative. Around 82% of companies use pre-employment assessments as reliable indicators of a candidate's skills and potential.

Online skill assessment tests have been proven to streamline technical hiring and enable recruiters to significantly reduce the time and cost to identify and hire top talent.

In the realm of online assessments, remote assessments have transformed the hiring landscape, boosting the speed and efficiency of screening and evaluating talent. On the flip side, candidates have learned how to use creative methods and AI tools to cheat in tests.

As it turns out, technology that makes hiring easier for recruiters and managers - is also their Achilles' heel.

Cheating in Online Assessments is a High Stakes Problem



With the proliferation of AI in recruitment, the conversation around cheating has come to the forefront, putting recruiters and hiring managers in a bit of a flux.



According to research, nearly 30 to 50 percent of candidates cheat in online assessments for entry level jobs. Even 10% of senior candidates have been reportedly caught cheating.

The problem becomes twofold - if finding the right talent can be a competitive advantage, the consequences of hiring the wrong one can be equally damaging and counter-productive.

As per Forbes, a wrong hire can cost a company around 30% of an employee's salary - not to mention, loss of precious productive hours and morale disruption.

The question that arises is - "Can organizations continue to leverage AI-driven tools for online assessments without compromising on the integrity of their hiring process? "

This article will discuss the common methods candidates use to outsmart online assessments. We will also dive deep into actionable steps that you can take to prevent cheating while delivering a positive candidate experience.

Common Cheating Tactics and How You Can Combat Them


  1. Using ChatGPT and other AI tools to write code

    Copy-pasting code using AI-based platforms and online code generators is one of common cheat codes in candidates' books. For tackling technical assessments, candidates conveniently use readily available tools like ChatGPT and GitHub. Using these tools, candidates can easily generate solutions to solve common programming challenges such as:
    • Debugging code
    • Optimizing existing code
    • Writing problem-specific code from scratch
    Ways to prevent it
    • Enable full-screen mode
    • Disable copy-and-paste functionality
    • Restrict tab switching outside of code editors
    • Use AI to detect code that has been copied and pasted
  2. Enlist external help to complete the assessment


    Candidates often seek out someone else to take the assessment on their behalf. In many cases, they also use screen sharing and remote collaboration tools for real-time assistance.

    In extreme cases, some candidates might have an off-camera individual present in the same environment for help.

    Ways to prevent it
    • Verify a candidate using video authentication
    • Restrict test access from specific IP addresses
    • Use online proctoring by taking snapshots of the candidate periodically
    • Use a 360 degree environment scan to ensure no unauthorized individual is present
  3. Using multiple devices at the same time


    Candidates attempting to cheat often rely on secondary devices such as a computer, tablet, notebook or a mobile phone hidden from the line of sight of their webcam.

    By using multiple devices, candidates can look up information, search for solutions or simply augment their answers.

    Ways to prevent it
    • Track mouse exit count to detect irregularities
    • Detect when a new device or peripheral is connected
    • Use network monitoring and scanning to detect any smart devices in proximity
    • Conduct a virtual whiteboard interview to monitor movements and gestures
  4. Using remote desktop software and virtual machines


    Tech-savvy candidates go to great lengths to cheat. Using virtual machines, candidates can search for answers using a secondary OS while their primary OS is being monitored.

    Remote desktop software is another cheating technique which lets candidates give access to a third-person, allowing them to control their device.

    With remote desktops, candidates can screen share the test window and use external help.

    Ways to prevent it
    • Restrict access to virtual machines
    • AI-based proctoring for identifying malicious keystrokes
    • Use smart browsers to block candidates from using VMs

Future-proof Your Online Assessments With HackerEarth

HackerEarth's AI-powered online proctoring solution is a tested and proven way to outsmart cheating and take preventive measures at the right stage. With HackerEarth's Smart Browser, recruiters can mitigate the threat of cheating and ensure their online assessments are accurate and trustworthy.
  • Secure, sealed-off testing environment
  • AI-enabled live test monitoring
  • Enterprise-grade, industry leading compliance
  • Built-in features to track, detect and flag cheating attempts
Boost your hiring efficiency and conduct reliable online assessments confidently with HackerEarth's revolutionary Smart Browser.
Top Products

Explore HackerEarth’s top products for Hiring & Innovation

Discover powerful tools designed to streamline hiring, assess talent efficiently, and run seamless hackathons. Explore HackerEarth’s top products that help businesses innovate and grow.
Frame
Hackathons
Engage global developers through innovation
Arrow
Frame 2
Assessments
AI-driven advanced coding assessments
Arrow
Frame 3
FaceCode
Real-time code editor for effective coding interviews
Arrow
Frame 4
L & D
Tailored learning paths for continuous assessments
Arrow
Get A Free Demo