What to do when data analytics is not an option

Jason Ku • 27 June 2019

Imagine you have finished a long day of interviews and have two remaining candidates for one legal trainee position. 

  • Candidate A ticks all the boxes and would be the logical candidate to pick. Good grades, well presented, recommendations from professors. But there’s something off about them. The way they talk reminds you of someone who turned out to have poor professional ethics. But there’s no way to be sure.

  • Candidate B has some shortcomings but there’s something about them that you just cannot put your finger on. It’s like this young person is destined for greatness. 

What do you do? If you haven’t already done analysis, it won’t be possible to fire up some analytical tools to guide you. You’ll need to make a decision then and there.

The tension between gut and data

We at Pirical love data. In our ideal world, all decisions are made on sound rational foundations. 

But we have to be realistic: 

  • Sometimes there is not enough data available;

  • Or the teams in charge need to make a decision quickly and don’t have enough time to peruse all available data;

  • Or a firm is only starting to build their data analytics capabilities and need to bridge the time until they are ready. 

Still, there is a good middle ground between making completely gut-based decisions and the ideal scenario of data-driven action. 

The happy medium

Here are two things you can do to mitigate the negative consequences of gut-based decision-making.


1. Become aware of your biases

When famous mathematician Douglas Hofstadter works on a difficult problem, he always starts with a “hunch” and seeks to prove or disprove it. 

This hypothesis-driven problem solving, as it is called in management consulting firms, is generally a useful approach, even if you don’t have data to prove or disprove them. Discussions with your team then become the substitute.

As you are working towards a solution, become aware of your biases, and be alert if you find them repeatedly skewing in the same direction. 

For example, when trying to resolve conflicts between employees, notice if and when you find yourself defaulting to taking the side of a particular group (e.g. women, minorities, senior staff) instead of being purely driven by the facts of each case. This could be a sign of undue bias and, thus, likely poor decision-making.

Another example of uni-directional bias is our analysis of interviewing effectiveness. The company in question favoured job candidates who did well in a group interview (instead of assigning other interview formats the same weight). This bias towards group interviews was skewing their recruitment results because it had the potential to exclude analytically brilliant, but less charismatic or gregarious candidates.

The best way to prevent these types of bias is to always look at the underlying data first. 

When no data is available, the second best approach is to discuss with others and let them challenge your biases. As Ray Dalio writes in Principles , people are wired very differently, and everyone sees the world from a different angle. Allowing others to stress-test your biases can be a good substitute for weighing the data. 

Which brings us to the second point. 

2. Cultivate radical openness

It’s a common scenario: Junior employees are queasy about challenging their superiors when it comes to making an important decision, even when they are strongly convinced that they are right. 

If your firm doesn’t actively champion dissenting opinions, you increase the risk of poor gut-based decision making. If there is a risk of negative consequences for openly disagreeing with a more senior person, people will practice anticipatory obedience and bury their dissent. 

A culture of radical openness where the leader is genuinely excited at the prospect of being convinced with good arguments is the best substitute for being proven wrong with data.  Healthy debate - whatever the outcome, is always a good thing.

Conclusion

These are the ways how you can counteract lack of data: 

  1. Be aware of your biases

  2. Cultivate a culture of radical openness

And if you do want to place your decision-making on a data-driven foundation after all, we at Pirical would love to work with you. 

Contact us here for a no-obligation call to explore how we can help you unearth and activate data in your organisation. 



Subscribe to the latest data insights & blog updates



Fresh, original content for Law Firms and Legal Recruiters interested in data, diversity & inclusion, legal market insights, recruitment, and legal practice management.

Get updates via email
James Charlton, SSQ
by Aidan Scanlon • 4 minute read 19 June 2025
We spoke to James Charlton, CFO & COO at SSQ about how his team uses Pirical Legal Professionals (PLP) to research the candidate market and build stronger relationships with their clients.
A green map of the united kingdom on a white background.
by Aidan Scanlon 11 June 2025
London dominates much of the UK's legal landscape but other legal hubs play a significant role and some are even growing at a faster rate. We've taken a closer look at the current distribution of the UK's top lawyers, which markets have been growing the fastest, and how large a presence US firms now have in the UK. Using publicly-available data tracked by Pirical Legal Professionals (PLP) , here's a snapshot of the UK legal market in 2025.
Photo from Pirical Pioneers 2025
20 May 2025
Last week, Pirical celebrated a decade of innovation at our biggest Pirical Pioneers event to date! We brought together a fantastic crowd of Recruitment, Strategy, HR & DEI leaders for some insightful panel discussions and previews of our latest tools & new features.
McDermott's office growth post-merger
by Aidan Scanlon 9 May 2025
Explore how the McDermott and Schulte merger will create a top 20 AM Law 100 firm, expanding presence in NYC and London and transforming the legal market.
US attorney headcount by city
by Aidan Scanlon 6 May 2025
Which US states and cities have the highest number of attorneys, which practice areas are the most prominent and which firms are leading the market with the highest Partner headcount
Lateral Partner demand in certain practices shifted across different segments of the AM Law 200
by Aidan Scanlon 30 January 2025
Using publicly-available data from Pirical Legal Professionals (PLP), we've taken a look at the lateral Partner hires and headcount growth from 2024 to see which law firms and practices had the most interesting growth stories of the year.
More posts