Premonition

Florida, USA, February 5, 2015 (Newswire.com) - The Brad Pitt film, Moneyball, portrays Billy Beane baseball team manager of the Oakland A’s struggling against accepted dogma in player selection. Beane’s insight was to use already available player data to pick athletes. This flew in the face of accepted conventional wisdom in the game. Talent scouts prided themselves on their “eye” for talent, choosing drafts by gut feel, pitching and batting style, even factors such as their demeanor off the field and the attractiveness of their wives and girlfriends. Despite a rocky start, strongly opposed by the A’s talent scouts, Beane put together a team that went down in baseball history. Derided, The Oakland A’s put together a roster of players believed to be lacking in talent, past their prime or unusable. Not only did the team prove itself by results, they were assembled with one of the lowest budgets in the sport. Win rates were not correlated with salary rates, Hon. Toby Unwin writes in International In-House Counsel Journal.

Lawyer selection is much like the bad old days of baseball player selection, contends Premonition LLC., a Florida based Artificial Intelligence company targeting the legal industry. Premonition claims to know which attorneys usually win before which judges. People pick attorneys based on recommendations from friends, online reviews, because they’re friends, friends of friends, went to a particular law school, have nice offices, work for a renowned firm, an advertisement, they found them in the phone book, etc. Many publications run “Top Lawyer” lists, people who are recognized by their peers as being “the best”. Premonition analyzed the win rates of these attorneys, it turned out most were average. The only way that they stood out was a disproportionate number of appealed and re-opened cases, i.e. they were good at dragging out litigation. They discovered that even the law firms themselves were poor at picking litigators. In a study of the United Kingdom Court of Appeals, it found a slight negative correlation of -0.1 between win rates and re-hiring rates, i.e. a barrister 20% better than their peers was actually 2% less likely to be re-hired!

Partners at Big Law firms are usually chosen based on the number of hours they bill and the value of clients they bring in. Courtroom prowess is a minor factor

Richard Waserstein Esq., a prominent Miami Attorney and Premonition Board member

If generally accepted methods for choosing a lawyer don’t work, what does? “Win Rate”, says Toby Unwin, inventor and Co-founder of the Premonition system. “The only item that affects the likely outcome of a case is the attorney’s prior win rate, preferably for that case type before that judge”. Wins and losses have traditionally not been tracked in law, perhaps being seen by the profession as a bit tawdry. “Attorneys don’t know their own statistics, nor do firms they work for. The only thing that gets tracked in law is hours and fees.” Unwin explains. Premonition was formed 2014 and expected to find a fertile market for their services amongst the big law firms. They found little appetite and much opposition. “In retrospect it was a stupid idea.” confides Premonition CEO and Co-Founder, Guy Kurlandski. “It was like interviewing cows, asking them what they thought of McDonalds. You don’t ask the candlemakers what they think about light bulbs.”

Despite being public record, court data is surprisingly inaccessible in bulk, nor is there a unified system to access it, outside of the Federal Courts. Clerks of courts refused Premonition requests for case data. Resolved to go about it the hard way, Unwin, wrote a web crawler to mine courthouse web sites for the data, read it, then analyze it in a database. Unwin founded NetSearch, one of the most profitable internet businesses in Europe in 1998, selling it a year later at a $160M valuation. Additional courts would be painstakingly re-coded by hand, each new source taking a week +. “It was the wrong approach. We had thousands of court to cover and it just wouldn’t scale. Then we developed an Artificial Intelligence based system that could actually learn how to crawl a court house. Now each new one takes an hour.”. 

Win Rates: Having downloaded 100'000's of cases, Premonition set about the huge task of teaching the Artificial Intelligence system to read the cases. Like a child, the system learned slowly at first, but rapidly gained in speed and accuracy. The system downloads new cases in real time, as they are filed. It analyzes them, then can create complex tables, mining overall win rates, differences from judge to judge looking for specialists in varying case types. Most of all, it looks for outliers, litigators with long strings of unbroken wins before particular judges. “Every judge has favorites.”

Premonition in action: Kurlandski recounted the story of a paralysis case on the verge of trial for a very nervous insurance client. Premonition downloaded 15,000 cases, 3 years worth of civil actions in the Reno, Nevada Courthouse. The system found an attorney with 22 straight wins before the judge - the next person down was 7. A bit of checking revealed the lawyer was actually a criminal defense specialist who operated out of a strip mall and devoted most of his Web site to his “advocacy for a particular lifestyle”. The lawyer had little reason to be before a civil Judge, let alone so often and with such a stratospheric win rate. Premonition advised he be hired as co- counsel. The case settled within weeks. The firm claims such outliers are far from rare. Their web site, shows an example of an attorney with 32 straight wins before a judge in Orange County, Florida. The attorney, an Associate at a major national law firm, has a higher win rate than the Partners at his office. 

Fees: “In law you don’t always get what you pay for”, Kurlandski claims. The firm found no correlation between win rate and billing rate. While there are undoubtedly highly paid top performers amongst the big firms, the majority of the most successful Counsel in each court is found amongst small firms and solo practitioners that Premonition refers to as “Strip mall superstars". The legal marketplace is broken. Significant opportunities for “Perception Reality Arbitrage” and Premonition is the only company to know each litigator’s true worth. He continues "Law has long been seen as a Geffen Good, an economics term whereby the more a consumer pays for something, the better it is perceived to be”. 

Case duration: Win rates aren’t the only metric Premonition tracks. “Many attorneys are notorious clock runners. They’ve got away with, because there’s been no transparency.” Unwin says. “Clients will often short-sightedly focus on an attorneys’ hourly rate. You need to look at your total spend: hourly rate x length of case + losses”. Over a portfolio of cases, these savings can be significant. Premonition can fine tune individual litigators cherry-picked for each case, or pick a better panel for the firms not willing to take the plunge into selecting new litigators every time. The firm claims attorney selection has a 30.70% effect on case success. “There’s the facts, the law and the people.” says Kurlandski. 

Analyzing big firms: Premonition recently completed a study of the major law firms. Targeting the Miami 11th Circuit Court, one of the busiest in the nation, they looked at data from 2010-October 2014, over 100,000 civil cases. Restricting the survey to just the 20 largest law firms by Attorney count in Florida then were able to extrapolate the first ever ranking of Big Law by their results. The insights were startling: 

Firm choice matters: Firm success rates ranged from 93.51% for a specialist insurance defense firm to 0% for a firm reputed to be “legal surgeons”. They had only 4 cases in the system for that court during the period analyzed, only 2 had been concluded and they lost them both. A couple of Statewide firms posted respectable 64.67% and 64.38% win rates, but 3 National firms scraped in at 37.93%,, 33.93% and 27.78%. Why do GC's hire these firms that lose 3 out of 4 times they go to court? “They don’t know. No one keeps score”.

Individual Attorney choice matters more: Success rates are not consistent within firms, they vary from office to office. Unwin showed a Statewide firm that did a lot of litigation in Miami with a good 64.67% win rate but did relatively little in Orlando at a win rate that averaged 50%. Premonition showed the stats for the a big firm in Miami. It had a 58.31% average win rate for that office. The bulk of the data came from just one litigator who was responsible for 35.42% of their cases, handling 243 for that period. His win rate was 62.14%, and it strongly affected the average for the firm. There were 2 100% win rate attorneys with 4 and 5 straight wins, but worryingly also one with 0% and 17 straight losses whose chart mark nestled next to a 3.45% win rate.

One lawyer had 28 losses out of 29 appearances. “It’s often a lottery who you get assigned to in these firms”. “If a GC feels they have  a strong relationship with their existing firm that they could never leave, they should, at least, pick a results-based panel from within that firm, not just accept the first person offered, or insist blindly on a Senior Partner in the hope they are hiring quality.” 

There are few Top 20 performers among the Big Firms: There is usually one representative from the top firms before each judge, occasionally two. However many judges have no Big Law top performers before them. It became very clear that the majority of top performers were in small firms or solo practitioners. Should companies just hire from the small firms? “No. You see that just because there are more solo and small firm attorneys than those employed at the big firms. Win rate isn’t correlated with firm size”, Unwin says. 

To read more please visit www.premonition-analytics.com