Contract analysis: Difference between revisions

no edit summary
No edit summary
No edit summary
Line 1: Line 1:
{{a|devil|
{{a|devil|
[[File:Zen.jpg|450px|thumb|center|Sir! Sir! I've found an [[indemnity]]!]]
[[File:Zen.jpg|450px|thumb|center|Sir! Sir! I've found an [[indemnity]]!]]
}}Luminaries, [[thought leader]]s and [[digital prophet]]s will tell you that machines can now read and annotate contracts, such that yon poor [[legal eagles]] are no longer needed and will shortly hacve no choice but to work as [[technological unemployment|pleasure droids]] for our transistor-based overlords. Quoth one such [[digital prophet]]:
}}Luminaries, [[thought leader]]s and [[digital prophet]]s will tell you that machines can now read and annotate contracts, such that yon poor [[legal eagles]] are no longer needed and will shortly have no choice but to work as [[technological unemployment|pleasure droids]] for our transistor-based overlords. Quoth one such [[digital prophet]]:


:''... machines are also increasingly encroaching on tasks that, until now, have required a human ability to think and reason. In the legal sphere, for example, J. P. Morgan has developed a system that reviews commercial [[loan|loan agreements]]. It does in a few seconds what would have required, they estimate, about 360,000 hours of human lawyer time.''
:''... machines are also increasingly encroaching on tasks that, until now, have required a human ability to think and reason. In the legal sphere, for example, J. P. Morgan has developed a system that reviews commercial [[loan|loan agreements]]. It does in a few seconds what would have required, they estimate, about 360,000 hours of human lawyer time.''
::— {{author|Daniel Susskind}}, {{br|A World Without Work}}
::— {{author|Daniel Susskind}}, {{br|A World Without Work}}


''Three hundred and sixty thousand hours of professional work carried out in seconds''. Sounds — literally — incredible, doesn’t it? Preternaturally intelligent silicon minds scanning and processing gigabytes of diverse text in an instant and analysing it for all material quirks and issues, like Zen from ''Blake’s Seven''. [[Get your coat]], [[legal eagles]].
''Three hundred and sixty thousand hours of professional work carried out in seconds''. Sounds — literally — incredible, doesn’t it? Preternaturally intelligent silicon minds scanning and processing gigabytes of text in an instant, extracting all material quirks and issues, like Zen from ''Blake’s Seven''. [[Get your coat]], [[legal eagles]].
===Contract analysis or data extraction?===
===Contract analysis or data extraction?===
But let’s just stop and consider what is actually going on here: a  bank seeking to reviewing tens and probably ''hundreds'' of thousands of ''its own'' commercial loans. These loans will be rendered in the hideous, overwrought prose of the banking lawyer, to be sure, but — even allowing for template variations and [[Legal evolution|evolution]] (by which I mean periodic [[Cambrian explosion]]s  of [[flannel|flannelry]] to which not even the House of Morgan is immune), ''the contracts will all be basically the same''. If there has been a modicum of [[legal design]] applied — okay, that’s quite a big if — there will be a predictable schedule of customer details and economic variables — dates, amounts, currencies, rates, and optional elections — but the ''legal terms'', however gruesomely articulated, will be homogeneous and, in any case ''within the bank’s control'': a commercial bank with half a brain won’t ''allow'' its customers to wordsmith its standard terms. If it does, then ''that'' is the problem to be solved, not “how can I possibly understand all these varied terms I have agreed with hundreds of thousands of customers?”
But remember what is going on here: a  bank is reviewing thousands of ''its own'' contracts. They will be rendered in overwrought prose no doubt, but — even allowing for template variations and [[Legal evolution|evolution]],<ref>By which I mean periodic [[Cambrian explosion]]s  of [[flannel|flannelry]] to which not even the House of Morgan is immune.</ref> ''the contracts will all be basically the same''.  


Note the irony: it was only thanks to this kind of technology that we can even ''contemplate'' micro-variations to standard terms: behold the [[technology paradox]]: what Andy Grove giveth, the [[legal eagle]]’s innate appetite for pedantry taketh away. Technology that allows one to ''ignore'' the [[root cause]] of the problem and carry on anyway is ''bad'' technology.  
If there has been a modicum of [[legal design]] applied — okay; quite a big if — customer details and economic variables will already be set out in a schedule. The ''legal terms'', however gruesomely articulated, will be homogeneous.<ref>In any case ''they will be within the bank’s control'': a competent commercial bank won’t ''allow'' customers to wordsmith its standard terms. If it does, then ''that'' is the problem, not “how can I possibly understand all these varied terms I have agreed with hundreds of thousands of customers?” Note the irony: it was only thanks to this kind of technology that we can even ''contemplate'' micro-variations to standard terms: behold the [[technology paradox]]: what Andy Grove giveth, the [[legal eagle]]’s innate appetite for pedantry taketh away. Technology that allows one to ''ignore'' the [[root cause]] of the problem and carry on anyway is ''bad'' technology. </ref>


But we digress. In any case, “reviewing one hundred thousand commercial loan agreements” really means “processing one hundred thousand tables of structured data”. This, doubtless, would take (and cost) an ''aeon'' if assigned to a battalion of [[legal eagles]], and would in the process ''drive each of the poor buggers up the wall'', but to be clear it would require ''absolutely no judgement, let alone legal acumen''. It is a matter of transcription.
In any case, “reviewing a hundred thousand commercial loan agreements” really means “processing one hundred thousand tables of structured data”. This, doubtless, would take (and cost) an ''aeon'' if assigned to a battalion of [[legal eagles]], and would in the process ''drive each of the poor buggers up the wall'', but to be clear it would require ''absolutely no judgement, let alone legal acumen''. It is a matter of transcription.


Assigning a lawyer to this task would, in any era, have been an act of cruel & unusual punishment, not to mention economic folly. It is not news that [[difference engine]]s can process structured data better than [[meatware]]. This use of Pentium processing power is hardly the proverbial [[Apocalypse|horseman on the lawyer’s ridge]].
Assigning a lawyer to this task would, in any era, have been an act of cruel & unusual punishment, not to mention economic folly. It is not news that [[difference engine]]s can process structured data better than [[meatware]]. This use of Pentium processing power is hardly the proverbial [[Apocalypse|horseman on the lawyer’s ridge]].


===[[Contract review tool]]s===
===[[Contract review tool]]s===
More ''potentially'' transformative are emerging “[[Artificial intelligence|artificially intelligent]]” [[contract review tool]]s. These promise to take a ''foreign'' draft, received from a counterparty, and analyse it against a pre-defined [[playbook]], together with other examples which the machine has already learned from, mark it up, and return it for completion of the negotiation.
More potentially transformative are emerging “artificially intelligent” contract review tools. These promise to take a counterparty’s draft, analyse it against a pre-defined [[playbook]] and automatically mark it up.  


This is a much harder stunt than reviewing your own standard terms. Legal text from random strangers can, and often does, say ''anything'', and is liable to be rendered in the sort of inventively tumid syntax that only a trained professional could confect.  
That ''is'' legal work. It is a much harder stunt than reviewing your own standard terms. Now, “[[natural language processing]]” means the ''mechanical'' processing of ''natural language'', not the [[natural]] processing of language. It is a dumb, statistical, pattern-recognising process. It doesn’t understand. The AI proposition is that, to a certain point, ''it doesn’t need to''. It can still play a useful role in the process even though it doesn’t.


'Semantically'', human languages are fundamentally ambiguous. Machines do not ''understand'' them. That's not how the [[AI]] works. “[[Natural language processing]]” means the ''mechanical'' processing of natural language, not the ''natural'' processing of language. It is a dumb, statistical, pattern-recognising process.
So however accurate a machine’s mark-up may be, a human will need to read it for sense. Especially with important agreements.


So however accurate a mark-up may become, there will always be a need for a human to read and approve it. A common subject for these contract review tools is [[confidentiality agreement]]s, being as they are (a) low risk; (b) ''substantially'' standard: all confis say the same basic things; and (c) ''formally'' variable: there is no limit to the profligacy with which legal eagles can waste words in articulating generic commercial requirements.
[[Confidentiality agreement]]s are common fodder for [[automated contract review]], being low risk, ''substantially'' standard but ''formally'' variable: there is no limit to the profligacy with which [[legal eagles]] can waste words in articulating generic commercial requirements; someone needs to check them, but it’s dullsville work. The AI can chop some wood here.


But even here, technology disappoints. By and large it has made the existing problem ''worse''. Institutions are now ''decommissioning'' contract review systems the same way they are repatriating once offshored operations functions.<ref>Isn’t it funny how you never hear about ''cancelled'' offshore operations?</ref> It is worth investigating why.
But even here, technology disappoints. In many ways it has made the problem ''worse''.  


====The problem statement====
====The problem to be solved====
What is the problem the contract review tool is designed to solve: [[Confidentiality agreement]]s are fiddly, but low-risk agreements that one must get through as quickly as possible to get to the fruitier deal negotiations they promise. Confis tend to be an “I’ll show you mind if you show me yours” kind of affair. But — especially in this data-obsessed world — they have buried risks if you don’t watch them carefully.<ref>The [[JC]] has a whole [[Confi Anatomy|confi anatomy]] you can peruse if you would like to know more.</ref>
Confidentiality agreements are fiddly, low-risk agreements that everyone wants to get through as quickly as possible to get to the fruitier deal negotiations. But they have buried risks if you don’t watch them. So, your legal eagles need to be on their game to keep the stupid out. And be assured, counterparties will throw lots of stupid at you. Let’s face facts: the fellow in charge of the NDA templates is going to be a Golgafrinchan, not a Top Gun Lawyer.  


So you need your [[legal eagle]]s to be on their game to stop the ''stupid'' getting in. And be assured, counterparties will throw lots of stupid at you. Let’s face facts: the fellow in charge of the [[NDA]] templates is going to be a [[golgafrinchan|Golgafrinchan]], not the organisation’s [[Top Gun Lawyer]].  
But it ''is'' a faff — an excruciatingly written [[NDA]] might take an hour to review, and return. This is not exactly glamorous work, though once in a while it is strangely satisfying. But by reference to the prism of “notional person-hours” through which a [[chief operating officer]]s views the world, NDA review ''costs money''.


So, [[confidentiality agreement]]s come in all shapes, sizes and shades of silliness. They needn’t be longer than a few paragraphs, but our American friends are given to 15-page bunker busters which, in the main, say no more than a concise one, ''but you just never know''. Hence, the need for contract review. It is all standard stuff. But it ''is'' a faff — an excruciatingly written [[NDA]] might take an hour to review, and return. This is not exactly glamorous work, though once in a while it is strangely satisfying.
[[Automated contract review]] promises to save some of that cost. It checks against pre-defined [[playbook]] of [[walk-away point]]s, like a triage unit at a military hospital, breaking the back of the most tiresome work, then handing over to you for a quick once-over before it goes out the door.  


So: it’s slow, it takes time, the review parameters are [[complicated]] (but not [[complex]]) — there is a (limited) risk of something slipping in — and a [[legal eagle]] has invariably got better things to do. By reference to the illusory “notional person-hours”, through which prism the [[chief operating officer]]s like to view the world, NDA review ''costs the firm money''.
====The [[contract review tool]] as a solution.====
The [[contract review tool]] promises to save some of that money. It performs a basic check against pre-defined [[playbook]] of [[walk-away point]]s. It operates rather like a triage unit at a military hospital, breaking the back of ''most'' tiresome work (while you are getting on with something more productive), then handing over to you for a quick once-over and it goes out the door. Brilliant.
That’s the theory.
====But it isn’t as simple as that====
====But it isn’t as simple as that====
But it turns out text lovingly confected by some unknown [[legal eagle]] isn’t as easy to review as all that. Even boring syntactical things like plurals, irregular verbs and parentheticals (we lawyers ''love'' parentheticals)<ref>See what I did there?</ref> are hard to code for. In time the machine will get better, but the universe of possible ways of articulating a single idea remains infinite and, while [[legal eagles]] suffer a form of locked-in syndrome with regard to many aspects of their creativity, it does not extend to methods by which they may torture prose. When it comes to textual complexity and saying things which, [[for the avoidance of doubt]], are ''not'' in doubt, lawyers are extemporisational geniuses.  
But it turns out unseen text isn’t as easy to review as all that. Even boring syntactical things like plurals, irregular verbs and parentheticals (we lawyers ''love'' parentheticals)<ref>See what I did there?</ref> are hard to code for. In time the machine will get better, but the universe of possible ways of articulating a single idea remains infinite and, while [[legal eagles]] are stunted in many aspects of their creativity, when devising ways in which they may torture prose they are not. Along that axis, they are extemporisational geniuses. Thus, most commercial [[contract review tool]]s hire paralegals, in low-cost jurisdictions, to check the machine’s output before sending anything back.
 
Parsing the fevered language of a human lawyer requires some kind of a human sense check. You would think that could be applied by the lawyer operating the tool but, most commercial [[contract review tool]]s hire paralegals, in low-cost jurisdictions, to check the output before sending it back.


This has three consequences:
This has three consequences:
Line 51: Line 43:
Secondly, it adds to the cost. Now, to be sure, [[reg tech]] providers are master [[rent-seeker]]s, but here, in their bench of paralegal sense-checkers, they have actual out-of-pocket costs. Thus, the [[contract review tool]] must carry a heavy charge ''per document'' review. Better ones charge less than a hundred bucks. Some charge as much as three hundred, ''per review''. ''But the point of automated review is that it shouldn’t cost anything.''
Secondly, it adds to the cost. Now, to be sure, [[reg tech]] providers are master [[rent-seeker]]s, but here, in their bench of paralegal sense-checkers, they have actual out-of-pocket costs. Thus, the [[contract review tool]] must carry a heavy charge ''per document'' review. Better ones charge less than a hundred bucks. Some charge as much as three hundred, ''per review''. ''But the point of automated review is that it shouldn’t cost anything.''


Suddenly the cost proposition that swung the business case doesn’t work: you assumed you were saving an hour [[legal]]’s time, which you unitise at, say, $250. But that is a ''nominal'' cost. It is sunk.<ref>Unless you were briefing out your confis to a [[law firm]], in which case, ''really?''</ref> A new [[confi]] coming in doesn’t generate that cost, and firing the thing out to your [[contract review tool]] doesn’t save it. The cost of your own [[legal eagles]] is fixed, and notoriously hard to [[shredding|shred]] back to your business. Legal eagles just sit there, on the firm’s dime, ''whether you use them or not''. Most work very hard, of course — the [[legal eagle]] who punches out at 5pm on the smacker on ''any'' day, let alone ''every'' day is a rare bird. He ''will'' look at that [[confi]], and anything else that needs to get done, at some stage during the day. ''[[Legal eagle]]s don’t work to rule''.<ref>As it happens, the occasional [[confi]] can be a pleasant distraction: a nice re-charger after a hard morning slogging through a series of regulatory change stakeholder [[Skype]] calls. Hey, management team: why don’t you try to get rid of all the ''stakeholder management calls''? ''There'' is a question.</ref>  
Suddenly the cost proposition that swung the business case doesn’t work: you assumed you were saving an hour of [[Legal]]’s time, which you unitise at, say, $250. But that is a ''nominal'' cost. It is sunk.<ref>Unless you were briefing out your confis to a [[law firm]], in which case, ''really?''</ref> A new [[confi]] coming in doesn’t generate that cost, and firing the thing out to your [[contract review tool]] doesn’t save it. The cost of your own [[legal eagles]] is fixed, and notoriously hard to [[shredding|shred]] back to your business. Legal eagles just sit there, on the firm’s dime, ''whether you use them or not''. Most work very hard, of course — the [[legal eagle]] who punches out at 5pm on the smacker on ''any'' day, let alone ''every'' day is a rare bird. He ''will'' look at that [[confi]], and anything else that needs to get done, at some stage during the day. ''[[Legal eagle]]s don’t work to rule''.<ref>As it happens, the occasional [[confi]] can be a pleasant distraction: a nice re-charger after a hard morning slogging through a series of regulatory change stakeholder [[Skype]] calls. Hey, management team: why don’t you try to get rid of all the ''stakeholder management calls''? ''There'' is a question.</ref>  


So, unless you can prove that your [[contract review tool]] will make some of your lawyers ''[[redundant]]'', ''it is not saving you any real money''. It is ''costing'' real money — ''more'' than it would for your internal team to just knock off the confi in the first place.
So, unless you can prove that your [[contract review tool]] will make some of your lawyers ''[[redundant]]'', ''it is not saving you any real money''. It is ''costing'' real money — ''more'' than it would for your internal team to just knock off the confi in the first place.
Line 62: Line 54:
*'''The [[negotiation]]''': it is a great comfort to an [[inhouse lawyer]] that she can make decisions, concede technical points, and let ''de minimis'' terms go, on the fly. ''This'' is what gives her ''wings''. This vouches safe [[Drive: The Surprising Truth About What Motivates Us - Book Review|her ''autonomy'', her ''mastery'' and her ''purpose'']]. ''This'' is why she shows up for work; why she slogged through interminable lectures about [[promissory estoppel]] all those years ago. There is something ineffable, even ''infinite'' about this skill: it is impervious to measurement; this rich forensic magisterium lies beyond the censorial gaze of [[internal audit]]. In this sunlit realm, we [[legal eagle]]s can truly fly.
*'''The [[negotiation]]''': it is a great comfort to an [[inhouse lawyer]] that she can make decisions, concede technical points, and let ''de minimis'' terms go, on the fly. ''This'' is what gives her ''wings''. This vouches safe [[Drive: The Surprising Truth About What Motivates Us - Book Review|her ''autonomy'', her ''mastery'' and her ''purpose'']]. ''This'' is why she shows up for work; why she slogged through interminable lectures about [[promissory estoppel]] all those years ago. There is something ineffable, even ''infinite'' about this skill: it is impervious to measurement; this rich forensic magisterium lies beyond the censorial gaze of [[internal audit]]. In this sunlit realm, we [[legal eagle]]s can truly fly.


But a [[playbook]] ''buggers up'' this freedom. It chains our young eagle to the ground. Scarecely can she unfurl her wings, when the [[contract review tool]] has marked-up the document ''to rule'', cleaving to every stricture of the [[playbook]], however prudish, [[tiresome]] or nonsensical. It is like Horton the goddamn Elephant, doggedly sitting on a nest up a tree. Now bearing in mind that the whole point is ''saving her precious'' [[time is of the essence|''time'' is of the essence]], it would be ''most'' odd for our young attorney now to ''undo'' those fussy, machine-generated corrections — and so we have created a cyber version of our old friend the [[anal paradox]]. And besides, why is de-stupiding the machine’s output any more useful than de-stupiding the original draft in the first place? Did ''that'' cost get baked into the business case?  
But a [[playbook]] ''buggers up'' this freedom. It chains our young eagle to the ground. Scarcely can she unfurl her wings, when the [[contract review tool]] has marked-up the document ''to rule'', cleaving to every stricture of the [[playbook]], however prudish, [[tiresome]] or nonsensical. It is like Horton the goddamn Elephant, doggedly sitting on a nest up a tree. Now bearing in mind that the whole point is ''saving her precious'' [[time is of the essence|''time'' is of the essence]], it would be ''most'' odd for our young attorney now to ''undo'' those fussy, machine-generated corrections — and so we have created a cyber version of our old friend the [[anal paradox]]. And besides, why is de-stupiding the machine’s output any more useful than de-stupiding the original draft in the first place? Did ''that'' cost get baked into the business case?  
=====The measure of a [[legal eagle]]=====
=====The measure of a [[legal eagle]]=====
But it is worse than that: our [[legal eagle]] is snookered: thanks to this fusspot machine, suddenly her ineffable judgment is ''measurable''. The bureaucrats can run MIS reports. They can see what she is doing. They have a yardstick, and it will tell them things like, “''L. Eagle departed from the recommended standard term seven times in June 2019''”. The [[rule of self-preservation]], which crushes the abstract yen for autonomy like a bug, discourages any deviation from the guidelines —“good!” squeaks the COO — ''but the guidelines will be stupid''. ''She'' might be incentivised to demur, ''but her counterparty won’t''.
But it is worse than that: our [[legal eagle]] is snookered: thanks to this fusspot machine, suddenly her ineffable judgment is ''measurable''. The bureaucrats can run MIS reports. They can see what she is doing. They have a yardstick, and it will tell them things like, “''L. Eagle departed from the recommended standard term seven times in June 2019''”. The [[rule of self-preservation]], which crushes the abstract yen for autonomy like a bug, discourages any deviation from the guidelines —“good!” squeaks the COO — ''but the guidelines will be stupid''. ''She'' might be incentivised to demur, ''but her counterparty won’t''.