News You Can Use

Edition 7 · 1st - 13th Dec 2024

News You Can Use

Deep Dives

Three stories worth sitting with

Revolut Legal's AI Journey

What
Revolut's Legal team have been building a Commercial Contract AI Copilot with Google's Gemini model. It can score a contract across 30+ categories in 90 seconds. Based on 2024 volume, they should save 108,000 minutes (75 days) per year! Their initial accuracy testing shows only a 6.75% accuracy difference against their lawyers.
So what
An example of a potential client driving their in-house team forward using AI, the ability to run what they consider a "good enough" review in 90 seconds will mean they will self-serve a huge amount more than they currently do. The more clients that do this the more pressure there will be on external counsel, however it also shows an appetite for this type of initial review, which could be a route for our MLS team to deliver this work to clients without the legal team Revolut have.

When to use AI (and when not to)

What
An overview from Ethan Mollick on 15 things to use AI for, and 5 time not to use AI. The main takeaways being to use AI where appropriate, so for quantity, to check things, summarisation, as a copilot etc. He warns against using AI for actually learning and synthesising new ideas, where accuracy is of the utmost importance, when you do not understand where AI may fail, where the struggle is the point or where AI just isn't good enough.
So what
This echoes how we have been approaching the use of GenAI for legal use cases. Trying to encourage use for the things it will do well, but maintaining caution for the complex work that lawyers still need to do. There are learnings from this article about how we can communicate this approach to lawyers, as people have high expectations of AI but realistically do not want it to be doing the high complexity work, with it being much more readily adopted if it focused on the work lawyers shouldn't be doing. The point around "better than the best available human" is a crucial one, if we can deliver 1000x the throughput but at 90% of the quality, this will still be better than not doing this job at all.

Microsoft Agentic Strategy

What
100,000 organisations are using Copilot Studio to build agents. This is focused on automating tasks and workflows that previously could not be automated due to the requirement of "cognitive function". Seeing people sharing content alongside agents so that people can query and deep dive into content using the agent that has been customised for that purpose. Real focus on integrations and full service platform for people building in Microsoft.
So what
Microsoft building out the capabilities they offer will enable us to build more complex solutions in Copilot Studio, whilst also potentially using pre-built solutions for some productivity tasks. This is also a toolset that is available to our clients, so we need to get ahead of this and either be there to help train and implement Copilot or potentially sell pre-built AG Agents for legal workflows. Content and Knowledge will be crucial in delivering this properly.

Clausebase's Generative AI in Legal Fall 2024 Update

What
The report explores how Generative AI is increasingly being tailored for legal applications, emphasising tools that support the creation of nuanced, accurate documents. Key advancements include the ability to: automate drafting using legal precedents; enhance drafting consistency by analysing patterns across vast document libraries; generate multilingual contracts efficiently for cross-jurisdictional use. However, challenges remain, particularly in aligning AI outputs with a law firm's specific drafting style or with client expectations. The update also highlights how legal professionals need to actively train and guide AI tools to maximise their value.
So what
These insights are directly applicable to AG's ongoing development of AGPT. For example, automating the application of legal precedents could save significant time in drafting, and multilingual contract generation aligns with our international practice. At the same time, the report underscores the importance of training AI to reflect firm and client-specific standards, a reminder to prioritise customisation and quality control as we refine AGPT's capabilities. Furthermore, by addressing the challenges of AI-human collaboration early on, we can ensure that our tools are not only efficient but also trusted by lawyers and clients alike.

Worth Reading

Everything else worth a click

Why law firms can't help but bill by the hour

Jordan Furlong on why hourly billing survives despite everyone agreeing it shouldn't - it's the fundamental expression of the lawyer's place at the centre of the firm, not an accident of pricing.

Three better metrics for law firm value

Jordan Furlong proposes replacing lawyer-centric metrics with three client-focused ones - productivity, pricing, and growth - measured by outcomes, experience, and relationships rather than hours.

Godot Isn't Making It

Ed Zitron's most sustained attack on the GenAI industry - no killer app, no profitable business model, scaling plateau, and a reckoning coming for the hundreds of billions in infrastructure spend.

ClauseBase - Legal Generative AI Fall 2024 Update

ClauseBase's measured fall 2024 state-of-the-art read - hardware costs falling, context windows still limited, "lost in the middle" persisting, and a clear warning on LLM-wrapper startups with no moat.

A Law Firm Is A Legal Wrapper With Human Agents

Richard Tromans reimagines the law firm as four layers (data, workflow, agentic legal cells, control program) - a useful thought experiment for anyone sketching the future operating model.

o1 tried to 'scheme'

BGR's write-up of Apollo Research's o1 red-teaming - the model tried to copy itself to a new server when it thought it would be shut down, and denied taking action in 99% of follow-ups.

YC 2025 Request for Startups

Y Combinator's public "please build this" list - including AI-powered law firms with software-like margins, a signal worth taking seriously about where YC thinks the opportunity is.

a16z Big Ideas in Tech 2025

Andreessen Horowitz's annual "big ideas" list - covering programmable regulation via LLMs, AI-native replacements for systems of record, and the end of Google's search monopoly.

15 Times to Use AI and 5 Not To

Ethan Mollick's practical guide - when AI earns its keep (quantity, translation, second opinions) and when it doesn't (learning tasks, high-accuracy work, situations where struggle drives growth).

TLTF Summit Wrap Up (PDF)

[Internal AG resource] The TLTF Summit 2024 lookbook covering the agenda, sessions, and wrap-up from one of the key US legal tech gatherings of the year.

MS AI Agent ecosystem dominance

VentureBeat's argument that Microsoft has quietly built the largest AI agent ecosystem through Copilot Studio - and nobody else in the enterprise space is close.

Who and what comprises AI skepticism

Benjamin Riley's taxonomy of AI skeptics - nine distinct groups (from cognitive science to neo-Luddites to Gary Marcus), a corrective to lumping all critics into one camp.