|
Andy Craig@andycraig.bsky.social |
LLMs are useless for lawyering and other tasks involving actual analysis and understanding not because the technology hasn't gotten there yet, but because that's fundamentally not what statistical word association is capable of doing. Not only can't it understand, it's not even trying to understand.
52 replies 392 reposts 1630 likes
|
Marv
@marvinbutters.bsky.social
[ View ] |
LLMs remind me of 3D printing in that there is something there, but almost everything you see online about it is by someone with no understanding of what it is. No it won't let terrorists make nuclear weapons, no it can't replace in house council, that's not what it's for.
0 replies 0 reposts 1 likes
|
|
Marv
@marvinbutters.bsky.social
[ View ] |
LLMs remind me of 3D printing in that there is something there, but almost everything you see online about it is by someone with no understanding of what it is. No it won't let terrorists make nuclear weapons, no it can't replace in house council, that's not what it's for.
0 replies 0 reposts 0 likes
|
John Argh
@johnargh.bsky.social
[ View ] |
📌
0 replies 0 reposts 0 likes
|
Anna E.
@queergermangirl.bsky.social
[ View ] |
I‘m very scared for people who are using GPT to put together contracts. 😬
0 replies 1 reposts 3 likes
|
R H
@flinflonimation.bsky.social
[ View ] |
I have trained a machine learning algorithm on millions of maps so it must understand territory by now.
0 replies 0 reposts 1 likes
|
🕯️
@candlelocks.bsky.social
[ View ] |
it makes me feel like i'm actually crazy
0 replies 0 reposts 1 likes
|
NutMeg
@casuallychaotic.bsky.social
[ View ] |
So given those capabilities, when do we think an LLM will get appointed to the Supreme Court?
0 replies 0 reposts 0 likes
|
Caren with a C
@caren.bsky.social
[ View ] |
This, exactly this. I'm not sure AI creators even understand how little AI understands.
0 replies 1 reposts 1 likes
|
Robots Everywhere
@robotseverywhere.bsky.social
[ View ] |
We've worked on natural language models for legal and other predicate oriented spaces before. We have not yet used a neural network structure for it, but have seen considerable reason to believe there is a solution. In fact, I just thought of something. Hold on.
0 replies 0 reposts 0 likes
|
Elsa
@notyourdove.bsky.social
[ View ] |
the impression i get is that they're sometimes useful search engines? so for law they could turn up stuff that may be relevant, which an actual human can check out. like telling you which bales are most likely to contain the needle you're looking for.
2 replies 0 reposts 0 likes
|
The Pumpkin Dipshit
@pumpkinpal.bsky.social
[ View ] |
there isn't even an awareness for the phrase "trying to understand" to apply to. It's putting one character after another, and all it "knows" is what was input, what parts of its training data are similar to the input, and what parts of its training data are therefore appropriate output.
1 replies 0 reposts 2 likes
|
C.V. Danes
@cvdanes.bsky.social
[ View ] |
Yep. Not only does it fundamentally not understand the answer, it fundamentally doesn't understand the question. It's merely automation. Nothing more.
0 replies 1 reposts 3 likes
|
Neuralink QA Lead
@helios-daedalus.bsky.social
[ View ] |
It's kind of sad that LLMs are probably drawing interest and funding away from symbolic languages and systems and maybe even degrading the field of AI research as a whole.
0 replies 0 reposts 3 likes
|
y'all'dn't've
@briantist.bsky.social
[ View ] |
📌
0 replies 0 reposts 0 likes
|
Botticellibelle
@botticellibelle.bsky.social
[ View ] |
Yeah, it reminds me of shitty music recommendation algorithms that don't understand what it is I like about the music I listen to, which spans genres.
0 replies 0 reposts 0 likes
|
Adam K
@adamkek.bsky.social
[ View ] |
I'm no lawyer, but would there also be a liability issue with a lawyer using ai? Say a lawyer writes a contract with the help of ai. The client signs it, but then the lawyer realizes it contains language he or she wasn't expecting, detrimental to the client. How would this be resolved?
2 replies 1 reposts 1 likes
|
Toreole
@toreole.bsky.social
[ View ] |
Its not designed to be capable of understanding
0 replies 0 reposts 0 likes
|
Scarlett Ibach
@sibach.bsky.social
[ View ] |
We could do so many useful things with “AI”/data science but get stuck with llms. Generating content has to be one of the least useful things we could build but I guess it’s easy to monetize. I’d like to have data organized and categorized so that we can access data quickly and accurately!
0 replies 1 reposts 1 likes
|
Jan Murphy
@packrat74.bsky.social
[ View ] |
Seeing people boast about what ChatGPT can do is like watching someone framing a house using a screwdriver to hammer in the nails. If you know even the slightest thing about tools, you know it's not the right tool for those jobs.
0 replies 2 reposts 6 likes
|
Public Universal Ally
@returnofmccarthy.bsky.social
[ View ] |
I'd push back very slightly and say theoretically - the chinese room - you could have a machine that mimics that understanding, but here in the real world with physical limits scaling becomes impossible before you get anywhere close
1 replies 0 reposts 5 likes
|
Most Excellent Theophilus
@optimetheophile.bsky.social
[ View ] |
One of the things you absolutely do not want an "AI robo-doctor" to do is give you a diagnosis that has the same syntax and jargon that the diagnosis a real doctor would give you, without the substance. Unfortunately, that's all it ever will do.
1 replies 1 reposts 22 likes
|
Himbo Blacksmith🇿🇦🇮🇹
@himboblacksmith.bsky.social
[ View ] |
i wish more people understood that AI is only going to be useful when it's purpose-built and only applied to the things it has been built to do. Like that guy who had gemini analyse his scans for cancer
1 replies 0 reposts 21 likes
|
Symbo1ics
@symbo1ics.bsky.social
[ View ] |
Furthermore, contra these lying con men and women, there is not even any PATH to useful "intelligence" through this technology. It's pure waste in support of financial scams. We have to stop cooperating with, stop humouring, and stop supporting any of this fraudulent nonsense.
0 replies 0 reposts 1 likes
|
E-W
@edashw.bsky.social
[ View ] |
As a pointer to concepts or documents that *might* be related, it's potentially useful. Vibes based search. In a legal context, the product should be checking whether those docs... actually exist.. before surfacing them. That's not what's being sold.
1 replies 0 reposts 0 likes
|
ѕ¢я1ρt🕵🏻
@zeroghost.net
[ View ] |
There are some genuinely good use cases for Gen Ai in legal tech, such as first pass contract generation, redline review and playbook interrogation, etc... Is it over hyped, absolutely, but there are definitely some solid uses for LLMs in law.
0 replies 0 reposts 0 likes
|
@zendarva.bsky.social
[ View ] |
Yeah, that's what the developers keep telling us. I don't get how people keep missing it.
0 replies 0 reposts 0 likes
|
@notgeorgecarlin.bsky.social
[ View ] |
Interesting, involved in an ugly estate war. Our attorney is beta testing the court reporting company's AI tool to summarize deposition testimony and insert into petitions. She'll double check it all but thinks this might save thousands on the next motion. God, I hope so.
0 replies 0 reposts 0 likes
|
Tom (kid codger) O'Neill
@doctecazoid.bsky.social
[ View ] |
Autocomplete on steroids.
0 replies 0 reposts 1 likes
|
Alex Remington
@alexremington.bsky.social
[ View ] |
I am assuming from context that you are not referring to graduates of law school masters programs
0 replies 0 reposts 1 likes
|
Andy J. T.
@ajtra.bsky.social
[ View ] |
LLMs are good for things you can easily check yourself, like code or "make that sound more professional", but you always have to mistrust them
1 replies 0 reposts 1 likes
|
jeremy parsons
@buzzard.bsky.social
[ View ] |
guess i have more in common with LLMs than i realized
0 replies 0 reposts 1 likes
|
Innocent🕷Abroad
@jjgass.bsky.social
[ View ] |
Tomorrow's essay question for the class: Does this observation have any implications for the coming fad of using corpus linguistics to interpret the Constitution, statutes, and contracts; if so, what are those implications?
0 replies 0 reposts 13 likes
|
Bill Stewart
@billstewart.bsky.social
[ View ] |
Yep. LLMs don't have models for "facts", so there's no way they can understand those facts.
1 replies 2 reposts 25 likes
|
Mike Janssen
@mjanssen.bsky.social
[ View ] |
I agree that LLMs don't "understand" anything but disagree that they're not good for analysis. Can be very useful in working with datasets, finding trends and outliers, etc.
3 replies 0 reposts 6 likes
|
You’ve Got Ishmael (they/them)
@poisonedpenuche.bsky.social
[ View ] |
okay but every time I see LMM, automatically think “master of laws in tax”
0 replies 0 reposts 0 likes
|
|
Chris in NY
@chrisb2.bsky.social
[ View ] |
someone asked David Simon if it would help him get from Scene 5 to Scene 6 in a script. Anyone can come up with 10 ways to do a scene. Writing is knowing which one *works.*
0 replies 0 reposts 0 likes
|
|
Chris in NY
@chrisb2.bsky.social
[ View ] |
right - it's trying to approximate a human answer, it's not trying to think critically to arrive at one.
0 replies 0 reposts 1 likes
|
Christian Fomm
@fomm.eu
[ View ] |
However, there are already judges who use something like this. You could also call them "beta judges".
www.heise.de/en/news/Mexi...
0 replies 0 reposts 1 likes
|
Dan Davis
@bindlestaff.bsky.social
[ View ] |
🎯
0 replies 0 reposts 2 likes
|
GreenEngineer
@greenengineer.bsky.social
[ View ] |
AI stands for Autocorrect Idiot
0 replies 0 reposts 1 likes
|
MB
@moab-bombadil.bsky.social
[ View ] |
You just described a fair number of lawyers.
0 replies 0 reposts 2 likes
|
David
@scotinus.bsky.social
[ View ] |
That's why it's surprising so much money is being poured into something that is an impressive novelty for sure, but in a sense 'average' by definition. In fact AI is an awfully misleading term. Something like "Data Trained I/O Technology" would be more apt.
1 replies 0 reposts 1 likes
|
A cavalcade of anger and fear
@uhhhclem.bsky.social
[ View ] |
There are only two problems with LLMs, which are that they have no memory and they can't learn.
0 replies 0 reposts 0 likes
|
Soon Lee
@soonleenz.bsky.social
[ View ] |
Pretty much this. arxiv.org/abs/2406.02061
0 replies 0 reposts 1 likes
|
annaluna 🏳️🌈🎼🏴☠️🧶
@annaluna.bsky.social
[ View ] |
Whenever I see LLM I think Master of Law degree and it totally fit here at first. Then I was like, wait…
1 replies 0 reposts 7 likes
|
|
Andy Craig
@andycraig.bsky.social
[ View ] |
It doesn't matter how much better LLM chatbots get at the thing they're actually doing, the thing they're doing is categorically not what hype merchants in this vein are claiming. It's like claiming Photoshop is going to tell us how to reform the tax system. It's a nonsensical premise.
6 replies 53 reposts 360 likes
|
That Anonymous Coward
@thatac.bsky.social
[ View ] |
So its a politician replacement?
0 replies 0 reposts 0 likes
|
Tica the Sloth
@ticasloth.bsky.social
[ View ] |
It seems to me that human brains also use language by using "statistical word association." What the AI lacks is lived and sensory experience. It's hard to tell fact from fiction using language alone.
13 replies 1 reposts 8 likes
|
Peter Stinson
@change1strategy.bsky.social
[ View ] |
People don't seem to "get" this notion that it's all just a word salad.
0 replies 0 reposts 0 likes
|
Professor Furious
@professorfurious.bsky.social
[ View ] |
Preach, brother.
0 replies 0 reposts 0 likes
|
Roberta
@jardinera.bsky.social
[ View ] |
Just read a 2024 article “Chat GTP is Bullshit” by Hicks, Humphries and Slater, Ethics Inf Technol where they argue it’s more accurate to call the inaccuracies in LLM as bullshit instead of ‘hallucinations’, in science communication. Interesting discussion, referencing other studies.
1 replies 0 reposts 4 likes
|
𝑩𝒓𝒆𝒂𝒅 🍉
@breadgloves.pm
[ View ] |
Even doing something like math expressions prove it can not deal with any form of analysis, there is not "thinking" involved. It finds words that correlate to your prompt and make word soup of it. The amount of text spat out makes people assume it has to be right
0 replies 0 reposts 0 likes