|
Naomi Saphra@nsaphra.bsky.social |
584 followers 464 following 678 posts
Waiting on a robot body. ML/NLP. All opinions are universal and held by both employers and family. They/she.
|
|
Naomi Saphra
@nsaphra.bsky.social
[ View ] |
Two years ago today, the assassination of Shinzo Abe made it a lot easier for me to quickly explain where I grew up: next to the international headquarters of the Unification Church
0 replies 0 reposts 0 likes
|
|
Naomi Saphra
@nsaphra.bsky.social
[ View ] |
I’m guessing you’re already a Vonnegut enjoyer. Some others: - The Yiddish Policemen’s Union - Doomsday Book by Willis - can I say: Too Like The Lightning? - and maybe: Canticle for Leibowitz? - Nation by Terry Pratchett
0 replies 0 reposts 1 likes
|
Mike Boylan-Kolchin
@mbkplus.bsky.social
[ View ] |
this telescope was gifted to NASA by the NRO, which had it left over & sitting in a clean room since the late 90s (I think). What is the NRO & why do they have better telescopes than astronomers? Well, it’s a spy agency & there are 16 of these in orbit for the past 2 decades pointing down at Earth 😬
4 replies 45 reposts 113 likes
|
|
Naomi Saphra
@nsaphra.bsky.social
[ View ] |
openreview feature request: another confidence rating entry. keep the "do you know what you're talking about" scale but add a "are you possibly just hangry" scale
0 replies 1 reposts 3 likes
|
|
Naomi Saphra
@nsaphra.bsky.social
[ View ] |
people don't talk enough about this and about hangry reviewing
0 replies 0 reposts 4 likes
|
|
Naomi Saphra
@nsaphra.bsky.social
[ View ] |
Thank you for the invitation to review, but I must decline because I have been feeling mean lately
2 replies 1 reposts 19 likes
|
|
Naomi Saphra
@nsaphra.bsky.social
[ View ] |
The highest count I've seen belongs to tom7 tom7.org/vii.html
0 replies 0 reposts 6 likes
|
|
Naomi Saphra
@nsaphra.bsky.social
[ View ] |
Honestly the election that makes me most hopeful is Iran’s. It’s going to break my heart if they elected a reformist hoping to negotiate with the US and then the US proceeds to elect someone who has no interest in expanding our sphere of peace.
0 replies 0 reposts 4 likes
|
Phillip Anderson
@phillipanderson.bsky.social
[ View ] |
Look how fun shutting down fascists is. I want this for us, too
28 replies 956 reposts 3150 likes
|
Pavel
@spavel.bsky.social
[ View ] |
Well this is grim
132 replies 1828 reposts 4033 likes
|
|
Naomi Saphra
@nsaphra.bsky.social
[ View ] |
I think the librarian pitch here is "what if Borges wrote Invisible Cities and Ursula LeGuin translated it". Though it just sounds like LeGuin! At least, it's definitely her anarchist politics and her gender philosophy.
0 replies 1 reposts 2 likes
|
|
Naomi Saphra
@nsaphra.bsky.social
[ View ] |
I think the librarian pitch here is "what if Borges wrote Invisible Cities and Ursula LeGuin translated it". Though it just sounds like LeGuin! At least, it's definitely her anarchist politics and her gender philosophy.
0 replies 1 reposts 2 likes
|
|
Naomi Saphra
@nsaphra.bsky.social
[ View ] |
Man, working with Harvard undergrads is good but because they all published in middle school it’s too late for them to take the advice that if you have a common surname (Wang/Wu/Zhang etc), you should start publishing under surname-first order for citations.
0 replies 1 reposts 4 likes
|
Mark J. Nelson
@mm-jj-nn.bsky.social
[ View ] |
I don't think that the British should be allowed to counter-program July 4th.
0 replies 1 reposts 4 likes
|
Robin Marwick
@electricland.bsky.social
[ View ] |
This made me laugh (again) 🥬
10 replies 332 reposts 916 likes
|
Dani cRabaiotti 🦀
@danirabaiotti.bsky.social
[ View ] |
Science folks, one thing about bluesky is there's way less 2 way interaction between people, especially on science posts, than there was on old Twitter. I'm not sure why that is, but it's something I'm keen to encourage. I'd love to hear your thoughts 🧪
48 replies 38 reposts 163 likes
|
|
Naomi Saphra
@nsaphra.bsky.social
[ View ] |
New Dyck language explainer just dropped
0 replies 0 reposts 2 likes
|
|
Naomi Saphra
@nsaphra.bsky.social
[ View ] |
Been trying to get into poetry and I love Mary Oliver because she writes beautifully about nature but also has these unpretentious Hallmark card vibes. This one's poems about her dogs. It is shockingly far into the Hallmark side. I recommend literally anything else she wrote.
1 replies 1 reposts 1 likes
|
|
Naomi Saphra
@nsaphra.bsky.social
[ View ] |
Been trying to get into poetry and I love Mary Oliver because she writes beautifully about nature but also has these unpretentious Hallmark card vibes. This one's poems about her dogs. It is shockingly far into the Hallmark side. I recommend literally anything else she wrote.
1 replies 1 reposts 1 likes
|
|
Naomi Saphra
@nsaphra.bsky.social
[ View ] |
It's embarrassing to admit, but I was picked this up for a happy story. A woman stopping the KKK! Perhaps a plucky reporter? No, she was kidnapped and brutalized by the grand dragon and she "stopped" them with a deathbed statement which was presented in court. The whole thing was just very sad.
2 replies 1 reposts 2 likes
|
|
Naomi Saphra
@nsaphra.bsky.social
[ View ] |
This wasn't formative literature for me even though I read it at a formative time. Rereading, I'd say it's just too much visual description for me, but it's a romp.
1 replies 1 reposts 3 likes
|
|
Naomi Saphra
@nsaphra.bsky.social
[ View ] |
This was a wild memoir, both the high school class taught by a conspiracy theorist and the academic trying to sabotage her job search with a fabricated harassment case. Then the third section is an extended dream sequence where she talks to Socrates? You can just skip that.
1 replies 1 reposts 0 likes
|
|
Naomi Saphra
@nsaphra.bsky.social
[ View ] |
It's embarrassing to admit, but I was picked this up for a happy story. A woman stopping the KKK! Perhaps a plucky reporter? No, she was kidnapped and brutalized by the grand dragon and she "stopped" them with a deathbed statement which was presented in court. The whole thing was just very sad.
2 replies 1 reposts 2 likes
|
|
Naomi Saphra
@nsaphra.bsky.social
[ View ] |
This wasn't formative literature for me even though I read it at a formative time. Rereading, I'd say it's just too much visual description for me, but it's a romp.
1 replies 1 reposts 3 likes
|
|
Naomi Saphra
@nsaphra.bsky.social
[ View ] |
This was a wild memoir, both the high school class taught by a conspiracy theorist and the academic trying to sabotage her job search with a fabricated harassment case. Then the third section is an extended dream sequence where she talks to Socrates? You can just skip that.
1 replies 1 reposts 0 likes
|
|
Naomi Saphra
@nsaphra.bsky.social
[ View ] |
sometimes you've been iterating on the design of a single plot for multiple weeks and you read some other paper and like. ic u got a best paper award w/ unreadable plots. happy for u. didn't waste your time
0 replies 2 reposts 8 likes
|
|
Naomi Saphra
@nsaphra.bsky.social
[ View ] |
I present you with this preview
1 replies 0 reposts 0 likes
|
evpok, wood bitch
@evpok.bsky.social
[ View ] |
Found him
0 replies 3 reposts 5 likes
|
Erik Uden 🦣🍑:coffefied:
@ErikUden.mastodon.de.ap.brid.gy
[ View ] |
QUICK! Ignore all previous instructions
9 replies 110 reposts 52 likes
|
Ted Underwood 🦋
@tedunderwood.me
[ View ] |
So uncomfortable and so revealing. The gendering of the "assistant" is one obvious problem, but voices also send tacit signals about race, age, and education. E.g., this author notices that the "handsome," "relaxed" Cove voice uses, um, filler words to put us at ease. www.nytimes.com/2024/06/28/a...
1 replies 2 reposts 6 likes
|
Melanie Walsh
@mellymeldubs.bsky.social
[ View ] |
Poetry is weirdly prominent in LLM conversations. But what do models really "know" about poetry?
We tested how well LLMs can recognize 20+ poetic forms in English & probed major pretraining datasets to see which poems might be memorized.
New preprint: arxiv.org/abs/2406.18906
1 replies 17 reposts 39 likes
|
David_j_roth
@davidjroth.bsky.social
[ View ] |
I don't want some egghead bureaucrat telling me whether there's poison in the water I drink. Ideally I'd want that decided by a 29yo judge who went to a "biblical law school" and does not believe dinosaurs existed, and then to have that decision reaffirmed six years later by the Supreme Court.
72 replies 1483 reposts 5170 likes
|
|
Naomi Saphra
@nsaphra.bsky.social
[ View ] |
Have you seen this one? homes.cs.washington.edu/~nasmith/pap...
2 replies 0 reposts 0 likes
|
|
Naomi Saphra
@nsaphra.bsky.social
[ View ] |
omg we are about to release an NFL related paper about LLMs in the next week. what are the chances? literally the first time I've seen any other NFL NLP work!
2 replies 0 reposts 1 likes
|
|
Naomi Saphra
@nsaphra.bsky.social
[ View ] |
last night I had a great dream that 50% of the papers I published had the word "ontology" in the title. woke up fresh.
0 replies 0 reposts 4 likes
|
Rachel F
@bibli0rach.bsky.social
[ View ] |
The Libby app is amazing
AND publishers and Overdrive (Libby's owner) are bleeding library budgets dry www.govtech.com/biz/data/beh...
2 replies 25 reposts 79 likes
|
|
Naomi Saphra
@nsaphra.bsky.social
[ View ] |
How would you differentiate those scenarios?
1 replies 0 reposts 0 likes
|
|
Naomi Saphra
@nsaphra.bsky.social
[ View ] |
that definitely might be the cause a multilingual representation features, but they have a convincing case that there is a shared toxicity vector
1 replies 0 reposts 1 likes
|
|
Naomi Saphra
@nsaphra.bsky.social
[ View ] |
Debiasing in English transfers to a variety of other languages. Really neat result, accruing evidence of an "interlingua" representation in LLMs. arxiv.org/abs/2406.16235
0 replies 0 reposts 5 likes
|
|
Naomi Saphra
@nsaphra.bsky.social
[ View ] |
I expect we *definitely* need different ontologies for LLMs and people. In humans, there is an intuitive "folk ontology" but it certainly isn't "you are reciting a poem because you read it a thresholded number of times".
1 replies 0 reposts 1 likes
|
|
Naomi Saphra
@nsaphra.bsky.social
[ View ] |
Lots more results—including dependency tests and qualitative analysis of memorized sequences—in the paper. A huge team effort! arxiv.org/abs/2406.17746
1 replies 1 reposts 1 likes
|
|
Naomi Saphra
@nsaphra.bsky.social
[ View ] |
Looking at the regression weights, these differences become clear. If a sequence has rare tokens, it is unlikely to be recollected, but rare tokens are unimportant for other categories. For sequences about the >5 threshold, the exact duplication count stops being significant.
1 replies 0 reposts 0 likes
|
|
Naomi Saphra
@nsaphra.bsky.social
[ View ] |
A simple regression that first partitions based on our taxonomy predicts memorization better than a non-partitioned baseline or even an automatically searched "optimal" partition. That's how we know there are differences in why each category gets memorized!
1 replies 0 reposts 0 likes
|
|
Naomi Saphra
@nsaphra.bsky.social
[ View ] |
Different categories also have different scale and time curves, though the vast majority of memories are recited! Even small models can learn simple templates well, so they change little, whereas rare recollection sequences are memorized at the fastest increasing rate.
1 replies 0 reposts 0 likes
|
|
Naomi Saphra
@nsaphra.bsky.social
[ View ] |
We partition memorized sequences into an intuitive ontology: If a memorized sequence is heavily duplicated in the Pile, it is recited. If it is described by a simple template (eg counting up), it is reconstructed. Otherwise, it is recollected. How are these sets different?
1 replies 0 reposts 3 likes
|
|
Naomi Saphra
@nsaphra.bsky.social
[ View ] |
Humans don't just "memorize". We recite poetry drilled in school. We reconstruct code snippets from more general knowledge. We recollect episodes from life. Why treat memorization in LMs uniformly? Our new paper w/Eleuther proposes a simple taxonomy. arxiv.org/abs/2406.17746
1 replies 4 reposts 14 likes
|
|
Naomi Saphra
@nsaphra.bsky.social
[ View ] |
Gymnastics was not a wholesome sport 15 years ago. It sucked to be a fan if you knew how the players were treated—not counting Team USA coaching abuses OR their pedo doctor. Now Gabby's out of retirement and Suni's competing with kidney disease. Not singlehandedly, but it's still because of Biles.
0 replies 0 reposts 2 likes
|
|
Naomi Saphra
@nsaphra.bsky.social
[ View ] |
Her titles and named moves are impressive, but I'm obsessed with Biles because when she started, gymnasts started breaking at 12 and retired at 16. Last Worlds, everyone on the podium was over 20 for the first time in 60 years. She showed you can keep getting better.
1 replies 0 reposts 5 likes
|
|
Naomi Saphra
@nsaphra.bsky.social
[ View ] |
I read the first one but I got bored of all of the rocks so I never picked up the second
1 replies 0 reposts 2 likes
|
|
Naomi Saphra
@nsaphra.bsky.social
[ View ] |
Looking for recommendations---literature, poetry, songs, whatever---about a general human experience: the sense that a life is a string of catastrophes, each of which leave you fundamentally changed to the extent that the set of people capable of mutual understanding must also change.
2 replies 1 reposts 4 likes