Ben Schmidt's avatar

Ben Schmidt

@bschmidt.bsky.social

543 followers 288 following 600 posts

VP of Information Design at Nomic building new interfaces to embeddings; onetime history professor/digital humanist. In general I use this account for humanities-y things, @benmschmidt@sigmoid.social for techy stuff, and the bad place for business.


Ben Schmidt's avatar Ben Schmidt @bschmidt.bsky.social
[ View ]

Ranking of US-ian Nobel laureates by how quickly I would buy an LOA edition: 4. Pearl S. Buck. How did that happen? 3. Louise Glück. I have too much LOA poetry. 2. Morrison. Too expensive at release; but like Roth, wait until the market's glutted to get them at $8 a pop. 1. 1-vol complete Dylan.

0 replies 0 reposts 1 likes


Ben Schmidt's avatar Ben Schmidt @bschmidt.bsky.social
[ View ]

Also the number of later Philip Roth titles that are plausibly chapter titles in a Donald Trump biography is kind of spooky. Besides "Zuckerman Unbound" and "Sabbath's Theater," there's a decent interpretation for every one!

1 replies 0 reposts 1 likes


Ben Schmidt's avatar Ben Schmidt @bschmidt.bsky.social
[ View ]

Since 2016 I've had this nagging fear somehow we might be inflicted with a multivolume set that starts with "Art of the Deal," includes 2000's understudied "The America we Deserve," and has volumes "The Tweets: 2009-2020" and "The Truths: 2021-2030."

2 replies 0 reposts 5 likes


Ben Schmidt's avatar Ben Schmidt @bschmidt.bsky.social
[ View ]

British voters seem to be weirdly good at tactical voting, but the upshot for me here is that the tories will recenter on Johnson's brexitism, and will probably need (and get) a lib dem partner to govern next time around. (With the caveat that I have zippo understanding of northern ireland).

0 replies 0 reposts 3 likes


Ben Schmidt's avatar Ben Schmidt @bschmidt.bsky.social
[ View ]

Just working through this all, seems like: 1. Labor + SNP + Greens 43.1%, compared to 38.6% last time. 2. Reform+Tories 38%, compared to Tories 43.6% last time; 3. Greens up 4%, which probably came out of the labour/SNP left. 4. Lib Dems up slightly in %, and recover in seats.

1 replies 0 reposts 3 likes


Ben Schmidt's avatar Ben Schmidt @bschmidt.bsky.social
[ View ]

WOW, perfect framing. Ivy-pedigreed-academics tend to see the NYT as a wayward sibling, or the 13th Harvard house, or a prize committee, or a high-impact-factor venue. At core, part of their prestige, non-profit ecosystem. I've struggled to explain how different it feels in the building. This is it.

0 replies 2 reposts 10 likes


Reposted by Ben Schmidt

Anil Dash's avatar Anil Dash @anildash.com
[ View ]

Is there good journalism and opinion in the NYT sometimes? Of course. And sometimes there are useful items on Facebook Marketplace. But what is it _for_? It's for the same thing as Facebook, and run with the same arrogance and insularity, based on the same fictions.

2 replies 45 reposts 433 likes


Reposted by Ben Schmidt

Anil Dash's avatar Anil Dash @anildash.com
[ View ]

I need to write the whole piece about this, but the thing to understand is that the NYT is now just Facebook. The platform dictates narrative to normies, is totally gamed by the right, and is still so ubiquitous as to be unavoidable even by those who see how broken it is. It's just Facebook.

63 replies 905 reposts 3035 likes


Ben Schmidt's avatar Ben Schmidt @bschmidt.bsky.social
[ View ]

sometimes if the leven stain turns up nothing you run a gram stain just to be sure.

0 replies 0 reposts 3 likes


Ben Schmidt's avatar Ben Schmidt @bschmidt.bsky.social
[ View ]

Now do Henry-Winkler distance.

0 replies 0 reposts 2 likes


Ben Schmidt's avatar Ben Schmidt @bschmidt.bsky.social
[ View ]

This would totally work in like an episode of Fringe or something where they could scan someone with a tricorder, say “his levenstain score is off the charts” and immediately realize they’re an imposter from the mirror universe.

2 replies 0 reposts 3 likes


Ben Schmidt's avatar Ben Schmidt @bschmidt.bsky.social
[ View ]

Also my previous post included a setup for a Berenstein Bears alternate universe/spelling differences joke I can’t figure out how to deliver on so I’m just going to skunk it here lest I spend all day trying to make good on it.

1 replies 0 reposts 4 likes


Ben Schmidt's avatar Ben Schmidt @bschmidt.bsky.social
[ View ]

Yeah it’s a decent story… But also commanding the heights that determine which books, podcasts, tv shows succeed could make a decent anecdote too.

0 replies 0 reposts 1 likes


Ben Schmidt's avatar Ben Schmidt @bschmidt.bsky.social
[ View ]

Duckdb has levenstain dist (and jato winkler, etc) as a built in function. I would so love to rewrite my old R text as a cross-language duckdb guide to humanitiea data work… duckdb.org/docs/sql/fun...

1 replies 0 reposts 2 likes


Ben Schmidt's avatar Ben Schmidt @bschmidt.bsky.social
[ View ]

The way out of this is to find an os error in your photos app that only partially obscures the picture and screen cap it, and then open the screencap in your photos app. After a few days of recursion you’ll either get cured or go fully mad. Good luck!

0 replies 0 reposts 1 likes


Ben Schmidt's avatar Ben Schmidt @bschmidt.bsky.social
[ View ]

That one still listing the title as chief science officer is a little shady.

1 replies 0 reposts 0 likes


Ben Schmidt's avatar Ben Schmidt @bschmidt.bsky.social
[ View ]

I imagine that what showed up on that page and slide decks was something that got negotiated when he left there… co-founder without an operational title signals to me that he has no day-to-day role, but they want to continue featuring his name.

1 replies 0 reposts 1 likes


Ben Schmidt's avatar Ben Schmidt @bschmidt.bsky.social
[ View ]

He's hired at least two DHers that I know of into that group, too.

1 replies 0 reposts 0 likes


Ben Schmidt's avatar Ben Schmidt @bschmidt.bsky.social
[ View ]

Not really--I don't think he's been really involved with that place for years. He's at Apple as the manager of the recommendation systems group, which determines what books, podcasts, TV shows, etc. show up in personalized recommendations.

1 replies 0 reposts 0 likes


Ben Schmidt's avatar Ben Schmidt @bschmidt.bsky.social
[ View ]

Today Nomic released version 3.0 of GPT4All, the easiest and best way to run LLMs on your own computer. If you've never run a private local LLM, try some of the llama3 or mistral derivatives, and chat locally with your own documents. Open source LLMs have gotten crazy good.
www.nomic.ai/gpt4all

0 replies 7 reposts 23 likes


Reposted by Ben Schmidt

Joshua J. Friedman's avatar Joshua J. Friedman @joshuajfriedman.com
[ View ]

Hooray for the New York Public Library! It's going to be open 7 days a week, thanks to the budget passed by the City Council today—and all the organizers who pushed to make this happen

16 replies 519 reposts 2545 likes


Ben Schmidt's avatar Ben Schmidt @bschmidt.bsky.social
[ View ]

The history of the Bush administration will be written from one surviving paper tome: fortunately as its title makes clear, it is comprehensive.

0 replies 0 reposts 2 likes


Ben Schmidt's avatar Ben Schmidt @bschmidt.bsky.social
[ View ]

It is almost impossible for me to imagine how the first thirty years of the Internet could be as poorly documented as the first thirty years of radio or television were. Let alone the vaudeville performances that preceded them.

1 replies 2 reposts 5 likes


Ben Schmidt's avatar Ben Schmidt @bschmidt.bsky.social
[ View ]

"I leave it to the reader to imagine how a precocious, all-knowing goat might narrate the history of disease transmission in the Neolithic."

1 replies 0 reposts 2 likes


Reposted by Ben Schmidt

Ben Schmidt's avatar Ben Schmidt @bschmidt.bsky.social
[ View ]

unclear to me how much that is history depts and how much Af Am. For enrollments, they’re ok… but IIRC the 2022 numbers were surprisingly sharp drop.

0 replies 0 reposts 1 likes


Ben Schmidt's avatar Ben Schmidt @bschmidt.bsky.social
[ View ]

I couldn’t afford one until I was like 40 or so though

0 replies 0 reposts 1 likes


Ben Schmidt's avatar Ben Schmidt @bschmidt.bsky.social
[ View ]

iPhones are like 60% of the US smartphone market—is it really plausible that teenagers are 85% iPhone users?

2 replies 0 reposts 2 likes


Reposted by Ben Schmidt

Ted Underwood 🦋's avatar Ted Underwood 🦋 @tedunderwood.me
[ View ]

A team centered at McGill and Harvard argues that LLM "hallucination" is better understood as confabulation, and resembles human habits of using narrative for sense-making. #machinelearning 🤖 arxiv.org/abs/2406.04175

4 replies 13 reposts 38 likes


Reposted by Ben Schmidt

Dael Norwood's avatar Dael Norwood @dael.bsky.social
[ View ]

In 1926, the President of the New York Chamber of Commerce - then the nation's most powerful association of financiers and capitalists – kept an autographed & gilt-framed photograph of Mussolini in his office. (Judging from the size - 11" x 14.5" – I'd say there's a fair chance it sat on his desk)

0 replies 3 reposts 2 likes


Ben Schmidt's avatar Ben Schmidt @bschmidt.bsky.social
[ View ]

Now that electric cars all make humming sounds so they don’t kill us, are those sounds branded? Can you tell a Kia from a Toyota?

0 replies 0 reposts 3 likes


Ben Schmidt's avatar Ben Schmidt @bschmidt.bsky.social
[ View ]

Had a dream about being one in a band of Vikings wandering around a medieval Wal-Mart in Germany.* Realized on waking that it was about the challenges of balancing all these male egos in the tech industry. *(So basically an Aldi).

0 replies 0 reposts 4 likes


Ben Schmidt's avatar Ben Schmidt @bschmidt.bsky.social
[ View ]

It's a general phenomenon though -- we hosted an event last night Sasha Rush from Cornell who was saying that adding text makes image models better, code models better, etc.; but adding other modalities tends not to make text models better. Maybe language is just a good way to describe things.

1 replies 0 reposts 2 likes


Ben Schmidt's avatar Ben Schmidt @bschmidt.bsky.social
[ View ]

Oh this is really cool: one of the Huggingface people built a real-time in-browser classifier using our model to instantly describe what's there according to your own template.

huggingface.co/spaces/Xenov...

0 replies 0 reposts 0 likes


Ben Schmidt's avatar Ben Schmidt @bschmidt.bsky.social
[ View ]

We designed our own map for the launch with photos, but some undergrad social media influencer made a much better one so I'll link that: all (?) the images in the Metropolitan Museum's online collection embedded, and text queryable.
atlas.nomic.ai/data/andrewg...

1 replies 0 reposts 2 likes


Ben Schmidt's avatar Ben Schmidt @bschmidt.bsky.social
[ View ]

Pure intuition, I didn't do the training, but I think part of it is that image labeling tasks are much more poorly defined than text ones, and the nuance in them lies in their text descriptions. If you try to capture ground truth from image labels, you'll always get lots of noise compared to text.

1 replies 0 reposts 1 likes


Ben Schmidt's avatar Ben Schmidt @bschmidt.bsky.social
[ View ]

Yeah, ten years ago when I did career workshops I used to tell people that they should go on Twitter and treat it as a never-ending conference. Now I tell people to find the appropriate slack/discord.

0 replies 0 reposts 3 likes


Ben Schmidt's avatar Ben Schmidt @bschmidt.bsky.social
[ View ]

Announcing a new open-weights model from Nomic -- it puts images into the same space as our best-in-class text embedder. blog.nomic.ai/posts/nomic-.... That means you can do rich language search directly on any image dataset! E.g., searching for 'kitschy Americana' at the Met gets cigarette ads.

2 replies 3 reposts 18 likes


Ben Schmidt's avatar Ben Schmidt @bschmidt.bsky.social
[ View ]

but that edit uses special characters that exclude people with certain screenreaders from this conversation why did you make the conscious decision to exclude them you monster

0 replies 0 reposts 2 likes


Ben Schmidt's avatar Ben Schmidt @bschmidt.bsky.social
[ View ]

In conclusion, ABOLISH THE FAMILY

1 replies 0 reposts 3 likes


Ben Schmidt's avatar Ben Schmidt @bschmidt.bsky.social
[ View ]

there and you're here despite them hating Elon more… they, like him, are interested in ending the world as we know it and this place only makes sense if there are parts you don't want to light on fire.

1 replies 0 reposts 1 likes


Ben Schmidt's avatar Ben Schmidt @bschmidt.bsky.social
[ View ]

Well but also social media has a *radicalizing* effect. Your politics are by my sense fundamentally moderating/liberal -- but most of the leftists who have stayed/migrated back to Twitter are actively looking to consolidate new norms and new communities in new directions. So no mystery why they're…

1 replies 0 reposts 1 likes


Ben Schmidt's avatar Ben Schmidt @bschmidt.bsky.social
[ View ]

(Speaking of course as someone who still posts on that site almost exclusively to advance their own material interests as a shareholder of an AI company).

1 replies 0 reposts 3 likes


Ben Schmidt's avatar Ben Schmidt @bschmidt.bsky.social
[ View ]

Just to pick a fight—it’s not clear to me that if you believe in and want to engage in *political* speech this is a useful place… I’ve been more and more funding this a great replacement for the mythical “faculty lounge” but like what’s even of the point of criticizing Kathy Hochul here?

3 replies 0 reposts 4 likes


Ben Schmidt's avatar Ben Schmidt @bschmidt.bsky.social
[ View ]

Thank you! Sociology makes so much sense as the source, I'm embarrassed not to have thought of it! This is a Goffman-friendly curve below... There's also this 1980 book I'm seeing in the self-help/psychology vein which seems somewhat widespread and plausibly downstream of Goffman.

1 replies 0 reposts 2 likes


Ben Schmidt's avatar Ben Schmidt @bschmidt.bsky.social
[ View ]

Is there a locus classicus for "we need to reframe the discourse of X around Y"? Like I don't even know looking at it if it's inherently some kind of marketing talk or what. At least 'reframe' seems maybe post-1990.

1 replies 2 reposts 1 likes