Nicholas Carlini - Black-hat LLMs | [un]prompted 2026

Why HN readers recommended it

HN cites it as a concrete demonstration that LLMs have suddenly become strong at finding and exploiting vulnerabilities.

This is a summary from the source dataset, not an endorsement by Hacker News or the video creator.

Video & recommendation details

Creator / channel

unprompted

Topic

llm vulnerability research

Format

talk

Level

intermediate

HN recommenders in dataset

9

HN mentions in dataset

16

Recommendation years in dataset

2026–2026

These counts and years describe the included Hacker News records; they are not YouTube views or the video’s publication date.

From the original HN conversations

Excerpts from the recorded comments. Follow each source for the full comment and surrounding discussion.

• I'm sure they do, yet the models really are getting scarily good at this. This talk changed my view on where we're actually at: [VIDEO]

• The talk "Black-Hat LLMs" just came out a few days ago: [VIDEO] Looks like LLMs are getting good at finding and exploiting these.

• This very question was asked to Nicholas Carlini from Anthropic at this talk: [VIDEO] The answer is complex, worth watching the video. But mainly, they don't know where to place the line. Defenders need tools, as good as attackers. Attackers will jailbreak models, defender might …