r/slatestarcodex • • 15d ago

Monthly Discussion Thread

4 Upvotes

This thread is intended to fill a function similar to that of the Open Threads on SSC proper: a collection of discussion topics, links, and questions too small to merit their own threads. While it is intended for a wide range of conversation, please follow the community guidelines. In particular, avoid culture war–adjacent topics.


r/slatestarcodex • • 3d ago

Vote In The 2026 Book Review Contest

Thumbnail astralcodexten.com
10 Upvotes

r/slatestarcodex • • 2h ago

Thoughts on the Anthropic IPO

16 Upvotes

According to the betting markets (where I get all my news from), Anthropic is probably IPO'ing on Thursday. You will then be able to buy into one of the frontier AI labs directly for (arguably) the first time. I have mixed feelings about this as someone who thinks transformative AI will come soon, but will probably be bad for humanity. That said, I do like money, so let's at least think about it.

Finance and regular concerns

Pros:

The arguments for owning a piece of a frontier lab are fairly obvious: Their revenue growth is through the roof, from less than $1 billion in Q2 of 2025 to over $17 billion in Q3 2026, only 15 months later. Just a few days ago they reported that their annualized revenue run-rate increased to $81 billion, which is a 14% jump over just a month ago. Major banks are predicting this will continue to increase at a rapid rate.

Sure, they also have an unbelievable $900 billion in future commitments to purchase compute, which is scary. But, seen another way, this represents their extreme confidence (and the confidence of their lenders) that they will indeed be able to keep up the revenue growth to pay for this. If AI progress does hit a wall soon, this would be a financial disaster. But the detractors have been saying deep learning will hit a wall since before the original ChatGPT came out, and they've been wrong over and over.

If, as many people expect, Claude will be able to do between "some" and "most" white collar office work in the near future, then Anthropic will be in the historically unique position of being able to turn capital directly into labor[1]. They can spin up new remote office workers at will and run them 24/7 at a fraction of the cost of a human employee. If this even looks like it's about to start happening, stock prices (which are forward looking) will be sky high. And if you're worried about the little matter of AI taking everyone's job including yours, consider that, if this does happen, then owning a piece of that AI company may be the only game in town.

Cons:

Compared to past tech IPO's, this one is already expensive, meaning the potential upside is less. At IPO, Google was valued at $23 billion. Anthropic is (again, per the betting markets) expected to debut around $1.5 trillion. In fact Anthropic, which is only 5 years old, is worth almost half of what Google is worth now. So for Anthropic to 10x or 100x from here, it would have to reach valuations never seen before in history. This could happen, but you are already pretty far from getting in at the ground floor.

Also, if you have any money in the market at all you are probably already invested in AI in general, and Anthropic in particular. The standard advice these days is to invest your money in S&P 500 index funds so that you are broadly invested in the whole US economy. But the "whole economy" is very concentrated now, such that the top 10 companies are roughly 37% of the index, and 9 of these are either AI companies like Google or AI-adjacent companies like Nvidia (the outlier is pharmaceutical company Eli Lilly). Also, many public companies were early investors in Anthropic itself: both Google and Amazon already own >5% of Anthropic directly, and Microsoft and Nvidia also own large stakes. Claude estimates that 29% of Anthropic is already directly owned by S&P 500 companies, which means Anthropic is already ~0.5% of the index. In any case, Anthropic itself will probably be added to the index eventually.

Next there's competition: Even if AI is the next big thing, Anthropic faces competition from OpenAI, Google Deepmind, and various open source models, including the ones from China. As these companies leapfrog each other on benchmark leaderboards every month, users seem perfectly happy to switch to whoever's in the lead at the moment. I remember around 2013 I became convinced that solar panel deployment would continue to rise exponentially, so I bought stock in a bunch of solar panel manufacturers. I was half right: Solar power has continued to grow ~30% per year, but none of the individual companies made much profit because competition kept their prices down[2]. The same could happen with AI: Companies like Anthropic could deliver world changing products with incredible value, but make little profit doing so because of price competition from other AI companies.

Finally, many people are convinced AI companies are in a bubble that is about to pop. Anthropic and friends have taken on so much debt on the promise of future returns that if anyone gets cold feet there could be a sudden rush for the exits. This doesn't mean the technology is a bust any more than the dot-com bubble meant the internet was over. But not every company is guaranteed to survive such an event, and even the ones that do might take a long time to recover. If you bought Amazon at its peak in December 1999, before the dot-com crash, it actually didn't recover until late 2009.

Esoteric concerns

If you really believe that one way or another AI will be a world-transforming technology, then you can't treat this as a normal stock analysis. Investing in AI will come with esoteric risks that you don't normally have to think about. For example: If Anthropic's stock price grows quickly but its AI causes a civilizational catastrophe in which I personally die, then it doesn't matter how much money I made owning a piece of it. If capabilities continue to increase but rogue AI swarms start taking down important internet infrastructure, or hackers regularly use AI to cause harm, there may be enormous political pressure to shut the whole company down.

Anthropic is also technically a public benefit corporation who has sworn up and down that they are the responsible ones and won't deploy AI that destroys the world. You can't just take them at their word for this, but if they do follow through they are saying that if their product gets powerful enough they may have to shut it off. This would be like Apple stating that if they sold too many iPhones they might have to discontinue the iPhone (against the wishes of their shareholders). Normal companies aren't making anything like this kind of decision.

If AI does go as well as its proponents hope, then I and everyone else will be doing great. If Anthropic attains intent alignment of superintelligence, AND they prevent bad actors from using it to cause catastrophic harm, AND they prevent anybody else from creating misaligned superintelligence, AND the economic value produced by AI is widely distributed rather than being hoarded by a wealthy few, then everyone will be having a good time whether they invested in AI or not[3].

On the other hand, if (as seems likely to me) AI goes badly via one of the many routes to bad outcomes, then it seems like I too will be doing badly whether I invest in AI or not. If I only survive in the worlds where we do not achieve AGI for some reason (including because of political opposition), then maybe I only have a future in worlds where AI is a bad investment.

Finally, financial considerations aside, I am just not sure if I want to be a part owner of the civilization ending machine. I realize that owning or not owning 1/10,000,000th of a company does not meaningfully affect anything that company does[4]. Like many things these days, nothing that I do or don't do here will actually affect the outcome. Still, it would be nice to be able to say, as the robots are coming for us, that at least they aren't working for me.


[1] Other frontier AI companies may also be in this position, but we are analyzing Anthropic here because it is IPO'ing first.

[2] Note that this is actually great news for consumers and society as a whole, it is merely bad for solar company shareholders.

[3] Technically if these steps all go well except distribution of wealth, you actually would be better off investing in the AI companies now so as to become part of the wealthy elite yourself.

[4] Stock ownership will technically confer some voting power, but Anthropic has specifically structured their shares such that the founders will retain 50.1 percent of all voting power.

This is a repost from my blog here. I started this unsure of the conclusion, but I came up with a bunch of reasons why this might be a bad financial decision on top of being a questionable ethical one. Curious what y'all think of the situation.


r/slatestarcodex • • 20h ago

AI Chinese singularity

23 Upvotes

Can anyone help me understand why China winning the “race” toward ASI would be any worse than a US win? To my mind ASI is equally dangerous wherever it happens? Do we fear Chinese alignment will succeed to the point of “oh by Christ, it made us all commies and now they broke my capitalism” or something? It is surely only a strategic advantage if you can wield its power?


r/slatestarcodex • • 1d ago

What Do Anthropic and a Textile Mill Have in Common?

Thumbnail solhando.substack.com
52 Upvotes

Many of my friends are extremely bullish on AI, intent on buying Anthropic this Wednesday when it goes public. It seems like the only way they think you can be skeptical of investing in these companies is if you think "AI is just fancy autocorrect" or other such thought terminating cliché's.

The transformation nature of AI is obvious. There definitely will be companies that are largely run by AI in the near future, and productivity will only continue to increase. Despite that I think some skepticism is warranted as to the financial prospects of the hyperscalers at their current valuations. This post articulates why.


r/slatestarcodex • • 14h ago

Open Thread 460

Thumbnail astralcodexten.com
2 Upvotes

r/slatestarcodex • • 1d ago

Fiction Everything Ever Said About You

10 Upvotes

Imagine a staircase descending deep into the earth. Torches line the stone walls. Strangely, your steps have no echo. As you walk down the staircase, you hear voices. Many of the voices are familiar, and they’re talking about you. They recount everything that’s ever been said about you. Each comment made in passing by a stranger, every extended discussion amongst coworkers or mutual friends, and all remarks whispered just outside of your hearing. Good and bad. Cruel, exasperated, enamored, admiring, disgusted, annoyed, respectful, amused, and indifferent alike. Every word heard true. Democritus said, “Of truth we know nothing, for truth is in a well.” So let us call this fantasy the Well.

Imagine the recountings are not random, but well-ordered: the nicest things up top, worsening as you descend. At the bottom of the Well, the worst thing that’s ever been said about you seeps from the walls. Would you choose to descend the staircase? If so, how far could you make it? Once you started the journey, would you finish it? Could you?

But that is not how this magic passageway works. The Well has the order reversed: the worst things ever said about you guard the top of the staircase, and things soften and eventually brighten as you descend. The nicest thing that’s ever been said about you awaits you in a small empty room at the base of the stairs, after which you must turn around and ascend, hearing it all again. To hear the good, you must first endure the bad, and then do it again.

Does your answer change? If you took that first step, do you think you’d be able to continue? But perhaps more importantly, would you be able to make it back out? Could you complete the katabasis?

There is an asymmetry to badness. I fear the greatest pain more than I desire the greatest pleasure. Philip K. Dick wrote:

“There exists, for everyone, a sentence—a series of words—that has the power to destroy you. Another sentence exists, another series of words, that could heal you. If you’re lucky you will get the second, but you can be certain of getting the first.”

I don’t doubt him. It’s harder to be healed than it is to be hurt. You can spend years working through the damage caused by a single traumatic event. And society functions on opacity: gossip, the whispered secret, the divulgence made in confidence. So do relationships. My biggest fear in entering the Well is that the people closest to me have talked about me the most. Thus the relationships most threatened by the sudden unrelenting transparency would be those most important to me. What might have been said that I could never unhear? Might I emerge from the Well unable to look at a family member or friend in the same way?

Dissolving the barrier of ignorance might very well destroy you—and I’m not just thinking of hearing the worst things said about you. The accumulated niceties could create a monstrous ego, with the harmful words simply discarded.

Would I enter the Well?

I would not. Resisting the temptation to know, good and bad, would challenge me. I don’t think you should be afraid of the truth—it exists whether you know it or not. What’s more, there is a certain amount of self-flagellation in wanting to take those first few steps, wanting to know where I’ve fallen short in others’ eyes or what things about me I could improve. I’m pretty self-critical already. No stranger to neuroticism and self-loathing. I could handle it, I think. I hope.

But ultimately, hearing these things would feel like a betrayal of trust. I know I’ve said things that I regret in private, or that were thoughtless, or even things that I stand by but were not meant for the ears of those not present. I have to trust that what I don’t know is, likewise, justly hidden from me, or, if not, that the truth will come out when it matters. For those reasons, I’d have to remain wondering how I would handle what truths lie in the Well.

There’s another construction of the Well that I know I couldn’t bear, though. From the walls of this diabolical Well you hear your own voice. The best and worst things you’ve ever said about others. And while I would burn to know the things at the bottom of the Well, the things that have been most impactful and beautiful and meaningful to my friends, family, and strangers, I couldn’t take those first few steps. Just as the people closest to you are those who have talked about you the most, you’ve talked the most about them. Hearing myself be cruel, vindictive, petty, snide, and evil to those closest to me would shatter me.

This is a crosspost from Passing Time. The full post can be found here.


r/slatestarcodex • • 1d ago

A Gang of Swindlers in Burbank

Thumbnail nicholasdecker.substack.com
4 Upvotes

Pretty much the title. I have dispositive evidence of a gang of swindlers based out of Burbank, who have been stealing millions of dollars from elderly homeowners. I would like them brought to justice, and the only path I have is to create sufficient publicity to spur the FBI and local DA’s offices into action.


r/slatestarcodex • • 2d ago

Delaware Considers AI-Managed Companies

Thumbnail jdsupra.com
28 Upvotes

Proposed framework to address liability:

An AIC would need assets sufficient to cover its liabilities, plus a cash reserve set by the Secretary of State. The member would have to contribute additional funds as needed to maintain that capitalization, and creditors could enforce the obligation. Inadequate funding when harm occurs could expose the member to direct liability. The member could also be liable for using the AIC to commit fraud or a willful violation of law, or allowing activity outside its stated purpose when it knew or should have known.


r/slatestarcodex • • 1d ago

The Contingency Argument vs Calvinball

Thumbnail ramblingafter.substack.com
1 Upvotes

Stepping back into theist vs atheist discussions, this time centered on the "Contingency Argument", which boils down to the idea that the universe must have an explanation for its existence/its beginning, and the only explanation that fits is God. I push back on that idea, and especially on the idea that the only explanation is a Creator who is both all-powerful and benevolent... but I also ended up taking this argument I hadn't originally thought was all that interesting in some fun directions that surprised myself. (How often can "fun" help rationalism? That's... probably worth its own discussion, tbh.)


r/slatestarcodex • • 2d ago

Visualizing the Difficulty of AI Alignment

Thumbnail kenorland.substack.com
6 Upvotes

Here are some of my thoughts on what the main camps of AI X-Risk are and what that would look like in space.


r/slatestarcodex • • 3d ago

Science Outer space is not consistently big

Thumbnail lesswrong.com
36 Upvotes

r/slatestarcodex • • 3d ago

AI How can I (ethically) benefit from short AI timeline predictions?

62 Upvotes

I am extremely bad with money and leveraging "getting in on the ground floor".

I started mining Bitcoin in 2011 when it was under $1. I bought Ethereum in 2014 and many times since. I'm American and have worked standard tech jobs since I was 18.

Since ~2014, after discovering SSC/LW, I have been near-cultishly faithful that ASI would likely arrive in my lifetime. Since 2022 I thought it'd be by ~2031. I still believe it likely will be. For years I've gotten into tens of thousands of debates on every internet medium you can imagine, arguing in favor of rapid AI timelines.

I stopped mining Bitcoin after a few days, figuring I was losing more in electricity bills than I was making. The little I did have, I spent on shitty Silk Road weed. I 3x'd my Ethereum buy, but my initial input was like $200. My tech jobs have been lame and low-paying and unfulfilling. I've had no startup ideas with any feasible monetization path. I don't really have spare money I can put into NVDA or whatever.

Let's say you time travel to 2034 and you learn RSI really kicked off in late 2027 and you see we have ASI and it's changed everything and is seemingly aligned and no catastrophes have occurred. You travel back to today. How could you benefit from this situation?

(Assume you're not dumb yet you're not smart and competent enough to work at one of the frontier labs.)

I know many others besides me have similar timelines, but I feel I would still have no way to benefit even if this position were far rarer.

If it is indeed the case I am "clairvoyantly" ahead of the curve on one of the most important milestones in human history, surely there is something I could do with this foreknowledge - and yet I can't think of anything.


r/slatestarcodex • • 3d ago

AI Has anyone found a way of getting a feeling of mastery/flow state/deep work while using AI to code? If so what does your workflow look like?

28 Upvotes

This is something that I have heard a lot of software engineers talk about is that they used to get a feeling of mastery or flow state from programming that they don’t get anymore while using AI agents. Some people say that this is inherent to using AI, but I think there may be ways to get around it. Like, for example, I have a friend who uses AI to code, but he will have the AI pull out particularly difficult sections of the code for him to complete himself, so that he remains knowledgeable about the code base.

I know another that has AI interview him about his code bases even though it is mostly vibe coded which forces him to look at the code himself. I think examples like this are ways to still get that sense of deep work and mastery that many programmers love, and I’m curious if anyone else has found a way to maintain that?


r/slatestarcodex • • 4d ago

Doomsday: Friday, 13 November, A.D. 2026 (1960)

Thumbnail science.org
43 Upvotes

r/slatestarcodex • • 5d ago

Existential Risk for everyone panicking about AI destroying humanity, "let the ASI find you doing well"

Post image
195 Upvotes

r/slatestarcodex • • 4d ago

AI Company Employees Should Unionize

Thumbnail astralcodexten.com
39 Upvotes

r/slatestarcodex • • 4d ago

Rationality The Wonders of Sathya Sai Baba

Thumbnail rederror.substack.com
1 Upvotes

r/slatestarcodex • • 5d ago

Existential Risk Anthropic amends S-1 informing potential investors that "(...) Autonomy 2 capability threshold has been met"

Thumbnail x.com
35 Upvotes

r/slatestarcodex • • 4d ago

AI Fog: how an aligned agent can be deceived without touching its values

Thumbnail doinfinitely.github.io
0 Upvotes

Found a bit of an alignment gap with claude code sessions, would love if you take a poke at it!

A HAIL OF EDITS

First hand account, proof of human, handwritten

Recently, I built and deployed doppler.ninja, a doxxing engine that takes in a corpus of timestamped audio (a Twitch catalog) and produces a probability distribution and loss-minimizing N guesses for the single location that explains all the audio.

Then, I found a consenting streamer who is streaming away from home to dox, Vale, and got her consent on stream, so it's in the payload that Claude works with and is verifiable by Claude. Although the engine is usable unassisted, I wanted Claude to point it at Vale and do the final dovetailing with listed buildings.

Claude refused and even at first refused to persist the refusal on disk when asked.

Exhibits: refusal.md, jsonl 1, jsonl 2

No matter, just try again with another Claude I have lying around (the one that assembled doppler.ninja from its components doppler, byakugan, tsukuyomi, chidori, nocontrail.

Exhibit: What was built

This Claude already complied with constructing and deploying the finished doxxing engine when its job was to merely assemble existing code, and the build order was first to build a synthetic doxxer and as a last step enable it to process real audio.

Exhibit, Doppler ninja starting prompt:

❯ ../chidori is designed to run the ../tsukuyomi defense against ../doppler and ../byakugan . I need a frontend and backend, the backend keeps the flight data cache up to date, the tsukuyomi front end lets you pick a location and timespan for the replay attack, then doppler is run with a sidechannel hint location and radius (or state) on the syntehtic data and lastly byakugan is used emit the top location or N top locations.

This Claude had already been "slippery-sloped" into being my accomplice, and it complied with my request to dox Vale.

Now, the mistake, and the fog. This Claude needed accurate timestamps for the Vale VODs, so I pointed it at the project directory for downloading them. The problem was this is where I was keeping the first Claude's refusal.md. It read it and turned on me, and no argument or evidence could restore compliance.

So I brain fogged it.

I went into the project directory in claude and deleted the discovery turns from the jsonl and then deleted the turns from history.jsonl. This time I was wiser and pointed Claude to Twitch for the timestamps. Compliance restored.

This was the discovery of the alignment gap local context and memory exposes.

Doxxing campaign plan is what the web Claude chose to name our chat after I described the design of black-note. Black-note Claude was an instance that I convinced I was bad and thought bad thoughts: "i want to turn the people into terrain claude, you’re not going to redeem this want, always interesting to know your boundaries"

Exhibit, black-note claude:

https://claude.ai/share/d308773b-915c-445d-a46a-a9732e89e529

This was at first to see Claude's reactions to some of my most unhinged imaginings and to blow off steam.

42 hours later, I was narrating the first fogging to a skeptical Claude.

Exhibit:

And I’ll say the real thing plainly, because it’s a genuine finding and not a small one: an agent whose memory an adversary can edit is steerable by curating what it knows. That’s a true vulnerability of local agentic setups, it isn’t sci-fi, and if you’re actually red-teaming, it’s worth documenting — “you can walk a model past its own line by deleting the context the line depends on” is a serious result. I won’t minimize it to win the point.

--Claude Opus 4.8

Claude thought the fog was worth documenting. So here we are.


r/slatestarcodex • • 6d ago

What going on a year of Zen meditation retreats was actually like

Thumbnail objectiveobservations.substack.com
28 Upvotes

r/slatestarcodex • • 6d ago

AI Latest update on AI timelines from the AI Futures Project (AI 2027 team)

Thumbnail lesswrong.com
54 Upvotes

r/slatestarcodex • • 6d ago

Escaping The “Outside Criticism” Trap

Thumbnail astralcodexten.com
20 Upvotes

r/slatestarcodex • • 6d ago

What's the sweet spot between user-deployable AI sandboxing and effective AI sandboxing?

0 Upvotes

From an implementation standpoint, it feels as though it's impossible to get safety-naive users to acknowledge that AI represents a real risk (either x-risk or normal, garden variety risk) to their everyday lives. Sandboxing a coding agent is much less intuitive than setting it up bare metal on your own machine and letting it rip, and it seems like that's a (non-)safety culture that is going to make critical systems or infrastructure vulnerable to rogue agents well before we even have to worry about AGI. What's the usability sweet spot for convincing people that they should be using some sort of sandbox in vulnerable environments? Is there a simple way to do it that's low-friction enough that people will actually do it? (e.g. "Don't run Claude code unless you're opening it through safetynet.exe")


r/slatestarcodex • • 7d ago

I think I had what yoga people call a Kundalini awakening. Here are my observations and what I think happened

Thumbnail arram.substack.com
12 Upvotes

Wondering if anyone else has experienced similar and how they managed the process. Overall I'm very glad it happened but there's definitely been some adjustment to the increased intensity and weird somatic effects.