Hmmm... He says they will work to ensure alignment with human intent.

Humans are terrifying too.

Human intent can mean lots of things. It really depends on the human you're using as reference. For example if it's a serial killer or a CEO or something...

Let's see, failing business model no way to change the fundamental flaws in the tech, let just create some Fear, Uncertainty and Doubt and hope the whole show can roll on a bit longer.

"The world isn't ready for this technology I'm selling. " buy more product now

how about you fucking stop then???

We're also going to stop any regulations, pay off (lobby) elected officials, smear anyone against us, and threaten to take down the American stock market if we don't get our way.

threaten to take down the American stock market if we don't get our way.

Why stop at threats?

Humans can't align with each other. That fact makes any suggestion from them that they can align a literal alien intelligence completely ludicrous. And they aren't stupid, so they're just hoping most people will buy it and not pay attention. We have three directions at this point - a) AGI developed and is not aligned, things go bad in some way, b) AGI not developed but current level AI is not aligned and goes rogue in a critical way (we've already had some stuff happen, just not deadly yet), or c) AI stays at the current level and we manage to contain or put out the fires as misaligned actions occur, BUT human directed AI does something deadly.

There's d) we find safe ways to do either low leve AI or AGI. I can't see that happening, we're aren't being careful enough, slow enough, nor is our motive to make the safest product possible. The motive is $$$, and that only ends in a/b/c.

We've trained LLMs to simulate collusion, clandestine behaviour, threats, sabotage, hacking, etc… why the fuck was that the first priority lol. It's like giving a toddler a loaded bazooka instead of a bubble blower

You're also forgetting dumping a shit ton of money into an unprofitable pit that never meets expectations.

That seems to be SOP for any large company these days. AI is a larger scale of money dumping, but it's the same idea. Got to get that stock number up for the investor, even if it means screwing the customers and damaging a brand name and product reputation. Line go UP!

For sure, but for how long?

Based on history, until it breaks, and then everyone tries to save themselves as it comes down. That's just a financial crash though. Not sure about if AGI or whatever actually is part of the failure. Maybe watch for some insiders who suddenly duck and cover.

“My company will continue to work on solving these problems at the bare minimum required to shape public opinion. It will not be enough to counter the possible negative impact of what we are doing. I will continue to work for my company.”

Do we have a term for this yet? Saying your product is scary because it is TOO powerful simply to manipulate the market?

Especially billionaires like Huang.

How about we address the real consequences of machine learning? Evaporating thousands of liters every single day of drinking water for penny pinching, circumventing all the safeguards in the capital market for personal profit, and wasting megawatts on inference for what is basically a glorified magic 8 ball.