| Post Reply | RetroFed Forum Forum Index » Privacy |
| Author | Message | ||
|---|---|---|---|
|
Doomerang
lemmy.ml
xela@lemmy.ml Joined: 2023-06-05 |
Very confused, is this all BS? "Confer, the private AI chatbot launched by Signal creator Moxie Marlinspike, uses that Nvidia-based TEE setup— along with an authentication system...." "Meta, too, uses a TEE to offer a more private version of the Meta AI chatbot included in WhatsApp—a privacy system that Confer’s Marlinspike has said he is helping Meta to develop." This feels too good to be true and I am surprised this article is the first i am hearing about the relationship between Marlinspike and Meta for this product. |
||
| 11 Original | |||
Alas Poor Erinaceus
lemmy.ml
zdhzm2pgp@lemmy.mlJoined: 2024-12-18 |
Lemmings, what are your thought on duck.ai? |
||
| 6 | |||
Alas Poor Erinaceus
lemmy.ml
zdhzm2pgp@lemmy.mlJoined: 2024-12-18 |
Marlinspike seemed like he might be ok, and now he's working with a company that's been proven time and time again that it can't be trusted to do anything? |
||
| 4 | |||
|
lagg_mine
lemmy.world
lagg_mine@lemmy.world Joined: 2026-07-28 |
Lemmings, what are your thought on duck.ai?
I tend to use it to help with homework for uni if I don't have access to a powerful enough device to run something locally. |
||
| 3 | |||
|
twoBrokenThumbs
lemmy.world
twoBrokenThumbs@lemmy.world Joined: 2024-03-29 |
I'm no expert so take this with a grain of salt. But basic logic says if the data (your prompt) gets processed by anything then it needs to be able to read it. Therefore its not private by default. Sure, they can encrypt it (where? At rest? End to end?) and not retain history etc, and that can make it more private, but it won't be private. That's like Proton's Lumo which is "private" in the same sense, but the requests are being sent to a server to process so that data is read by something somewhere. I use Lumo BTW, but never put personal info into it etc. Then no matter how private it is, if Meta starts using it it's immediately spyware. If you want true private you'll need to run your own local models. |
||
| 11 | |||
|
Helix 🧬
feddit.org
helix@feddit.org Joined: 2024-07-27 |
Lemmings, what are your thought on duck.ai?
I like it. I treat it the same as any other AI apart from my local llama.cpp. |
||
| 4 | |||
|
grey_maniac
lemmy.ca
grey_maniac@lemmy.ca Joined: 2023-07-24 |
It's paywalled for me so I can't verify this, but the quote provided looks like two separate statements. It does not necessarily mean Marlinspike works with Meta. |
||
| 2 | |||
|
Doomerang
lemmy.ml
xela@lemmy.ml Joined: 2023-06-05 |
It's paywalled for me so I can't verify this, but the quote provided looks like two separate statements. It does not necessarily mean Marlinspike works with Meta.
It links to a blog entry from his AI project confer.to: https://confer.to/blog/2026/03/encrypted-meta/ "As Confer continues to operate as an independent entity, I will also work to integrate Confer’s privacy technology so that it underpins Meta AI. Meta is building advanced frontier models, so this will combine the most private AI chat technology in the world with the most capable AI models in the world. As Meta builds more AI products beyond the basic chat paradigm, the privacy technology from Confer will be a part of the foundation of everything that is to come." |
||
| 2 | |||
|
grey_maniac
lemmy.ca
grey_maniac@lemmy.ca Joined: 2023-07-24 |
It links to a blog entry from his AI project confer.to: https://confer.to/blog/2026/03/encrypted-meta/ "As Confer continues to operate as an independent entity, I will also work to integrate Confer’s privacy technology so that it underpins Meta AI. Meta is building advanced frontier models, so this will combine the most private AI chat technology in the world with the most capable AI models in ...
Thank you for the further detail and working link. |
||
| 2 | |||
|
Doomerang
lemmy.ml
xela@lemmy.ml Joined: 2023-06-05 |
Thank you for the further detail and working link.
Sure thing! |
||
| 2 | |||
|
reader
lemmy.zip
reader@lemmy.zip Joined: 2026-02-19 |
cold sun? |
||
| 0 | |||
eremophila
lemmy.zip
eremophila@lemmy.zipJoined: 2026-07-20 |
Would rather talk to myself, it's saner. |
||
| 3 | |||
|
un_ax
lemmy.today
un_ax@lemmy.today Joined: 2026-05-27 |
I'm no expert so take this with a grain of salt. But basic logic says if the data (your prompt) gets processed by anything then it needs to be able to read it. Therefore its not private by default. Sure, they can encrypt it (where? At rest? End to end?) and not retain history etc, and that can make it more private, but it won't be private. That's like Proton's Lumo which is "private" in the sam...
The TEE mentioned in this article is essentially hardware level identity/encryption similar to the boot chain of a phone or game console, so if you trust nvidia then it sounds like it would work. If you trust nvidia. And all of the other implementation details.
There is actually Homomorphic encryption where you can operate on encrypted data, but I don't imagine it's used much in machine learning since it takes 100-10,000x longer than the plaintext operation. |
||
| 4 | |||
|
eldavi
lemmy.ml
eldavi@lemmy.ml Joined: 2023-07-18 |
Would rather talk to myself, it's saner.
i do it because i'm a fan of intelligent conversation. lol |
||
| 2 | |||
|
utopiah
lemmy.ml
utopiah@lemmy.ml Joined: 2022-01-17 |
I'm no expert so take this with a grain of salt. But basic logic says if the data (your prompt) gets processed by anything then it needs to be able to read it. Therefore its not private by default. Sure, they can encrypt it (where? At rest? End to end?) and not retain history etc, and that can make it more private, but it won't be private. That's like Proton's Lumo which is "private" in the sam...
It's two different problems :
|
||
| 1 | |||
|
hirihit640
sh.itjust.works
hirihit640@sh.itjust.works Joined: 2024-10-28 |
If TEE is anything like Secure Computing, then it works something like this:
There's also ways to make sure you as a user/client are communicating with one of these trusted servers and not some malicious server masquerading as a trusted server, but I forgot how that part worked. You can look up Apple's announcement on Private Cloud Compute, or any article on remote attestation. |
||
| 0 | |||
Matt
lemmy.ml
DieserTypMatthias@lemmy.mlJoined: 2024-04-03 |
Just install Ollama and pull a model from their registry. |
||
| 2 | |||
tiny
midwest.social
tiny@midwest.socialJoined: 2023-06-08 |
Just install Ollama and pull a model from their registry.
You need a minimum of 16gb of vram in order to do anything that requires tool calls and even then it is slow. Running llms locally is a fun challenge and it's impressive what can be done on consumer hardware but it isn't cheap or simple |
||
| 3 | |||
Matt
lemmy.ml
DieserTypMatthias@lemmy.mlJoined: 2024-04-03 |
You need a minimum of 16gb of vram in order to do anything that requires tool calls and even then it is slow. Running llms locally is a fun challenge and it's impressive what can be done on consumer hardware but it isn't cheap or simple
Yeah. But you at least have the incentive to upgrade. I still have my GTX 1660super I want to upgrade to something better so that I can save on my AI subscription (unlike a sub you actually own it and can run whatever open weight model you desire). |
||
| 0 | |||
Matt
lemmy.ml
DieserTypMatthias@lemmy.mlJoined: 2024-04-03 |
If TEE is anything like Secure Computing, then it works something like this: first you have to trust the CPU manufacturer to not insert any backdoors the CPU is designed to only run code that is signed with a certain signature (aka secure boot) the AI company (Signal or Meta in this case), gets their code audited to make sure it does not exfiltrate user data, and then signs the code now the sig...
AFAIK Confer is independent from Signal. |
||
| 1 | |||
| Post Reply |
Back to top |