Why?

Interaction is what drives it. You think you’re being clever, but as long as you’re communicating it-

You’re locked in with it.

If you aren't paying cash, you pay with your privacy. If you are paying, enable privacy features (no improving their service, no blackbox memories).

They are also subject to GDPR and similar, so make use of your legal rights, if you have any.

Or ... shock, horror ... don't use them at all.

I don't use ChatGPT anymore as I've switched to another model but back when I did this wasn't something they were secretly doing. It's a feature. You can read the memories it has saved, delete the ones you don't want it to store and IIRC it can also be turned off.

blackbox memories

I'm fairly sure you can just check what the memories are and IIRC even delete them (haven't really used ChatGPT recently so maybe it's changed)?

I want the personalization...without Big Brother. My personal and local AI, should work solely for my interests. I have been using my local AI for creating an customized cookbook, making save editors, and right now, an restoration mod.

Never before have I had so much agency in my life. AI has great potential for self actualization, but corporations and government will be working to undermine it. Hopefully, everyday people will recognize that and make local AI the norm.

Exactly. The real promise of AI isn’t having a corporate assistant that remembers your life so it can monetize you. It’s having a tool you control, running on hardware you own, helping you create things you actually want. Local AI turns personalization into empowerment rather than surveillance. Which is probably why Big Tech would prefer to rent you your own brain by the month. How does your setting look like? What hardware, harness, agent, modell are you running locally?

Currently, using the Strata backend with Qwen-Flash-Next. It has successfully made 4 save game editors, 2 plugins, and did some work on La-Mulana 2006 to make the controls and graphics play nice with Windows 11, plus my gamepad. The DLC restoration mod is largely successful, I am doing QA for making the DLC accurate to what was offered in the ad copy.

000000000

Hermes Agent is my model of choice, and I have Strata using 256k context, on a IQ3. I find that Next-Flash is much faster than the smaller 27b, and has more personality. Sometimes it can get a bit loopy. I typically have the AI keep a bible of findings, and start a fresh Hermes session - then tell it to condense the information from the old workspace and session into a more relevant version. Save on context, and makes it more effective since it discards findings that have been superseded.

Hardware wise, a TRX50 AI TOP motherboard, 7965WX CPU, RTX 4090 and x2 RTX 3060, with 128gb of 5600 RDIMM. Down the line, I might try some GPU unlockers when other folk have tested them for bugs. So about a month or two?

https://github.com/JustAResearcher/gpu-unlock-ada

https://github.com/Zagitta/gpu-unlock

https://github.com/impacifist/Windows-GPU-UNLOCK

00000000

I bought my memory and the CPU from Ebay, for prices a bit lower than at Newegg. If I could redo my GPU purchases, I would have gone with a RTX Pro 4500 Blackwell. That has 32gb of VRAM, and occupies a single double-width PCIe slot, and sips energy. The RTX 4090 is only 24gb, and takes up 1 and 1/2 of my slots.

00000000

Qwen-Flash-Next is an experimental model, the official version might come out in a month or so. If it is the same size or smaller, I will switch to that as my main driver. My current AI model feels useful to me, but clearly has raw aspects to it. Vision is a big one, since this AI can fail to see or understand details.

Ugh yeah that seems to fit the bill. So I guess the inquisition is next up... Or you just starve if you don't go full head into the(ir) system, I mean that is what they prepare potentially.

Memory summaries these days, yeah. Point & click management for ChatGPT.

Codex maintains local memory files, which is better.

Funny that article is in futurism.com that is jam packed with tracking cookies and fingerprinting.

This is the kind of AI success story that never makes the investor decks: Your setup sounds like the future they can’t easily monetize. 💪😎✌️

Thank you. :)

Hopefully my projects make the lives of other people a bit better, alongside my own.

00000

I am thinking about starting up a $5 tip jar at Patreon, with my files free for anyone to download. If I can get enough money saved, I would be able to decrease the amount of time it takes for a project. So far, my projects take 3-7 days to succeed or fail, bottlenecked by the AI speed.

Unfortunately, my projects are pretty niche. Bastion, TEVI, System Shock 2, Ast Libra, Shrift, Sailing Era, The Humankind Odyssey, Alpha Protocol, The Jupiter Incident, and many others are probably too obscure to interest people.

Unless they somehow make personal setups too expensive for.... Oh, wait...

Because I'm capable of reading chat logs and research posted by humans. I follow this stuff closely, because I'm a software developer and it impacts my career. I don't have to use LLMs to understand how they work and what they do.

For now, I can avoid AI because it's easy to spot. Even product website AI chatbots are poor imitations of people. (Honestly, the mental acrobatics people must go through to talk to one of these things as a trusted advisor baffles me. It's a fucking machine, you're talking to a box, a piece of software. Stop anthropomorphizing the damn things. But, maybe that's just me.)

In the near future I expect for anything important to me (namely, doctors, lawyers, friends, advisors), I'll only trust face to face conversations--but then, no more so than I ever have. Because, they won't perfect androids in my lifetime.

The threat is that for paid positions, like doctors, etc., the option for face to face may become too expensive for anyone but the rich. Because, you know the rich won't take digital advice. Hell, they're trying to replace teachers in public schools with machines, right now. The rich never let their kids have phones when they're young. Or, at least not the parents who give a fuck about their kids, which seems not many filthy rich do. Let alone will they let some machine teach them in school.

Oh no...

so you knew what you posted was wrong and posted it anyway just to virtue signal?

My girlfriend works in the medical field and she told me that their doctors and psychologists all use some form of AI, mainly chatgpt. So even if you're really careful, someone might still feed your information to tge cloud.

Don't lots of countries have very strict rules about were medical information can be sent to and how it must be managed (I believe in the US it's called the HIPA)?

It's part of a family of attitudes which include "I don't care about Politics", as if pretty much everything involving humans living in society wasn't in some way or other shaped by politics.