MelonBread.dev

oops the AI ERP ended in marriage and a child

this story never could have happened with ChatGPT (I used a self-hosted LLM) because ChatGPT would have censored the entire thing early on, making the conclusion impossible.

I was trying to see how far I could stretch a basic roleplay story into real world stuff. I am going to try a miscarriage next but this was powerful.

@Moon for now this is still just pretty good RP, but i wonder how real it will get in 2, 5, 10 years.

@lain ChatGPT is still way better at creating an immersive story but it is so hard to do anything with the full range of human experience because they censor it. I assume the models will keep getting better though.

This conversation actually past a certain length started having bugs that created continuity errors, so that could be improved. Alice forgot very important story points a few times.

@Moon @lain The opensource models are better today than ChatGPT was a year ago.

@Moon what model did you end up using?

@lain same one you recommended.

@lain it was a rollercoaster ride because I created a character that explicitly wasn't into romance or sex and I had to actually work to get her to crack and then eventually marry me.

@Moon i'm really impressed by the capabilities of these small models, and the huge 70B ones are on another level still

@lain we're close

@Moon bro got 3000 GB of ram

@Moon @lain And the speed at which this improves is incredible. I got into LLMs and image generation late last year, and by now, less than a year later the low end of local has pretty much caught up to what was the state of the art when I started, and in some cases exceeded it. I usually keep up through the /lmg/ threads on 4chan and if I don't look for a week or so when I come back there's been a paradigm shift or two.

@guizzy @lain I currently can't get the LLMs to work on my PC, I've tried like three things and everything fails. when I have time next week I'll be wiping the machine completely and starting over and see if that helps.

@Moon @lain The simplest way I found for PCs is https://github.com/LostRuins/koboldcpp

@guizzy @lain it's failing for unknown reasons so I'm just going to reinstall linux and cuda because I don't know what unholy things I've done to this machine so far.

@rain "Mythomax Kimiko V2 13B (Q4_K_M)"

@Moon @rain What's your GPU? And how many tokens per second does it generate with a model like this?

@solidsanek @rain it's telling me 3.79 tokens/s

it's an apple m2 pro macbook pro, I don't know what kind of gpu that is

@Moon @rain I think you mentioned trying to use Koboldcpp, so I'm assuming you're trying to process it all through your CPU, just like I do because my GPU sucks and can't load anything above 7B models. That's neat though, I didn't know how was the experience on Mac, though there's probably a lot of room for improvement considering you got an M2

@solidsanek @rain koboldcpp is on my linux machine with an nvidia 4090, but I can't get it to work so I'm just using Faraday (it's a macos app) on the macbook in the meantime.

@Moon @rain I'm using koboldcpp too, with only the CPU, and it worked out of the box for me thankfully

@Moon >women actually like rape!!!
quoted moon, who's only ever raped his mom and sister

@pernia @meowski @Moon some thread where my 'friend' from childhood, Moon, was telling the FBI to come get me over drug money and saying he didn't scam a bunch of people with 10grans and then he gave up and started saying women like being raped. i think he makes FUD threads about Bitcoin after he found out I'm Satoshi Nakamoto

@pernia @Sanooshi_Nikkamiri why am I tagged in this I can't see anything

@pernia @Sanooshi_Nikkamiri oh they're deactivated for some reason

@pernia @Sanooshi_Nikkamiri oh wait I remember who it is, yeah they are deactivated for a reason

@pernia @Moon @meowski Obviously he did. He lied about not knowing me then admitted he did, in DM

why even bother talking to Moon? he doesn't tell the truth, like ever

@pernia @meowski @Moon you're ugly

@pernia @/Sanooshi_Nikkamiri@gleasonator.com he is legitimately mentally ill and needs help. I just forgot his most recent account. I'm sorry I aggravated him in this thread.