• 2 Posts
  • 37 Comments
Joined 1 year ago
cake
Cake day: November 6th, 2024

help-circle
  • I have a 12 gig gpu that I dont use for most of the time, might as well put it to work doing something. And even second hand ddr4 memory has gotten so expensive I’d rather not have to upgrade my homelab.

    What is your main use case for this anyway? Do you use it for researching? Thats what I would mainly use it for, but also finding things in my obsidian volt.

    What stage have you actually gotten to?

    I do like the idea of this all though. I should really get into undervolting/overclocking my stuff, there is really no reason not to I could either gain performance or longevity or both!

    Also I hate that the stock fans on cpu’s are so garbage. Luckily arctic fans are really cheap and quiet. Noctua is great but i’d sooner buy a budget aio than a single noctua fan lol.



  • Thats awesome! I was going to add some sort of AI to my proxmox homelab for researching but I figured the risk of halloucination was too high, and I thought that the only way to fix this was getting a bigger model. But thid seams like a really good setup (if I can actually figure out how to implement it.) And I wont need to upgrade my gpu!

    Althogh I only have one ai suitable gpu (I have a gtx 1660 6gb in my homelab which is really only suitable for movie transcoding.) I have a 3060 12gb that I use in my gaming pc I was thinking I could setup some kind of wol system that boots the pc and sets up the ai software on that. Maybe my homelab hosts openwebui and when I send a queory it prompts my gaming pc to wake up and do the ai crunching.