If i can figure it out I’ll be sure to post something lol.

So far, i found a python project that is supposed to enable RAG but i have yet to try it and after a reinstall of my linux pc to Popos, im having less than success getting ollama to run.

Me personally, i use my AMD 7700XT to run ollama on my main pc. Can be helpful for troubleshooting as the internet gets worse amd worse to search especially if i dont know what the issue is. Thats my main use case for it but id like to set up something with RAG and use it to help me with documentation if i have questions.

I don’t think its super worth it to use a VPS for an LLM if you already have a decrnt gpu that you can run it on. If yoy dont already have the hardware, plenty of older gpus can run the models pretty well. My 1070ti still kicks ass all these years later and you can find them for $100 bucks or less on ebay used. Ive used it for ollama as well and it does just fine.

Will it be super fast or a really big model? No, but if its for personal use, i dont see any benefit to paying a monthly subscription for it and like i said, works well enough for me.

Its also more secure and private to host it yourself if thats worth anything to you. Thats one of the biggest reasons i self host.

This is rough man, I’m really sorry to hear all that. Christmas is supposed to be a happy time for everyone even without all the gifts.

Maybe instead of gifts for your kids like physical things, plan a day with just you and them. Do something fun as a family or with each of them individually. Memories like that they can cherish for a long time after this year and gifts dont have to be material.

Given what you said, it sounds like you could use a day of fun with them.

“This utility-style regulation will slow down rural broadband builds.”

What a load of shit. As someone who lives in a rural part of Washington, can confirm that Comcast makes no fucking effort whatsoever to bring internet out here. They could give two fucks about building new lines and only care about dominating existing copper shit.

God this makes me so mad. Fuck these assholes for making the internet actively worse for consumers.

I agree with this. I’m using a 1070ti for image gen and it would be more than capable for handling some LLM stuff. An AMD 7700xt ive found dors well with 7B models on my main rig but im sure you could get away with somthing cheaper or less powerful.

That said, the amount of text you can genrate or the context length of its answers will depend the model you use and the larger the model, the more power it takes.

If youre just messing around with it or want it to review or answer small questions, I’d say a 1070ti like I’m using would be just fine. Some folks use even more budget friendly options. If you got a gaming machine with any semi recent GPU, I’d say go for it. Worst case, you can pay for a subscription later if you really want.

I was recently looking for something like this and couldn’t find what i was looking for, so thanks!

I tried umbrel and wasnt super impressed. It seemed like it would function alright for the small amount of things i was trying to do but broke shortly after installing. I set up pihole and i think jellyfin since i was just testing it out on an older laptop.

I’ve heard decent things about CasaOS but have not used it myself.

I like a certain level of quality when it comes to audio.

When I’m making music, I use in ear monitors from shure with a flat response because it would throw off my mixes otherwise. Same with my presonus speakers. Flat response.

But for causally watching content, its fine for me to use some bookshelf speakers or even a bluetooth speaker. Its not super important for watching content for me as long as its not total trash.

What are you doing step-LAN?

My advice is start slow and dont hurt yourself in the name of fitness. Its better to take a day off if your legs really hurt so that your body has time to heal rather than “work through the pain”.

And eat enough to fuel the new cardio. Doesnt do you much good if you arent giving your body enough to work with. If your trying to lose weight, slight calorie deficit of about 200 calories is typically recommended.

And listen to some music that pumps you up! Always made me love running. Good luck! You got this :)

Jellyfin was my go to as well. It was really nice to play with and finamp was as well. Once setup it was just as easy and nice to use as Spotify without all the ads and Spotify randomly playing songs after i finish a podcast episode.

I personally have had the best luck finding jobs on indeed. Its a popular job board for a reason but that doesnt mean that there arent a ton of postings from companies that arent actually looking for employees. Its super shitty of them but work with what ya got.

I avoid any job posting that has weird requirements like they want you to take a test or want you to add your resume through thier website instead. I dont reccomend wasting your time with that unless the job posting looks really worth it. Rarely they are. I get the most rejections from those.

What i recommend most is trying to get a job in the same field or company that a friend works at. Much easier to get hired if someone can vouch for you. Thats how i got my current job. Before that, i was stuck in security and constantly job hunting with no return on investment.

It will effect your health but having most “bad” foods in normal amounts every once in a while won’t really hurt you. Any effect would be minimal at worst so long as you dont have preexisting health conditions. If you already have high blood pressure or a heart condition, energy drinks are probably not a good idea.

If you dont need the drive to be fast and want best bang for your buck storage capacity, HDD is the way to go.

If you want speed and are ok with a higher price, SSD is best. Used enterprise HDD are usually a good value. Im in the US so not sure about where to purchase exactly.

Something to consider is if the drive you are storing the os and files on are the same, using am HDD will make it slower on start up.

I second this.

I started learning Google app script for work and while its not exactly traditional programming like most folks would do, i can now look at javascript and have a basic understanding of whats going on.

I learned a ot by doing. And with the help of ai, i was able to learn concepts, syntax, the best way to do this or that at least to a degree.

Just trying to make something is the best way. Make a tool to make your life easier. Like if you have a repetitive task that you dont want to do each time, make a script that does it for you.

Ah ok, thats pretty cool. I dont do much torrenting anymore cause my internet is not only limited but is kinda slow and unsteady.

Might check that out once im back in civilization with a decent connection. I miss gigabit speeds man.

Yea the real fun is always the set up when selfhosting. Then you look for the next project lol.

Im not familiar with gluetun, is that what you’re using to download tracks or something?

I personally really liked using jellyfin and finamp. Both were pretty great once i figured out how to set it up lol.

The issues i had were due to my lack of knowledge and trying to set things up to use it outside of my home network. Jellyfin itself was great as was finamp when i used them.

Lol prompts are important for sure. Me and my boss often talk about what you can do with chatgpt when we use it at work amd what kind of prompts we use.

Most models that I’ve played with are only about as good as what you put into it. If you ask it the right questions in the right way, you can get pretty good results.

GPT3.5 has worked well for me. I’ve also run AI on my pc locally using Ollama and lots of different models. Most do well with simple questions or requests.

Llama 3 instruct is what I’ve liked the most so far.