• 0 Posts
  • 23 Comments
Joined 1 year ago
cake
Cake day: April 23rd, 2023

help-circle



  • Unfortunately I can’t even test Llama 3.1 in Alpaca because it refuses to download, showing some error message with the important bits cut off.

    That said, the Alpaca download interface seems much more robust, allowing me to select a model and then select any version of it for download, not just apparently picking whatever version it thinks I should use. That’s an improvement for sure. On GPT4All I basically have to download the model manually if I want one that’s not the default, and when I do that there’s a decent chance it doesn’t run on GPU.

    However, GPT4All allows me to plainly see how I can edit the system prompt and many other parameters the model is run with, and even configure multiple sets of parameters for the same model. That allows me to effectively pre-configure a model in much more creative ways, such as programming it to be a specific character with a specific background and mindset. I can get the Mistral model from earlier to act like anything from a very curt and emotionally neutral virtual intelligence named Jarvis to a grumpy fantasy monster whose behavior is transcribed by a narrator. GPT4All can even present an API endpoint to localhost for other programs to use.

    Alpaca seems to have some degree of model customization, but I can’t tell how well it compares, probably because I’m not familiar with using ollama and I don’t feel like tinkering with it since it doesn’t want to use my GPU. The one thing I can see that’s better in it is the use of multiple models at the same time; right now GPT4All will unload one model before it loads another.


  • I have a fairly substantial 16gb AMD GPU, and when I load in Llama 3.1 8B Instruct 128k (Q4_0), it gives me about 12 tokens per second. That’s reasonably fast enough for me, but only 50% faster than CPU (which I test by loading mlabonne’s abliterated Q4_K_M version, which runs on CPU in GPT4All, though I have no idea if that’s actually meant to be comparable in performance).

    Then I load in Nous Hermes 2 Mistral 7B DPO (also Q4_0) and it blazes through at 50+ tokens per second. So I don’t really know what’s going on there. Seems like performance varies a lot from model to model, but I don’t know enough to speculate why. I can’t even try Gemma2 models, GPT4All just crashes with them. I should probably test Alpaca to see if these perform any different there…



  • PCIe gen 5 is for the PCIe slots and NVMe storage slots, but they’re backwards compatible; you can put a gen 3 component in a gen 5 slot and it will work at gen 3 speeds. Similarly, if you put a gen 5 component in a gen 4 slot, it will be limited to gen 4 speeds. Right now there’s very little appreciable difference between gen 4 and gen 5 unless you’re spending a lot of money on the component (GPU/storage). Another thing to note is that Gen 5 requires that both the CPU and motherboard support it; a CPU with gen 4 support in a gen 5 motherboard will limit all the slots to gen 4 speeds.

    RAM is a totally different standard that must be matched exactly for what the motherboard has; if it’s a DDR5 motherboard then you have to use DDR5 RAM or it won’t even fit in the slots. You can get a PCIe gen 5 motherboard and just use gen 4 SSDs or GPUs, that’s perfectly fine and leaves you room to upgrade later.


  • Seems mostly fine to me, I game all the time on Linux (Bazzite gang 🤘) with a 3900X + 7900GRE, haven’t had any significant issues aside from needing to make sure clock speeds were configured correctly on the GPU. Two ram sticks is the way to go with these systems as sometimes they don’t support 4 sticks at full speed.

    You’re right that GPU passthrough is definitely more for tinkering or advanced users with very specific needs (usually professionals who need Windows/Nvidia and choose to run it in a VM rather than dual-boot), with a budget to match. For a gamer couple, having fully separate systems is going to be much less hassle and more resilient against failure.

    The one thing I would recommend changing is the power supply, it’s unironically the most important component in the computer because if it fails it can kill everything else, and the System Power 10 is known enough for being low-quality that discussions of that come up in web searches. Poor quality power supplies can damage your hardware and otherwise cause weird, intermittent issues even if everything seems to work fine most of the time, and will fail and shut off the computer when a good power supply would have just kept on chugging. Seasonic and Corsair are considered the best brands and have 10 year warranties - they’re more expensive, but they’re worth it. You want 80+ Gold or better these days, this is a buy once, cry once component.

    If you don’t have a UPS, I would also recommend getting one at some point, either one big shared unit (if they’ll be close together) or two individual units. Having backup power will allow you to shut down the computers gracefully during a power outage, and prevents the worst-case scenario where the power goes out while the computer is installing updates and it turns into a brick.



  • The ELI5 for Fedora’s atomic desktops is that if Windows had an Atomic Desktop version, Program Files and most of the Windows folder would be read only, and each program you installed yourself would go into its own folder in your user directory. That’s the basic idea. It’s harder to screw up an Atomic system as long as you stick to containerized app formats like flatpak/appimage whenever possible. It makes it easier for everyone to diagnose problems, and easier for users to roll back if an update has problems. Even if you were to install it right now, you could use one simple command to “roll back” to any image from the last three months.

    The benefit of Bazzite is you have all of the above, plus a lot of gaming-related stuff preinstalled which, if you were to install them yourself in a normal Fedora environment, you’d likely have to spend a lot of time just learning how they’re supposed to be configured, how they interact, which versions have problems, and how to troubleshoot problems when an update to one app breaks a prerequisite for something else; eventually you end up in config hell instead of actually using your computer. With Bazzite, the image maintainers are the ones in config hell - they work out the kinks, app versioning, communicate with upstream to fix issues, all that, so your system should be in the most functional state that a Linux system can be, so you only have to think about using your apps.

    tl;dr

    • Atomic Desktops are more resilient to randomly breaking from updates or user error, and are easier to revert to a prior state if problems do arise
    • Bazzite is a custom Atomic image with lots of gaming stuff preinstalled and preconfigured to work properly out of the box
    • If you’re a gamer and wanting to try out Linux, Bazzite is going to be the least painful way to get your feet wet.
    • Immutable distros are excellent for daily driving. I daily drive one myself!




  • As a fellow virgin, if you actually do want to not be a virgin, but see yourself as having “failed” then think deeply on what the reason is.

    First of all, if you’ve “failed” then what did you actually try that failed? Do you constantly take steps to meet new people and find friends, male and female, whether in hobbies or online or anywhere? If not, why not? If you have, and therefore have lots of friends you speak with regularly, are you recruiting them to help you find a romantic partner? Meeting lots of people, making friends, and then asking those friends for help is a great way to accomplish almost anything. It’s much easier early in life, but it’s never impossible.

    If you have taken steps to meet lots of people (and I mean a lot of people), but none of them or their single-and-looking friends wanted to date you, then did they give reasons? What is it about you that they don’t like? Are you taking care of yourself? Maintaining good personal hygiene? Dressing well? Do your peers find you unpleasant to be around? Are you simply boring? If you meet lots of people and all of them reject you, there’s likely something you’re not doing that you need to be doing. Work on yourself to be someone that people want to be around.

    If any of what I’ve said here is relevant to you, even if it’s unpleasant to think about, it’s very important to be consciously aware of it so that you can accept that your current reality is one you’ve chosen, consciously or unconsciously… and that you can choose differently.

    I’m one year younger than you, also virgin guy who would maybe like to have a partner, but through introspection and years of learning shit on the internet, I’m aware of the likely reasons I haven’t gotten one yet - I just don’t meet people, and when I do, even when we get along, I tend to fall out of touch immediately. I believe I likely have undiagnosed and unmedicated ADHD along with some steep but situational social anxiety, both of which I know have and will continue to keep me from forming and maintaining many social connections that I otherwise could have, which I could be leveraging to find people to date.

    So, I recognize what my stumbling blocks are, and that if I decide I really do want to find love and get laid, I have to deal with those stumbling blocks. For me, that will involve speaking to a head doctor and learning more precisely how my brain works and what strategies I can use to overcome those blocks. It’s not about fixing me, it’s about being able to be more me. But until I do that, I accept that my current status of “virgin, but maybe wants to change that” is there because I have, in some way, chosen up to this point not to change it.

    If you figure out what your stumbling blocks are, or even if you haven’t, tell a close and trustworthy friend or family member about where you’re at, where you want to be, and how you feel about it. They might have options, or be able to help you take whatever steps you need to be where you want to be. If you feel like you just can’t make yourself do the thing, get someone else to give you a kick in the ass.



  • Remember that a dance party is a party - most people are there to have fun. I think the main thing to avoid, if you can manage it, is being so caught up inside your own head that you aren’t looking at the people around you. Keep your back straight, your head high, your eyes off the floor. Basically, avoid the posture of a shrinking violet and you’ll feel less like one. Even if you don’t feel confident, maintaining a pose that looks confident will keep some of your fear away, and it will passively invite others to interact with you, which boosts your confidence a little more with each person you talk to.

    Even if you spend the entire party standing around and watching other people dance, as long as you are actually watching the event, and mentally present for what’s going on, you will gain something from the experience. Just remember that standing around and not talking to anyone is as much a choice as going up to someone and asking for a dance. Neither choice is wrong, but you have to live with what happens - or doesn’t - based on what you choose.

    All that said, you can do this! We believe in you!


  • Onihikage@beehaw.orgtoLinux@lemmy.mlCrapped my system
    link
    fedilink
    English
    arrow-up
    2
    ·
    5 months ago

    Atomic means the core OS packages are in an immutable container such that none of its individual components can be updated separately; instead the entire container is replaced with a newer version when the system is updated. This makes it much less likely for something to break during normal use, and easier to rollback updates if something does happen to break. The ideal use case is a containerized environment where each app you use is installed in its own container, like Docker, or is otherwise self-contained such as flatpak installers, and doesn’t rely on any of the system’s packages.