LLM inference is GPU bound and VRAM bound. Given quantization however, 2x3090 or 4090 (48GB) is enough VRAM to load 65B quantized llama derivatives (30-40GB). With exllama you can get maybe 20-30 tok/s with dual 4090s on ~1200W. With an M2 Ultra maybe 10 tok/s on ~178W.
(I don't have these devices but have been researching LLM inference performance in the interest of buying a machine for them.)
Advantage goes to M2 Ultra if you ever might need more than 48GB VRAM. I think it's unlikely nvidia is going to release a significantly higher VRAM consumer card anytime soon, since that's what their A100s are for.
I'm guessing most people either don't bother with it (I haven't...) or write their own ad-hoc file integrity managers using checksum files and par2. I was about to try something, but decided to go look for existing work instead.
There's a proliferation of backup software, but this is the only file integrity solution I've come across. Surprising, since file integrity is the only way to know if what's being backed up is any good.[0]
I'm a senior CS student at Georgia Tech starting out with freelancing. Preferred technologies are go, java, dart, flutter, and linux shell scripting, but I pick up languages and platforms pretty quickly and have also done some programming in c/javascript/julia/perl6/python.
I'm willing to do pro-bono work for the right client if I can use it as a portfolio piece.
One thing that makes Anker stand out to me is that they pay attention to the unboxing experience, which I haven't seen from any other company in a non-premium market like cables and car docks.
My unboxing experience with Anker cables is always "oh they've sent me another pointless faux-suede pouch, I wonder how many tonnes of these have gone on landfill this year".
Ianal, but my sense is that as long as they keep trying to hold back the tide, they're eligible for trademark protection. Once they give up, there's nothing to stop Google Docs Photoshop mode, Microsoft Office Photoshop, or rflrob's awesome photoshop. Though there's nothing that says that vigorous enforcement needs to be mean—see, for example, Jack Daniels: https://brokenpianoforpresident.com/2012/07/19/jack-daniels-...
I love how they expect people to assert their trademark rights with the ® symbol. Unless this document is aimed at Adobe employees or contractors, that's inappropriate.
Yeah, the original cool pentagram diagram no longer works.
There's an eighth category to add which I've not researched yet: people with physical access to the device. Whether that's jealous spouses installing tracker malware or customs agents scrolling through your facebook.
This is pretty good as far as grand theories of the universe go, which in fine because we're talking philosophy, not science. However, I don't agree with life being an oppositional force to normal increasing entropy. It's probably more like eddies in a current, where life can only exist where free energy / negative entropy / information already exists and can be used.
You might be interested in a book I just added to my reading list: "What is life?" (Schrödinger, 1944) The wikipedia articles on it sound fascinating.
the funny thing is i have a series of "posts" on this subject and while trying to post on r/philosophy i got a ban warn on the reason it is not philosophy :D
You can't match that speed with nvme. Samsung 990 Pro only gets 7.3 GB/s sequential read.
edit: I stand corrected.