AI also gives you the benefits of a middle manager. If everything works as intended you take the credit but if something breaks that’s not your fault, AI made the mistake. If they try to put the blame on you just say you have 6 agents working on 6 different domains all cross-reviewing their commits and you can’t be expected to review every single line of code yourself. Time to play corporate like a damned fiddle!
Oh absolutely, but I doubt anyone is paying the equivalent of a 5090 to get the performance of a 3060. Server GPU-s aren’t optimized for gaming.
Being in the self-hosted community I know people buy used enterprise servers to set up their own services, but consumers who buy enterprise servers probably make up less than 1% of all the consumers who buy hardware.
Not really. They’re not making consumer grade stuff, they’re making hardware for data centers so unless you’re planning on doing a DIY data center you’re not buying the hardware. Hard drives are likely an exception.
You’re more likely to see cheap VPS services than cheap secondhand hardware.
Well that article was a waste of space. Intel has already stepped into the GPU market with their ARC cards, so at the very least the article should contain a clarification on what the CEO meant.
And I see people shitting on the arc cards. The cards are not bad. Last time I checked the B580 had performance comparable to the 4060 for half the cost. The hardware is good, it’s simply meant for budget builds. And of course the drivers have been an issue, but drivers can be improved and last time I checked Intel is actually getting better with their drivers. It’s not perfect but we can’t expect perfect. Even the gold standard of drivers, Nvidia, has been slipping in the last year.
All is to say, I don’t understand the hate. Do we not want competition in the GPU space? Are we supposed to have Nvidia and AMD forever until AMD gives up because it becomes too expensive to compete with Nvidia? I’d like it to be someone else than Intel but as long as the price comes down I don’t care who brings it down.
And to be clear, if Intels new strategy is keeping the prices as they are I’m all for “fuck Intel”.
Unless you’re planning on buying the whole rack you’re not scooping up anything, except maybe the hard drives. The memory and GPUs are not consumer grade hardware. Some of the GPUs you technically could hook up to your PC, for example the Nvidia A6000, but its launch price was ~$4500 so even on the cheaper end you’re shelling out probably $3000 for a card that (out the box) is marginally better than the 4070ti. Most of the GPUs and pretty much all of the memory is not compatible with your standard consumer grade MoBos.
Setting up a local model was specifically about people who take privacy and security seriously because that often requires sacrificing convenience, which in this case would be having to build a suitable server and learning the necessary know-how of setting up your own local model. Casual consumers don’t really think about privacy so they’re going to go with the most convenient option, which is whatever service the major players will provide.
As for Dell keeping the NPUs I forgot they’re going to be bundled with processors.
I’m not that concerned with the hardware limitations. Nobody is going to run a full-blown LLM on their laptop, running one on a desktop would already require building a PC with AI in mind. What you’re going to see being used locally are going smaller models (something like 7B using INT8 or INT4). Factor in the efficiency of an NPU and you could get by with 16GB of memory (especially if the models are used in INT4) with little extra power draw and heat. The only hardware concern would be the technological advancement speed of NPUs, but just don’t be an early adopter and you’ll probably be fine.
But this is where Dells point comes in. Why should the consumer care? What benefits do consumers get by running a model locally? Outside of privacy and security reasons you’re simply going to get a better result by using one of the online AI services because you’d be using a proper model instead of the cheap one that runs with limited hardware. And even for the privacy and security minded people you can just build your own AI server (maybe not today but when hardware prices get back to normal) that you run from home and then expose that to your laptop or smartphone. For consumers to desire running a local model (actually locally and not in a selfhosting kind of way) there would have to be some problem that the local model solve that the over the internet solution can’t solve. So far such a problem doesn’t exist today and there doesn’t seem to be a suitable problem on the horizon either.
Dell is keeping their foot in the door by still implementing NPUs into their laptops, so if by some miracle some magical problem is found that AI solves they’re ready, but they realize that NPUs are not something they can actually use as a selling point because as it stands, NPUs solve no problems because there’s no benefit to running small models locally.
They’re trying to squeeze the last water out of the rock while hoping to dip out before everyone realizes everything has been squeezed out.
Yeah. It technically very impressive and and can have very impressive results if used properly. But all of the excellent uses and technical marvels get vastly overshadowed non-technical management going “what if you could have a chat with your toaster as it toasts your bread? Genius.” The people at the top have no fucking idea what they have and thus they have no idea how to use it which is why they throw everything at it to see what sticks.
I have to agree that killing online only games makes sense because they can’t be forced to run the server forever, not they can be forced to release the source code. But offline / solo / bots should keep working.
We are not in agreement. It doesn’t make sense even for online games.
The politicians statement is not what SKG is about. SKG is not trying to preserve every version of a game. It would be cool if that was also on the table, but that’s not the purpose of the initiative. SKG is concerned with keeping the game playable AFTER the publisher/developer has decided it’s not longer worth maintaining. At that point the online video game is no longer a dynamic service because it’s no longer updated nor maintained. And that means it absolutely could be viewed as a static product. The point she is making is completely irrelevant to the initiative and shouldn’t even be a point of discussion.
This has already been addressed by SKG. Nobody is demanding the source code. Developers have multiple ways to solve this and SKG deliberately leaves that part open so developers could choose whatever works best for them.
Whoever told you developers would have to release the source code is lying and is against the initiative.
Exactly. Just like the dotcom bubble websites and web services aren’t the scam, the promise of it being some magical solution to everything is the scam.
Bubble is build upon potential of the investment. It’s unlikely that AI is near its invested potential which means declining usage might actually be an indicator that the bubble is about to pop. A few big investors think the potential has been reached and pull out and then it cascades into a crash.
How much more specific do I need to be when I explicitly say “USB-C headphones”? What do you think USB-C stands for?
You could’ve done a single web search yo find that you can buy wired headphones that go straight into the USB-C port.No dongle required. But you’re too busy foaming from the mouth like a rabid dog to even understand what I said.
Why aren’t you complaining about the removal of a keyboard? Or the removal of SD card slots? Or the removal or the IR light? Or the notification light? or something else that used to be there but isn’t now. Why is the 3.5mm port so special it deserves constant complaining about almost A DECADE LATER? Why must you be these grumpy old men who can’t fucking move on with the times.
I don’t really care if the port is there or not, I’m just fed up with the constant whining about it. It’s gone, the ship has sailed. The majority are more than happy to use wireless headphones, 3.5mm is a niche in the mobile space. There are alternatives if you really like wired headphones. What makes 3.5mm such fucking hill to die on? Nothing. It’s just petty conservatism of people unwilling to move on with the times.
You know you’ve got not argument when you have to compare a $700 dollar phone to a $5 dongle for your argument to even make sense.
First of all, I seriously doubt any $700 phone without a 3.5mm port is going to have a decent DAC, because there’s no reason for it. In those phones the DAC is used primarily for phone calls. If those phones had a a 3.5mm port and they were flagship phones then maybe they would have higher quality DACs in them, but then they’d also cost more. And secondly, I wasn’t talking about some cheap $5 dongle, I specifically said quality headphones.
Then maybe don’t make examples of something I never talked about? I think I’ve been very clear that I’m talking about replacing 3.5mm headphones with a USB-C headphones. I wasn’t talking about replacing a 3.5mm in/out cable with some kind of a USB-C in, 3.5mm out cable. Such a cable would have to contain a DAC and if it’s going to contain a DAC you might as well buy a USB hub with a 3.5mm out port so you can continue using your 3.5mm in/out cable while you also charge your phone. See how that’s a completely different scenario with a completely different solution?
You have headphones on in your car, listening to music, while you’re driving? I hope you’ve checked your local laws because that is illegal in quite a few countries. It’s also a very niche example as most people would use the car stereo instead of headphones.
See this is why we need smart appliances, so AI could make you coffee.