Europe != UK
Europe != UK
Alexa powered by Amazon Titan sounds even less useful than it currently is. Titan is by far the worst commercial LLM I've used.
There's a bit in a Silicon Valley where they give admin access to an Adderall-fueled teenage coder who destroys the entire system, and I feel like that's about to play out on a massive scale
This still makes sense canonically given this version of Lorca was from the evil timeline.
Every car is a Cybertruck in the mirror universe
I agree with your last point wholeheartedly! My point is that Deepseek is a vindication of LLMs as a technology, not a threat or a sign of failure.
Proportional*
Yes, it is unfair given the advances are promotional to the investment. Deepseek makes that investment more rational, not less.
Fair enough. Iβd say given the advances in AI over the last 3 years anything short of ASI is apparently going to be defined as βnot enough progressβ!
βLittle to no progressβ!!
An extremely significant development in AI efficiency = overhyped?
That doesn't make sense to me.
I can see a market for this for some exasperated CISO who fields so many dumb cybersecurity questions that he says FINE WEβRE STORING ALL OUR DATA ON THE MOON
For a large swathe of the population "OpenAI" and "AI" are the same, unfortunately.
T630
llama-cpp-python
For us they are a useful local test proxy for our production cloud environment, which uses L4s. They still have their uses.
Yep. This is not the build for tokens per second. Our use case for this is batch processing - it's not fast enough for real-time chat on larger models.
For us, it was buying a very old Dell PowerEdge server for Β£100 and putting 4 Tesla P40s in it.
Very slow, but it has 96GB VRAM and runs 70B models comfortably.