Nvidia shrinks LLM memory 20x without changing model weights

Nvidia's KV Cache Transform Coding (KVTC) compresses LLM key-value cache by 20x without model changes, cutting GPU memory costs and time-to-first-token by up to 8x for multi-turn AI applications.

OpenAI, Mistral AI release new hardware-efficient language models

OpenAI Group PBC and Mistral AI SAS today introduced new artificial intelligence models optimized for cost-sensitive use ...
Communications of the ACM

Measuring What Matters in Large Language Model Performance

As large language models (LLMs) gain momentum worldwide, there’s a growing need for reliable ways to measure their performance. Benchmarks that evaluate LLM outputs allow developers to track ...
InfoQ

Google Researchers Propose Bayesian Teaching Method for Large Language Models

Google Research has proposed a training method that teaches large language models to approximate Bayesian reasoning by ...
News-Medical.Net

Study reveals limitations of large language models in medical diagnostics

Artificial intelligence (AI) is rapidly transforming healthcare. AI systems can now detect diabetic eye disease from retinal photos and analyze CT images for signs of early-stage lung cancers and ...
The Conversation

Large language models: how the AI behind the likes of ChatGPT actually works

Mark Stevenson has previously received funding from Google. The arrival of AI systems called large language models (LLMs), like OpenAI’s ChatGPT chatbot, has been heralded as the start of a new ...

World's first Tibetan large language model unveiled in Lhasa

The world's first Tibetan large language model and its application, DeepZang, has been officially unveiled in Lhasa, ...
techtimes

Large Language Model Limitations: Why Generative AI Still Has a Long Way to Go, Researchers Say

As great as generative AI looks, researchers at Harvard, MIT, the University of Chicago, and Cornell concluded that LLMs are not as reliable as we believe. Even a big company like Nintendo did not ...
Forbes

Small Language Models – More Effective And Efficient For Enterprise AI

Forbes contributors publish independent expert analyses and insights. Exploring Cloud, AI, Big Data and all things Digital Transformation. Frontier models in the billions and trillions of parameters ...
The Manila Times

Personal AI’s Memory-Based Small Language Models Deliver Hyper-Personalized Experiences on Comcast’s AI Grid, Powered by NVIDIA

Memory-based Small Language Models deployed across virtualized, highly distributed telecommunications networks achieve ...
Futurism

Large Language Models Will Never Be Intelligent, Expert Says

Are tech companies on the verge of creating thinking machines with their tremendous AI models, as top executives claim they are? Not according to one expert. We humans tend to associate language with ...
Quanta Magazine

To Make Language Models Work Better, Researchers Sidestep Language

Language isn’t always necessary. While it certainly helps in getting across certain ideas, some neuroscientists have argued that many forms of human thought and reasoning don’t require the medium of ...