Bitget App
Trade smarter
Buy cryptoMarketsTradeFuturesEarnSquareMore
Tensormesh secures $4.5 million to boost AI server efficiency for greater inference capacity

Tensormesh secures $4.5 million to boost AI server efficiency for greater inference capacity

Bitget-RWA2025/10/23 16:33
By:Bitget-RWA

As the demand for AI infrastructure skyrockets, organizations are under increasing pressure to maximize the inference output from their available GPUs. For those with specialized knowledge in certain methods, this environment presents an excellent opportunity to secure investment.

This is one of the main reasons behind the emergence of Tensormesh, which has just come out of stealth mode after raising $4.5 million in seed capital. The round was headed by Laude Ventures, with additional backing from angel investor and database innovator Michael Franklin.

Tensormesh intends to use these funds to develop a commercial offering based on the open-source LMCache tool, which was created and is maintained by co-founder Yihua Cheng. When implemented effectively, LMCache can cut inference expenses by up to a factor of ten—a capability that has made it popular in open-source projects and attracted collaborations with major players like Google and Nvidia. Now, Tensormesh aims to transform its academic achievements into a sustainable business.

At the core of this technology is the key-value cache (KV cache), a memory architecture that streamlines the processing of complex inputs by summarizing them into key values. In most conventional systems, the KV cache is discarded after each query, but Tensormesh CEO Juchen Jiang believes this practice leads to significant inefficiency.

“It’s comparable to a brilliant analyst who reviews all the information but forgets everything after answering each question,” explains Tensormesh co-founder Junchen Jiang.

Rather than deleting the cache, Tensormesh’s approach preserves it, making it available for reuse when the model encounters a similar task in a future query. Since GPU memory is a limited resource, this often involves distributing data across multiple storage solutions, but the payoff is a substantial boost in inference capacity without increasing server demands.

This improvement is especially impactful for chat-based applications, where models must repeatedly access an expanding conversation history. Agentic systems face a similar challenge, as their logs of actions and objectives continually grow.

While, in principle, AI firms could implement these changes themselves, the technical hurdles make it a formidable undertaking. Given the Tensormesh team’s expertise and the complexity involved, the company is confident there will be strong interest in a ready-made solution.

“Storing the KV cache in secondary storage and reusing it efficiently without degrading system performance is a tough technical challenge,” Jiang notes. “We’ve observed teams hiring dozens of engineers and spending several months to build such a system. Alternatively, they can leverage our product and achieve the same results much more efficiently.”

0

Disclaimer: The content of this article solely reflects the author's opinion and does not represent the platform in any capacity. This article is not intended to serve as a reference for making investment decisions.

PoolX: Earn new token airdrops
Lock your assets and earn 10%+ APR
Lock now!

You may also like

AI Grabs Headlines, Yet Gold Industry's Productivity Fuels Worth

- Two Gen Z entrepreneurs rejected Elon Musk's funding to develop a brain-inspired AI outperforming OpenAI and Anthropic models. - QGold Resources initiates economic assessment for its Oregon gold project with 1.543M oz reserves, signaling strategic expansion. - Galactic Gold appoints mining veteran Manley Guarducci to enhance operational efficiency amid industry consolidation. - Alamos Gold and B2Gold demonstrate resilience through record cash flow and production growth despite geopolitical risks. - Gold

Bitget-RWA2025/11/28 11:34
AI Grabs Headlines, Yet Gold Industry's Productivity Fuels Worth

Bitcoin News Update: As Major Crypto Firms Target Affluent Investors, Authorities Increase Scrutiny

- Binance launches "Prestige" to target high-net-worth clients, competing with Morgan Stanley and Fidelity through tailored crypto services. - KuCoin secures MiCA license in Austria, enabling EEA operations and emphasizing compliance with global regulatory standards. - Binance faces lawsuit alleging $50M+ in Hamas-related transactions, highlighting crypto's regulatory challenges amid expanded AML measures in South Korea. - Houdini Pay introduces privacy tools for freelancers, addressing wallet transparency

Bitget-RWA2025/11/28 11:34

XRP News Today: Institutional ETFs May Exhaust XRP Reserves Earlier Than Expected

- XRP's institutional ETFs (e.g., Franklin Templeton's XRPZ) drive rapid supply depletion risks as inflows outpace expectations. - Analyst Zach Rector models potential $168 price targets if XRP ETF inflows mirror Bitcoin's $62B 2024–2025 surge pattern. - ETFs enhance XRP liquidity for SMEs and fintechs but expose risks from whale manipulation and unclear Asian regulations. - Market analysts warn XRP's limited 60.25B circulating supply faces accelerated institutional demand pressures amid growing ETF adopti

Bitget-RWA2025/11/28 11:34
XRP News Today: Institutional ETFs May Exhaust XRP Reserves Earlier Than Expected

CME's Twofold Mission: Emergency Response and Advancing Cryptocurrency Innovation

- CME Group's November 2025 data center outage disrupted global trading, highlighting infrastructure vulnerabilities and prompting redundancy calls. - CME launched XRP and Solana spot futures on December 15, 2025, addressing surging institutional demand for altcoin exposure beyond Bitcoin and Ethereum . - Crypto derivatives trading hit record volumes, with 794,903 contracts traded on November 21, 2025, as year-to-date volume grew 132% compared to 2024. - CME plans 24/7 crypto trading in early 2026 but rema

Bitget-RWA2025/11/28 11:34
CME's Twofold Mission: Emergency Response and Advancing Cryptocurrency Innovation