Know a great AI tool or AI news source? Submit it to AiByts

AI Inference

38 stories

Stories

  • ScaleFlux bets its controller chips can break AI’s memory bottleneck

    AI data centers have spent heavily on faster accelerators, denser racks and liquid cooling to keep that hardware running. The data pipeline that feeds those processors has not kept up, and expensive compute ends up waiting on memory and storage.

    SiliconANGLE3 min read
  • Microsoft bets on memory that moves to the workload as AI supply tightens

    Memory has become the scarcest resource in the AI data center, and hyperscalers are rethinking how they hand it out. Composable memory, which pools capacity beyond individual servers and assigns it to workloads on demand, is emerging as one of the most practical answers to that squeeze.

    SiliconANGLE5 min read
  • Agentic AI puts the CPU back in play as Dell touts 13-to-1 server consolidation

    Server consolidation is getting a second look as agentic AI drives a surge in demand for general-purpose compute. Graphics processing units dominate the AI infrastructure conversation, but the agents running on those systems lean heavily on central processing units, and data centers are short on…

    SiliconANGLE4 min read
  • Vast Data bets stitched-together AI pipelines can’t keep sensitive data in sync

    Data sovereignty is becoming an architectural problem as enterprises push artificial intelligence inference toward their most sensitive information. Pipelines assembled from separate tools struggle to keep embeddings, permissions and source data aligned, leaving many valuable data sets out of AI’s…

    SiliconANGLE4 min read
  • ScaleFlux bets smarter SSD controllers can break the AI memory bottleneck

    AI factories run on graphics processing units that cost a fortune and work at blistering speed, yet those chips increasingly sit idle waiting for data. As the bottleneck moves from compute to memory and storage, NAND flash is being asked to do far more than hold files.

    SiliconANGLE3 min read
  • Copper’s days are numbered inside AI racks as Cisco bets on optics

    AI infrastructure networking is approaching a physical turning point as the copper links that tie GPUs together inside a rack strain under ever-faster signaling speeds. The move to light-based interconnects could redraw the boundaries of what counts as a single AI system. Cisco Systems Inc.

    SiliconANGLE3 min read
  • What to expect during the AI Data Pipeline Forum: Join theCUBE Oct. 13

    The artificial intelligence infrastructure race is no longer just about building faster chips. AI infrastructure bottlenecks are shifting attention to a bigger challenge: keeping those chips supplied with data, connected through high-speed networks and operating within increasingly demanding power…

    SiliconANGLE5 min read
  • CoreWeave makes the case for an open, full-stack AI cloud

    The full-stack AI cloud market is about more than access to graphics processing units: it also encompasses the tools needed to improve models and agents in production. Providers are seeking to distinguish themselves through the tooling, partners and expertise they combine with hardware.

    SiliconANGLE4 min read
  • Liquid AI builds personal AI around device-level context

    On-device personal AI requires models and agent software that can operate within fixed hardware limits. Developers also need ways to keep those systems improving after deployment. Model builders are rethinking architectures designed around elastic cloud capacity.

    SiliconANGLE3 min read
  • Willow taps CoreWeave to simplify AI model training

    AI model training can leave startups managing infrastructure alongside the products they are trying to build. Willow Care Inc., the company behind AI dictation app Willow Voice, chose CoreWeave Inc. for its forward-deployed support rather than compute alone.

    SiliconANGLE3 min read
  • Caterpillar and CoreWeave shorten the learning loop for physical AI

    Demand for new data centers, power plants and highways is fueling a construction boom, even as the industry wrestles with declining productivity and a shortage of skilled machine operators. Physical AI, which lets machines perceive their surroundings and act on them, is emerging as one answer.

    SiliconANGLE4 min read
  • CoreWeave targets GPU utilization in continuous AI post-training

    GPU utilization during post-training depends partly on how efficiently infrastructure moves data and loads updated models. As enterprises continually refine AI agents, reducing delays between training rounds can help keep that process moving.

    SiliconANGLE3 min read
  • MasterClass bets AI teaching agents can broaden access to tutoring

    AI teaching agents could make personalized instruction available to more learners by reducing the cost and staffing demands of one-to-one tutoring. MasterClass is exploring that potential through a system designed to adapt to how each student learns.

    SiliconANGLE4 min read

Showing 18 of 38 stories

Load more stories
AiByts Weekly Brief

Get the top AI news and tools straight to your inbox every week.

Weekly · AI news

Join 15,000+ AI enthusiasts