Alloy Compute Splits AI Models Across GPUs And FPGAs For Faster Replies
Alloy Compute says it has built an AI inference system that splits language model work between AMD graphics chips and programmable accelerators to cut response times. Alloy Compute Splits Inf
A
AnonymousCryptoCompass newsroom
July 31, 2026
2 min read
NEWS
CryptoCompass editorial visual for bitcoin coverage.
Alloy Compute says it has built an AI inference system that splits language model work between AMD graphics chips and programmable accelerators to cut response times.
Alloy Compute Splits Inference Workloads
The company described the design on Jul. 31 as a disaggregated architecture, one that sends each phase of a model's execution to the processor best suited for it. Most inference systems run every stage on a single chip type. AMD graphics processors take prompt prefill and attention, while FPGA accelerators handle token decoding and mixture-of-experts layers.
Alloy Compute has not published benchmark results and said it is still integrating the system while measuring latency, throughput, energy use and traffic between the two chips. Customer evaluation programs have not opened.
Founder and Chief Executive Nour de Vos said prefill, attention and token generation make different demands on hardware, so running a whole model on one architecture wastes capacity. The company said it is prepared to guarantee first-token responses under 200 milliseconds, though only for deployments that stay inside set limits on models, input length and concurrency. Early work covers quantized Qwen models.
De Vos came to AI infrastructure from large-scale cryptocurrency mining, where profits hinged on keeping machines busy and power bills low. He has said that same system-level thinking, treating chips, memory, networking and software as one unit, shaped this design.
The Shiba Inu price stood at $0.00000385 at around 9:40 pm CET on Tuesday evening, according to CoinGecko. That is down 0.4 percent on the previous day, 12.5 percent on the week and 21.5 perc
BitcoinWorld Media Deutsche Bank and Ant Digital Technologies Release White Paper on Agentic Payments in Wholesale Finance New White Paper Sets Out Roadmap and Safeguards for Integrating Agen
BitcoinWorld Media Formation Securities Notifies SEC of Intent to Operate First Tokenized Securities Venue on Solana Venue combines self-custody and around-the-clock trading with the same vot