Thoughts on using an AMD Alveo V80 FPGA PCI card as a poor man’s Taalas HC1 (LLM-burned-onto-a-chip).

The author explores using an AMD Alveo V80 FPGA card for LLM inference, aiming to approximate the performance of a dedicated Taalas HC1 chip. After consulting Gemini Pro, potential speeds of 1,400-3,200 tk/s were estimated, and the author seeks community input on this speculative approach.