Running a Language Model on a $35 FPGA
I recently took on a project to implement a language model on an FPGA. In simple terms, a Field Programmable Gate Array (FPGA) is an IC that can be reconfigured to implement hardware circuit designs written in a Hardware Description Language (HDL) such as SystemVerilog. They are particularly interesting because