The ASIC-GPU Standoff
My friend Liberty recently highlighted an interesting paper from Google that goes through the evolution of TPUs. The objection to domain-specific silicon which might sound quite persuasive is the one about obsolescence: a chip may take two to three years to design, fabricate, and deploy, and AI moves fast