pGPU is a simulator for a minimal GPU-like device, entirely in Python, with its own mini-ISA, DRAM, Scratch, Register-File and SM models.
The target problem is to implement a kernel in pGPU's software framework to compute the attention map between two matrices:
Watch this space!