Question: Feasibility of using more modern small language models #4

Hi I saw the reddit blog post on claudish and thought this is a very interesting thing. I was thinking if using a newer model like LFM2.5-230M or LFM2.5-350M might help to drastically improve the model's capabilities? I understand that changing models would require recompilation of the .paw file. I also saw some things about Cactus' runtime being made for edge and browser use, not sure if its is a promising alternative to what is used now. Also I would like to know more about the compilation process on the server as I dont think the source is published? It would help with experimentation greatly. Im also thinking about the possibility to use this as part of a RAG? What do you think? Thank you, just wanted to share some thoughts I had on this.