How to use Cactus: An inference engine for running LLMs on smartphones. Two lines to try it on Mac, and the mechanism for handing off to the cloud

Have you ever thought about wanting to run an LLM solely on your smartphone?It runs in places without connectivity. Data ...