Great job, very interesting!
However I wonder: since you are targetting iOS, why only restrict yourself to generalist frameworks such as llama.cpp and LiteRT-LM?
MLX Swift looks like a better fit, and the model catalog on HF's MLX community is pretty huge and diverse.
Great job, very interesting! However I wonder: since you are targetting iOS, why only restrict yourself to generalist frameworks such as llama.cpp and LiteRT-LM? MLX Swift looks like a better fit, and the model catalog on HF's MLX community is pretty huge and diverse.
[dead]