Sida’s Status Report for 3/7

tested the newly released Qwen3.5 models, including 0.8B, 2B, 4B and 9B versions(all Q4_K_M). All tested with 8K context length(double of our design requirement. Still need to do more detailed tests on whether the models can accurately perform the tasks, but based on online reviews, they will definitely be better than the Qwen3 models.
- 9B: read 217, write 10.84
- 4B: read 341, write 14.88
- 2B: read 839.2, write 30.99
- 0.8B: read 1149, write 41.58
Result: the Qwen 3.5 4B model is decently slower than the Qwen 3 one, which violates our design requirement. Qwen 3.5 2B, on the other hand, is faster than the Qwen3 4B. We can set both as backups while developing further.