top of page
LATEST TECH ARTICLES
The Journey to Automatically Measure LLM Performance on Smartphones – Building the On-Device LLM Tester
"You want to put AI on a smartphone?" — The Beginning of a Reckless Challenge The story of how TecAce's AI Supervision Team built the On-Device LLM Tester "Um… I'd like to automatically measure LLM performance on a smartphone." A brief silence fell over the meeting room. Our team was developing our own on-device AI chatbot. The problem was that every time we swapped models, a tester had to physically hold the phone, send prompts one by one, and time everything by hand. That p
Gemma 3n vs Gemma 4: A Real-World Benchmark Guide on the Galaxy S25 Ultra
Click the image to view the report. Every time Google ships a new generation of the Gemma series, the question we ask first is simple: how much faster does it actually run on real hardware? To answer that directly, TecAce ran a head-to-head benchmark between Gemma 3n and Gemma 4 on the Samsung Galaxy S25 Ultra under identical conditions. We tested four model configurations using the llama.cpp CPU inference engine: the previous-generation Gemma 3n E2B Q8_0 as our baseline, a
SECURE YOUR BUSINESS TODAY
bottom of page
