Blog

Essays and field notes on practical AI, machine-learning systems, research, and engineering.

2026

July 26, 2026 ML Systems 7 min read

How Kimi K3 Scales: MoE, KDA, and Attention Residuals

Kimi K3 combines a sparse mixture of experts, linear attention, and depth-wise routing. Here is what its architecture changes for AI teams.

Kimi K3Mixture of ExpertsLLM ArchitectureLong Context

July 13, 2026 Research 6 min read

Finding failing solar panels with a digital twin

A practical method for detecting solar-panel anomalies by calibrating a two-diode digital twin from voltage, current, temperature, and irradiance telemetry.

Digital TwinsAnomaly DetectionSolar Energy

Nothing matches — try a different term or category.