Serial Parameter Machineemufpga research notebook

Lab notebook · reproducible entries

The failures are part of the result.

Experiment 01

Can batching reuse one parameter stream?

Hypothesis: traffic stays flat while useful applications rise.
YES
batch        1     8     32    128
bytes read ─────────────────────
useful work ████████████████████▶

Measured: Ps equals batch size; streamed and resident outputs agree bit-for-bit.

method + raw results →
Experiment 02

Can scalar CPU compute keep up with cached storage?

Hypothesis: storage becomes the bottleneck at a measured batch.
NO
page cache ━━━━━━━━━━━━━━━━━━━━━━━→scalar CPU ━→≈196× gap

The tested engine stayed compute-bound. This gives purpose-built arithmetic a concrete job; it does not prove FPGA speed.

reproduce with just bench →
Experiment 03

Does serial MoE preserve a real model result?

YES, WITH TOLERANCE

All 24 streamed MoE layers preserved top-1, retained 9/10 top logits, and stayed below the 0.002 absolute-error gate.

full validation →
Experiment 04

Does asynchronous buffering automatically help?

MIXED

Seven-run cases ranged from −5.5% to +11.7%; cache-bypass proxies gained 2–5%. Correct plumbing, no universal speed claim.

distributions + caveats →
Next: consolidate the evidence →