novitalabs/pegaflow v0.23.3

v0.23.3

Repository: novitalabs/pegaflow

Tag: v0.23.3

Published: 2026-07-10T06:11:29Z

Prerelease: no

Release notes:

Highlights

• Added PegaNixlPullConnector, which keeps the vLLM NIXL control plane while using PegaFlow RDMA v1 for pull-mode KV reads. The H200 P/D benchmark completed 64/64 requests at 9.04 req/s with 232.21 ms mean TTFT.
• Added a MetaServer flush barrier and an embeddable P2P transfer service for applications that host PegaEngine in-process. The validated H200 P/D run discovered and transferred 33/33 blocks (74.2 MiB) over RDMA with token-identical greedy output.

Reliability and transfer behavior

• RDMA-prefetched blocks are now registered with MetaServer only when they remain resident after local cache admission.
• RDMA prefetch now uses block-local staging and preserves an already staged prefix when a later allocation fails. In the measured H200 pressure A/B, reclaim amplification fell from 2.56x to 2.07x (-19.5%) and request throughput changed from 3.16 to 3.49 req/s. The tradeoff was higher mean TTFT (4.52 s to 5.07 s), higher mean TPOT (30.0 ms to 45.3 ms), and lower mean logged RDMA throughput (28.9 GiB/s to 18.0 GiB/s).
• Hardened the RC backend with overlap-safe memory registration, predecessor-based MR lookup, shorter global lock scope, and error returns for inconsistent session state. Real-link A/B results on an 8x400G IB node stayed within 3% noise; this release does not claim a measured throughput win from that refactor.

Release build and tooling

• Release-profile A/B measurements improved the 32K query/prefetch lease benchmark from 3.7152 ms to 3.5507 ms (-4.43%) and the 61-layer 32K save-submit benchmark from 482.18 ms to 443.73 ms (-7.98%). Thin LTO and one codegen unit are now enabled for release artifacts. Clean build time increased from 27.05 s to 48.03 s (+77.6%), while the benchmark binary decreased from 12.03 MB to 8.60 MB (-28.5%).
• Updated local development, CI, and release builds to Rust 1.97.0.
• Added PEGAFLOW_IB_DEVICE support to the P2P RDMA integration test.

Full Changelog: https://github.com/novitalabs/pegaflow/compare/v0.23.2...v0.23.3