Infini-AI-Lab

Popular repositories Loading

1. hermit hermit Public

   A framework for continual learning and recursive self-improvement through harness adapter evolution.

   Python 436 35

2. Sequoia Sequoia Public

   scalable and robust tree-based speculative decoding algorithm

   Python 376 37

3. TriForce TriForce Public

   [COLM 2024] TriForce: Lossless Acceleration of Long Sequence Generation with Hierarchical Speculative Decoding

   Python 280 21

4. MagicPIG MagicPIG Public

   [ICLR2025 Spotlight] MagicPIG: LSH Sampling for Efficient LLM Generation

   Python 256 21

5. MagicDec MagicDec Public

   [ICLR2025] Breaking Throughput-Latency Trade-off for Long Sequences with Speculative Decoding

   Python 162 14

6. MonarchRT MonarchRT Public

   Python 146 13