Show HN: I stopped using an LLM gateway and put rate-limits/fallback in-process

 (github.com)

3 points | by Buddo 3 hours ago

1 comments

  • Buddo 3 hours ago
    If any of you have feedback or any feature requests for VernLLM, feel free to ask them.