Free LLM API will appear in the AI Tinkerers newsletter
AI Tinkerers selected Free LLM API for its Community Spotlights newsletter after our Dublin demonstration. The issue is due on 10 August.
Our founder Tashfeen demonstrated Free LLM API at AI Tinkerers Dublin. We announced the event before the session.
The room was full. The five-minute demonstration explained how the router selects a model for each request.
How the model selection works
The router uses Thompson sampling. Each model draws a number from a distribution based on its results. The model with the highest draw gets the request.
Older results gradually have less influence. This helps the router use models that work well while it continues to test others.
The newsletter invitation
On Friday, we received confirmation that Free LLM API will appear in the AI Tinkerers Community Spotlights newsletter.
The issue is due on 10 August. Its audience includes tens of thousands of people who attended AI Tinkerers events around the world.
The organizers gave three reasons for the selection. They highlighted the router's use of Thompson sampling, its free source code, and positive feedback from developers.
Conversations after the demonstration
At the science fair after the talks, people asked questions and connected the router to their own prototypes.
These conversations helped us understand how people want to use the project.
Thanks to the AI Tinkerers Dublin organizers and to Toast for hosting the event.
Free LLM API is available at freellmapi.co. If you attend a future Dublin event, come and talk with us.
Thank you for your time.
More posts
