Sunday, June 14, 2026

Priorities

• Create a live demo of t5-small ML model.

Work Log

Inference Service - Live Demo - T5-Small

Situation

I already created an example of an inference service using best practices to deploy an ML project using KServe. However, it is only a REST API and I want to have a platform for everyone to interact with the ML model. Therefore, I planned to create a page within my website about it.

Task

Build a simple webpage so anyone can use the ML model at ilyasahsan.xyz/t5-small.

Action

I created a web app using a Docker image and deployed it on the same server as the ML model.

Result

Anyone can now visit ilyasahsan.xyz/t5-small and interact with the ML model directly from their browser.

Blockers

N/A

Carry-overs

N/A

Reflection

N/A