A first LLM app
So, I don’t know if you already know, but I’m a JAVAPRO author now. I was thinking about my first article and decided to talk about building an app using GenAI.
Yes, I know there are many articles about that already, so my idea is to integrate with Ollama, using Quarkus and the lang4chain extension. What’s the big deal? You can follow my article and run everything on your local machine without any cost!
My demo is to create an assistant to help me organize my meetings. It’s like an intelligent calendar or something similar. The first feature is just to add meetings.
Ok, so here are my first impressions while trying to build this tool:
I can say it’s a new paradigm: You need to create prompts to talk with the LLM, and this is not an easy task at the beginning.
You need to specify everything: If I don’t set rules, the LLM creates overlapping meetings, schedules on weekends, and makes every error you can imagine.
LLM does not calculate anything. This was a huge discovery for me. Now I know why I asked to create a meeting on July 22nd (year 2024) and it returned on Tuesday - it should be Monday.
Quarkus helps a lot! Extensions and DevServices are really amazing; you just need to focus on your main problem.
As you can imagine, I’m still creating the tool and the article. =D
Hope I can finish both next week!
And you? Doing amazing things with LLM? Let’s talk about it.
Happy coding!