Now, let's talk a bit about GenAI.
Chances are that at some day, you
will be responsible for hosting a GenAI system.
So what are the GenAI components?
Start with the large language model.
That is considered the brain of the GenAI solution.
And it typically has been trained
on large amounts of data, and it will
be multiple gigabytes in size.
It requires a lot of GPU RAM in order to be used.
Training LLMs from scratch requires
huge amounts of resources.
And for that reason, most companies that run an LLM
don't train the LLMs themselves.
They use a standard LLM, which next they
will be fine tuning only.
The AI client provides a prompt that
is used to get information out of the AI system.
That is where the user is interfacing
and is asking the question.
In a process that is referred to as inference.
The AI agent is a goal-driven system on top of the LLM
that can perform actions for you.
It can perceive, it can reason, and it can act.
So it can make bookings for you, for instance.
Or it can make changes to configuration
or whatever you have configured your agent to do.
Think about questions like, analyze
which servers are running out of disk space
and send me a report.
And agents turn Gen-AI systems into real problem solvers.