Generative and Agentic AI

O IMD Business School, em Lausanne na Suíça, através do Centro de Pesquisas em Transformação Digital, publicou esta semana, o relatório atualizado das ferramentas GenAI categorizados e com a indicação (linha pontilhada) de qual é a ferramenta ou serviço de IA que possue melhor qualidade naquela categoria (dentro da metodologia de avaliação deles, claro). Serve como um bom guia, dentro da diversidade e variedade que temos. Um ótimo indicativo como guia.

Esta é uma colaboração do colega Fernando José (***@gmail.com)

Killer Robots
- NETFLIX - 
2023

https://revistapesquisa.fapesp.br/n%C3%BAmeros-em-revis%C3%A3o/

Build a Large Language Model (From Scratch)
https://www.manning.com/books/build-a-large-language-model-from-scratch
Acesado em 24 de abril de 2024

As illustrated in Figure 1.3, the first step in creating an LLM is to train it in on a large corpus of text data, sometimes referred to as raw text. Here, "raw" refers to the fact that this data is just regular text without any labeling information[1]. (Filtering may be applied, such as removing formatting characters or documents in unknown languages.)

​

This first training stage of an LLM is also known as pretraining, creating an initial pretrained LLM, often called a base or foundation model. A typical example of such a model is the GPT-3 model (the precursor of the original model offered in ChatGPT). This model is capable of text completion, that is, finishing a half-written sentence provided by a user. It also has limited few-shot capabilities, which means it can learn to perform new tasks based on only a few examples instead of needing extensive training data. This is further illustrated in the next section, Using transformers for different tasks.

After obtaining a pretrained LLM from training on large text datasets, where the LLM is trained to predict the next word in the text, we can further train the LLM on labeled data, also known as finetuning.

The two most popular categories of finetuning LLMs include instruction-finetuning and finetuning for classification tasks. In instruction-finetuning, the labeled dataset consists of instruction and answer pairs, such as a query to translate a text accompanied by the correctly translated text. In classification finetuning, the labeled dataset consists of texts and associated class labels, for example, emails associated with spam and non-spam labels.

In this book, we will cover both code implementations for pretraining and finetuning LLM, and we will delve deeper into the specifics of instruction-finetuning and finetuning for classification later in this book after pretraining a base LLM.