Basic Overview of LLMs
Introduction Language Model is a type of AI used in NLP. It is a probablity distribution over sequence of words. Given a sequence of n words, it assigns probablity to the whole sequence. Language models are trained to predict likelihood of a sequence of words occuring in a given context. These can be used for various tasks like text generation, machine translation, data analysis etc. It is one example of Generative AI. Some examples of LLMs are chatgpt and bard. Generative AI Generative AI generates new data based on trained dataset. Eg: Train with data about music → Input prompt about music → Generates new music AI hierarchy (Click on image to enlarge) Large Language Models How keyboard suggestions work? How search suggestions work? It all depends on how much we or other people who use similar set of words, right? This is the goal of Language Modeling, assigning probablity to every sentence. Calculating frequency by how many other people have used. But this doesnt all...
