Classification of deep learning methods in Natrural language ?

Question

There are several main methods
#Neural_Network (RNN LsTM,CNN)
#Transformer (Liké Bert)
#Word embedding (word2vec,Glove)
#Pre-trained models (Bert,gpt ) that correct ?
Or transformer and pre-traind models are types of neural network ??

Answer 1

Izmiir Sorry, I don't know too much about that maybe Justice D Shah 🎯⏳️ or other members will help you

Answer 2

Transformer model

https://blogs.nvidia.com/blog/2022/03/25/what-is-a-transformer-model/#:~:text=A%20transformer%20model%20is%20a,the%20words%20in%20this%20sentence.&text=If%20you%20want%20to%20ride,in%20AI%2C%20grab%20a%20transformer.

Pre-trained model

https://www.baeldung.com/cs/neural-network-pre-training#:~:text=Pre%2Dtrained%20neural%20network%20models,%2C%20feature%20extraction%2C%20and%20classification.

Hope it's helpful to you

Answer 3

Aw man, I'm sorry Sakshi (Less Active) and Izmiir, this is completely out of my field of knowledge! I have yet to do anything related to AI or ML, but hopefully sometime this year!

Answer 4

Justice no problem sis

Answer 5

Yes, that is correct. Transformers and pre-trained models are types of neural network architectures in the context of NLP. Transformers, exemplified by models like BERT, utilize self-attention mechanisms to capture long-range dependencies in text. Pre-trained models, such as BERT and GPT, leverage neural network architectures like transformers to learn contextualized representations of text, enabling them to perform well on various downstream NLP tasks with minimal fine-tuning.

Answer 6

Hey Izmiir, sorry I am not into Deep learning, ML or Neural Networks.

Based upon your question, I have found small help for you that you might want to go through.

The links of "towards data science" includes code examples as well as graph. Just for your further reference sharing links below, in hope it might come handy for your project.

https://www.deeplearning.ai/resources/natural-language-processing/

https://towardsdatascience.com/deep-learning-techniques-for-text-classification-78d9dc40bf7c

https://towardsdatascience.com/natural-language-processing-classification-using-deep-learning-and-word2vec-50cbadd3bd6a

Answer 7

D Shah 🎯⏳️ Thank you very much, sis. I will read them and try to find an answer to my question. Thank you for your help

Answer 8

Justice nevermind I need to make sure that this information is correct in order to put it in my final project at the university :(

Answer 9

Jared Ramon Elizan Sakshi (Less Active) Can i say that has 2 methods neural network contain types like (transformer and pre-traind models) and word embedding ??
Also Can i classify RNN LSTM in neural network and Bert ?? Word2vec ? I want a graph that explain classification of that ??