Best libraries for working with LLMs?

Question

Hi all,

I’d like to settle on 2-3 libraries for working with LLMs. I’ve done a little fine tuning on HuggingFace and completed one of the Deeplearning.ai courses on RLHF. I feel like I’m a bit all over the place, master of none essentially.

I’d like to pick 2-3 libraries that are the most useful for fine tuning, training, and making LLM powered web apps. My goal is to just master 2-3 of these libraries then move on, instead of jumping all over the place like I’m doing now.

Any recommendations?

Answer 1

Hope these articles/blogs will help you:

https://kenhuangus.medium.com/1-introduction-5134d4ad52b4#:~:text=spaCy%20is%20well%2Dsuited%20for,library%20for%20basic%20NLP%20tasks.

https://blog.finxter.com/top-5-llm-JUMP_LINK__&&__python__&&__JUMP_LINK-libraries/

https://github.com/tensorchord/Awesome-LLMOps

https://betterprogramming.pub/frameworks-for-serving-llms-60b7f7b23407?gi=859bbb0b8e40

https://levelup.gitconnected.com/8-awesome-libraries-to-train-large-language-models-ef4092836bb9?gi=30a48250d984

Answer 2

Thank you!