Member-only storyKevin Berlemont, PhDFollowTowards Data Science--ShareThe past months have witnessed a drastic reduction in the parameters size of the various generative models, such as the new Mistral AI’s Model that just came out. The reduction in size opens the door to getting your own personal assistant AI enabled that can be tied to you through your local computer. This type of local inference is very tempting to ensure confidential computation on your data. With all these new developments, deploying and managing an AI workload looks different than it did 6 months ago and is constantly evolving. How to use one of these models to play around with it or even to host it on your company’s infrastructure?I think that before using any kind of API model that will be hosted by someone else, it is a good thing to experiment with different type of models to get a sense of how these different model families perform. So let’s assume you are not using an API model right away. How do you pull down a model and use it?For this you have two type of models: proprietary and open access models. The proprietary models will be OpenAI, Cohere and so on and they all have their own API. The open access ones can be fully open or half-restricted models due to their license such as commercial, non-commercial, research purposes only …The best place to find these models is on HuggingFace. On the models page, you can see that hey have over 350,000 models available across a very diverse set of tasks. So you do have a few to choose from!Something to have in mind is that not all of these models are being/will be used. Some of them could just be somebody trying something out during an afternoon and then never updated it again. One of they key metrics to find the most useful models is to look at how many people downloaded the model and liked it. For example, you filter on the type of task you are looking for, such as Text Classification, and from there you can see which are the most downloaded and the trending models filtered by…----Towards Data ScienceSharing Data Science concepts I have in mind. Senior Data Scientist. Dog dad. https://medium.com/@kevin.berlemont/membershipKevin Berlemont, PhDinTowards AI--Damian GilinTowards Data Science--24Khouloud El AlamiinTowards Data Science--18Kevin Berlemont, PhDinLevel Up Coding--Damian GilinTowards Data Science--24Haifeng Li--Cory Doctorow--52Jim the AI WhispererinThe Generator--72George “Ace” AcevedoinILLUMINATION--176agent007GPT--HelpStatusWritersBlogCareersPrivacyTermsAboutText to speechTeams