This action will delete this post on this instance and on all federated instances, and it cannot be undone. Are you certain you want to delete this post?
Todd Sundsted postedFeb 19, 2024
i installed ollama. 20 minutes later i had llama2 running locally. almost all of that time was downloading the pre-trained model. performance and quality are better than i expected! (technical reference point: i'm on a macbook m3 max with 48gb of memory but that does not seem to be in any way required—i'm going to try some older hardware later.)
i'm still trying to sort out which llms are really open source (architecture, source code, training data, weights) and which are not.