wuphysics87@lemmy.ml to Privacy@lemmy.ml · 1 month agoCan you trust locally run LLMs?message-squaremessage-square22fedilinkarrow-up173arrow-down16file-text
arrow-up167arrow-down1message-squareCan you trust locally run LLMs?wuphysics87@lemmy.ml to Privacy@lemmy.ml · 1 month agomessage-square22fedilinkfile-text
I’ve been play around with ollama. Given you download the model, can you trust it isn’t sending telemetry?
minus-squarestink@lemmygrad.mllinkfedilinkEnglisharrow-up1·1 month agoIt’s nice but it’s hard to load unsupported models sadly. Really wish you could easily sideload but it’s nice unless you have a niche usecase.
minus-squareEmberleaf@lemmy.mllinkfedilinkarrow-up2·1 month agoI’m not sure what you mean by ‘hard to load’. You find the model you want, you download it, then load it up to chat. What’s the issue you’re having?
minus-squarestink@lemmygrad.mllinkfedilinkEnglisharrow-up1·1 month agoAt parents for the week but IIRC I had some sort of incompatible extension with a model I downloaded off huggingface
It’s nice but it’s hard to load unsupported models sadly. Really wish you could easily sideload but it’s nice unless you have a niche usecase.
I’m not sure what you mean by ‘hard to load’. You find the model you want, you download it, then load it up to chat. What’s the issue you’re having?
At parents for the week but IIRC I had some sort of incompatible extension with a model I downloaded off huggingface