It is very nice to see the possibility of self deployment. Does anyone have expe... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		pama on Feb 26, 2024 \| parent \| context \| favorite \| on: Mistral Large It is very nice to see the possibility of self deployment. Does anyone have experience with self deployment of such a large model in a company setting?

thenaturalist on Feb 26, 2024 [–]

No reference to self-deployable Docker images for large as of now.

Only 7B and mixtrail exist.

https://docs.mistral.ai/self-deployment/vllm/

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact