llamafile logo
Mozilla yakazivisa, kuburikidza ne blog post, iyo lkuburitswa kwecompiler, iyo ine as Chinangwa ndechekurerutsa mashandisirwo emitauro mikuru yakawanda. (LLM) pane chero desktop kana sevha.
Iyo itsva Mozilla purojekiti inonzi "llamafile", ndeye yakavhurwa sosi compiler iyo inogona kutora muchina wekudzidza modhi faira muGGUF fomati uye woishandura kuita faira rinogoneka iro rinogona kumhanya pamatanhatu akasiyana masisitimu anoshanda pa AMD64 uye ARM64 Hardware.
Uye havandiregi kunyepa, asi ivo Mhando dzemitauro mikuru (LLMs) dzekushandisa munharaunda dzinowanzo kugoverwa mumaseti akasiyana, iyo uremu hweimwe neimwe yemafaira aya kazhinji magigabytes akati wandei. Aya mafaera haashandiswe zvakananga ega, izvo zvinokanganisa kugovera kwayo uye kuuraya zvichienzaniswa nemamwe marudzi esoftware. Pamusoro pezvo, imwe modhi inogona kunge yakagadziridzwa uye kugadziridzwa, zvichitungamira kune akasiyana mhedzisiro kana uchishandisa shanduro dzakasiyana.
Mozilla akaziva izvi, akatora danho pamusoro penyaya iyi uye kugadzirisa dambudziko iri, Boka rekuvandudza reMozilla rakatangisa "llamafile", iyo, sezvataurwa pamusoro apa, inyanzvi inoshandura iyo LLM kuita bhinari faira imwe chete inokwanisa kushanda pane matanhatu akasiyana masisitimu anoshanda (macOS, Windows, Linux, FreeBSD, OpenBSD uye NetBSD) pasina kudiwa kwekuwedzera kuisirwa. Iyi mhinduro inofambisa zvakanyanya kugovera uye kuitwa kweLLM, uku ichisimbisa kuenderana uye kudhindwa kweimwe vhezheni yeLLM nekufamba kwenguva.
Nezve iyo lamafile compiler, inotaurwa izvozvo yakagadzirwa nekubatanidza mapurojekiti maviri: llama.cpp (yakavhurika sosi LLM chatbot chimiro) uye Cosmopolitan Libc. (yakavhurika sosi purojekiti inobvumidza iwe kuunganidza uye kumhanyisa C zvirongwa pamapuratifomu mazhinji uye zvivakwa). Panguva yekuitwa, Mozilla inotaura kuti yakatarisana nematambudziko anonakidza uye yaifanira kuwedzera zvakanyanya chiyero cheCosmopolitan kuzadzisa zvinangwa zvakataurwa.
Chinangwa chedu ndechekuita kuti mamodheru akavhurika emitauro akwanise kuwanikwa kune vese vanogadzira uye vashandisi vekupedzisira. Tiri kuita izvi nekubatanidza llama.cpp neCosmopolitan Libc kuita hurongwa hunoputsira kuoma kwese kweLLM kuita faira rimwechete rinoitwa (rinonzi "llamafile") rinomhanya munharaunda pamakomputa mazhinji, pasina kuiswa.
Izvo zvinotaurwa kuti Chimwe chezvinangwa zvikuru zvellamafile kwaive kukwanisa kumhanya pane akawanda CPU microarchitectures. Apa ndipo panouya llama.cpp kuzotendera maIntel masystem kuti ashandise maficha emazuva ano ma processor pasina kupa rutsigiro kumakomputa ekare, nepo AMD64 neARM64 izvi zvakabatanidzwa uchishandisa shell script inotanga iyo yakakodzera vhezheni. Iyo faira fomati inoenderana neWIN32 uye akawanda UNIX shells.
Rimwe dambudziko rakagadziriswa inyaya yehuremu hwemafaira eLLM., iyo inogona kubatanidzwa mullamafile, nekuda kwerutsigiro rwePKZIP muGGML raibhurari. Izvi zvinobvumira uremu husina kuomeswa kuti humepurwe zvakananga kundangariro, sefaira rekuzvibvisa, uye zvakare rinobvumira huremu hwakagoverwa pamhepo kuti hugadziriswe neshanduro inowirirana yesoftware inonzi.cpp, kuve nechokwadi chekuti maitiro akacherechedzwa pakutanga anogona kudhindwa nekusingaperi. .
Ngatiti iwe une seti yezviyereso zveLLM muchimiro che4 GB faira (muiyo inowanzo shandiswa GGUF fomati). Nellamafile unogona kushandura iyo 4GB faira kuita bhinari inomhanya pane matanhatu anoshanda masisitimu pasina kuisirwa.
Chekupedzisira, zvinofanirwa kutaurwa izvo Mozilla yakatanga chirongwa ichi «llamafile» yakanyorwa muC/C++ uye yakagoverwa pasi perezinesi reApache, izvo zvinoreva kushomeka kwezvirambidzo maererano nenzira dzekushandisa uye kuwanikwa kwezvinhu, zvichienzaniswa nemarezinesi akadai seGPL.
Kana ari kufarira kudzidza zvakawanda nezvazvo iyo purojekiti kana kutoda kuishandisa, unogona kubvunza ruzivo uye/kana iro rinokurumidza gwara rekushandisa pa chinotevera chinongedzo.