UMarcus Holland-Moritz (unjiniyela we-software ye-Facebook) wazise ngokushicilelwa izinhlobo zokuqala ze-DwarFS, uhlelo lwefayela lokufunda kuphela olwenzelwe ukukhulisa ukucindezelwa nokunciphisa idatha engafuneki.
Lolu hlelo lwefayela isebenzisa indlela ye-FUSE bese isebenza esikhaleni somsebenzisi, ikhodi ibhalwe ku-C ++ futhi isatshalaliswa ngaphansi kwelayisense le-GPLv3.
Mayelana ne-DwarFS
I-DwarFS ifana nezinhlelo zamafayela afana ne-SquashFS, ama-cramfs, ne-CromFS kwimisebenzi yakho, futhi ingasetshenziselwa ukudala izithombe ezibukhoma futhi wehlise usayizi wamafayela ngenani elikhulu lezimpinda nedatha eyimpinda (ngokwesibonelo, ukugcinwa kwezithombe zemishini ebonakalayo noma amaqoqo ezinhlobo ezahlukahlukene zezinhlelo).
Ngokuya ngejubane ukufinyelela idatha, I-DwarFS icishe ibe sezingeni elifanayo ne-SquashFS, kepha izikhathi eziningana ngaphambi kwale FS maqondana nokusebenza kokucindezela kanye nejubane lokucabanga.
Iphrojekthi yathuthukiswa ukuxazulula inkinga yokwandisa isitoreji ngezinhlobo ezahlukahlukene zikaPerl (umbhali we-DwarFS ubamba iqhaza ekugcineni ifayili le-CPAN).
Ekuqaleni, sizamile ukusebenzisa amaCromfs ukucindezela, Kepha kuthathe isikhathi eside ukwakha isithombe nokuzinza kushiye kungathandeki. I-squashFS isebenze kahle futhi yahumusha izithombe ngokushesha okukhulu, kepha izinga lokucindezela belingamukeleki.
Iningi lekhodi ye-DwarFS yabhalwa ngo-2013. Kulo nyaka, umbhali uthole isikhathi sokuletha le khodi emphakathini nokubhala imibhalo. I-DwarFS isebenzisa imitapo yolwazi ye-Boost ne-Folly.
Umtapo wolwazi wegatsha le-Facebook owomisiwe osetshenzisiwe usetshenziselwa ukugcina imethadatha. Okunye ukuncika kufaka i-FUSE3 kanye ne-lz4, zstd, kanye nemitapo yolwazi ye-liblzma compression.
I-DwarFS idlule i-SquashFS ngokwesilinganiso sokucindezela izikhathi eziyi-8, nangokuya ngejubane lokudala isithombe amahlandla ama-4 lapho kwakhiwa isithombe esifaka ukufakwa okuhlukile kwe-Perl okungu-1139, okunezinhlobo ezingama-284 zikaPerl.
I-DwarFS ukwazile ukunciphisa ibhentshimakhi kusuka ku-47GB kuye ku-582MB (1,1% wosayizi woqobo), ngenkathi umphumela wosayizi we-SquashFS wawungu-4,7 GB. I-SquashFS ithathe imizuzu engama-69 ukudala isithombe, kuyilapho i-DwarFS iqedele umsebenzi ngemizuzu engu-15.
Zombili lezi zinhlelo zefayela zisebenzise i-ZSTD algorithm ukucindezela. Kusetshenziswa i-LZMA, usayizi wesithombe se-DwarFS wehliswe ngomunye u-18% (approx. 479MB), kepha isivinini sokufinyelela kuleso sithombe sehliswe kakhulu.
Ukuhlolwa kwedatha enezimpinda ezimbalwa kubonise inzuzo hhayi njengokubalulekile, kepha kusamangaza, kusuka ku-DwarFS. Isibonelo, usayizi wesithombe wempande ye-Paspberry Pi OS yi-298MB ye-DwarFS ne-364MB ye-SquashFS, kanti isikhathi sokwakha kwaba yiminithi elingu-1 iminithi engama-36 neminithi eli-1 imizuzwana engama-54, ngokulandelana.
Of Izici ezibalulekile ze-DwarFS okulandelayo kugqame:
- Ikhono lamandla lisusa ukungasebenzi ngokuqoqa idatha efanayo (ngaphandle kwemingcele yefayela) kusetshenziswa imisebenzi ye-LSH hash ukukhomba izinto ezifanayo.
- Ukuhlaziywa kokuhlukaniswa kwesistimu yefayela ukunciphisa usayizi wohlelo lwefayela olungacindezelwe futhi kwandise ukusebenza kahle kokusetshenziswa kwesilondolozi se-processor ngenxa yokuthi idatha eningi edingekayo iyangena.
- Ukuqaliswa kwemicu eminingi yokusetshenziswa kwe-imaging nemojula ye-FUSE, engasebenzisa zonke izinhlamvu ze-CPU ezitholakalayo lapho isebenza.
- Ukusekelwa kokuhlola okwazi ukuxhuma abalawuli beLua abangasetshenziswa ukuhlunga nokuhlunga okuqukethwe.
- Imodi yokufaka kabusha ekuvumela ukuthi ushintshe i-compression algorithm yesithombe esivele sidaliwe (ngokwesibonelo, ungaphinda ubeke kabusha usebenzisa i-LZMA noma i-LZ4 esikhundleni se-ZSTD).
- Izithombe zenziwa kusetshenziswa okusetshenziswayo kwe-mkdwarfs futhi zafakwa kusetshenziswa okusetshenziswayo okuncane.
Ekugcineni, uma ufuna ukwazi kabanzi ngalolu hlelo lwefayela noma unentshisekelo yokukwazi ukuhlanganisa ikhodi yalo yomthombo, ungaxhumana nolwazi noma uthole ikhodi yomthombo Kulesi sixhumanisi esilandelayo.