Burst Buffers, chichava chimwe chezvinhu zvitsva zveReiser5

Mwedzi yakati wandei yapfuura takataura pano pa blog nezve reiser5, iyo inzira yefaira inochengetwa naEdward Shishkin uye ndeipi inomiririra yekubatanidza hunyanzvi mukuyera kwakaenzana, inoitwa kwete padanho rekuvharira, asi kuburikidza nesystem faira.

Reiser5 ishanduro yakadzokororwa yeReiserFS faira sisitimu, mune rutsigiro rwezvikamu zvinowoneka zvine musoro zvinoitwa, ichibvumidza kugoverwa kwakaringana kwedata pane vhoriyamu ine musoro.

Zvino, munhau dzichangoburwa, Eduard Shishkin akazivisa zvinhu zvitsva zviri kugadzirwa sechikamu cheiyo Reiser5 chirongwa.

Yezvazvino zvigadzirwa, Izvo zvakacherechedzwa kuti mushandisi anogona kuwedzera diki yepamusoro-yekuita block block (semuenzaniso, NVRAM), inonzi proxy disk, kune vhoriyamu yakakura zvine musoro inoumbwa nemadhisiki emabhajeti akaderera. Izvi zvinopa pfungwa yekuti iro rese vhoriyamu inoumbwa neakaenzana epamusoro-mashandiro ekushandisa seiyo 'proxy disk'.

Maitiro akaitwa aive akavakirwa pane zvakapusa kucherechedza kuti, mukuita, kunyorera kudiski hakuitwe nguva dzose uye munyonga I / O mutoro Iine chimiro chemuromo. Mukati mepakati pe "spikes" dzakadai, panogara paine mukana wekurasa dhata kubva kune proxy disk nekunyora pasi rese data (kana chingori chikamu charo) pane "inononoka" main kuchengetedza kumashure. Naizvozvo, proxy unit inogara yakagadzirira kugamuchira chidimbu che data.

Pakutanga, iyi nzira (inozivikanwa seBurst Buffers) yakatanga mumunda weakakwira-kuita komputa (HPC). Asi zvakazoitika kuti zvaidawo kunyorera zvakajairika, kunyanya izvo zvinoisa zvinoda kwakakwirira pane kutendeka kwedata (izvi zvinowanzo kuve rakasiyana dhatabhesi). Shanduko idzi dzinoitwa neatomu nechero kunyorera mune chero faira, zvinoti:

• Kutanga faira nyowani inogadzirwa iine iyo yakagadziridzwa data;
• Ipapo iyi faira nyowani yakanyorerwa diski uchishandisa fsync (2);
• Mushure meizvozvo, iyo nyowani faira inozotumidzwazve kune yekare, iyo inosunungura iyo yega mabhuroko anogara neyakare data.

Aya ese matanho aya, kune imwe nhanho kana imwe, anokonzera kuderera kukuru mukuita pane chero faira system. Mamiriro acho anovandudzika kana iyo nyowani faira ikatanga kunyorerwa kune yakatsaurwa yepamusoro-inoshanda chishandiso, izvo chaizvo zvinoitika muBurst Buffers faira system.

MuReiser5, zvakarongerwa kusarudzika kutumira kwete chete zvitsva zvinofungas kubva kufaira kuenda kune proxy disk, asiwo mapeji ese akasviba mune zvese. Zvakare, kwete chete mapeji ane data, asiwo metadata, iyo yakanyorwa mumatanho (2) uye (3).

Proxy disks inotsigirwa mumamiriro ebasa renguva dzose nemavhoriyamu ane musoro Reiser5 yakaziviswa pakutanga kwegore. Mune mamwe mazwi, iyo aggregate system "proxy disk - yekutanga kuchengetedza" ivhu rakajairika zvine musoro, nemusiyano chete wekuti proxy disk inotungamira pamusoro pezvimwe zvikamu zvevhoriyamu iri mudhisiki rekutaura mutemo.

Kuwedzera proxy disk kune zvine musoro vhoriyamu hakufambidzwe nechero data rebalancing, uye kubviswa kwayo kunoitika nenzira imwecheteyo sekubvisa yakajairwa diski. Zvese proxy disk mashandiro ari maatomu.

Mushure mekuwedzera proxy disk, huwandu hwakazara hwehuwandu hwehuwandu hunowedzera nekukwanisa kweiyo disk.

Iyo proxy disk inofanira kucheneswa nguva nenguva, ndiko kuti, dump data kubva pairi kuenda kuchitoro chikuru. Mushure mekusvika kuReiser5 beta kugadzikana, zvakarongerwa kugadzira yekuchenesa otomatiki (ichaitwa neakasarudzika yakakosha tambo). Panguva ino, basa rekuchenesa rinosara nemushandisi.

Kana pasina nzvimbo yemahara pane proxy disk, data rese rinonyorwa roga kuti rirambe rakachengetedzwa. Panguva imwecheteyo, iko kuita kwese kweFS kwakaderedzwa nekutadza (nekuda kwekuramba uchikumbira nzira yekusimbisa yezvinhu zvese zviripo).

mabviro: https://marc.info