data zvidhinha muvambi uye muchengeti weApache Spark, yakaunza hunyanzvi hwakawanda hweiyo Unified Analytics Platform pamusangano wayo weData + AI Summit 2021 mushandisi, kusanganisira inosimbisa kuvhurwa kweiyo yakavhurwa sosi chirongwa chinonzi "Delta Kugovana" iyo inopa vhura protocol yekuchengetedzwa kwedata kwakachengeteka pakati pemasangano munguva chaiyo, zvisinei nepuratifomu panogara data.
Delta Kugovana inosanganisirwa mukati meiyo Delta Lake chirongwa, tafura yekuchengetera tafura yakaburitswa nekambani kuvhura sosi mukupera kwa2019.Puratifomu yatove yakawana rutsigiro kubva paseti yakakura yevanopa dhata, kusanganisira Nasdaq, Amazon Web Services, Microsoft, Google, uye Tableau Software.
Kugovana dhata kwave kwakakosha muhupfumi hwazvino sezvo makambani ari kutsvaga kuchinjanisa dhata zvakachengeteka nevatengi vavo, vanotengesa, uye vavanoshanda navo Semuenzaniso, mutengesi angangoda kushambadzira data rekutengesa revatengesi vavo munguva chaiyo, kana mutengesi angangoda kugovera zvinyorwa munguva chaiyo. Asi kusvikira zvino, kuchinjana kwedata kwave kushoma nekuti mhinduro dzekuchinjana dzakasungirirwa kune mumwe mupi. Izvi zvinogadzira kukakavara kune vese vanopa data uye vatengi, avo vanowanzo mhanyisa mapuratifomu akasiyana.
Nhasi, isu takaparura nyowani yakavhurwa sosi purojekiti iyo inorerutsa kugovana pakati pemasangano: Delta Kugovana, yakavhurika protocol yekuchengetedzeka-chaiko-nguva kuchinjana kwemahombe data maseti, zvichigonesa yakachengeteka kuchinjana kwedata pakati pezvigadzirwa kekutanga. Isu tiri kuvandudza Delta Kugovana nevatinoshanda navo kubva pasirese inotungamira software uye data vanopa.
data zvidhinha yakati inotarisira kugadzirisa kusashanda kwemaitiro kazhinji zvinoda manyoro yemasangano kuchinjana data nevatengi, vadyidzani nevatengesi. Nhoroondo, zvigadzirwa zvekugovana dhata zvakasungirirwa kumutengesi mumwe chete kana chigadzirwa chekushambadzira, zvichitadzisa kubatana pakati pemasangano anoshandisa mapuratifomu akasiyana.
"Nzira huru makambani akagovana nevamwe ndeyekufamba nenzira inorema kana kushandisa hurongwa huripo hwakaomarara hunofanirwa kushandiswa nemunhu wese," akadaro Arsalan Tavakoli (pikicha), mubatsiri pamwe nemutevedzeri wemutungamiri wenyika muDatabricks.
Kuunza pamwechete akawanda masosi ezvinyorwa zvakare basa. "Iwe haugone kungopa munhu wese mukana," akadaro. “Unoda zvekushandisa, kuongorora uye kudzora vhezheni. Iko hakuna nzira yekuzviita nhasi.
Delta Kugovana inoganhurira mutengesi kutsamira uye inogonesa yakafararira uye yakasarudzika seti yemakesi ekushandisa kupfuura zvazvaimboita, kambani yakadaro. Unity Catalog iyo inogona kushandiswa muSQL, zvinoonekwa zvekuongorora maturusi, uye mitauro yekuronga yakadai sePython neRelta Kugovana inoitawo kuti masangano agovane maseteti epo aripo pamwero mukuru muApache Parquet neDelta Lake Mafomati munguva chaiyo pasina iyo anodikanwa. emakopi.
Delta Kugovana ndiyo yechishanu huru yakavhurwa sosi chirongwa chakatangwa naDatabricks, mushure meApache Spark, Delta Lake, MLflow yekudzidza kwemuchina, uye Koalas, iyo inoshandisa iyo pandas DataFrame application program interface paSpark. Iyo purojekiti iri kupihwa kuLinux Foundation.
Mukuwedzera Databricks zvakare yakasimbisa «Kubatana Catalog« yakamisikidzwa dhata katalog uye chii chiri inoenderana ne "Delta Kugovana". Unity Catalog ine interface nyowani iyo inofambisa kuwanikwa uye manejimendi eese dhatabhesi rekambani, ine maonero akazara eiyo data mumakore uye makatalogu aripo, zvirokwazvo muLakehouse chikuva cheDatabricks.
Kubatana Catalog inopa imwechete yekuchengetedza modhi, yakavakirwa pa ANSI SQL, kugadzirisa kudzora uye kuenzanisa hutongi hwegore. Icho chishandiso zvakare inogona kuverengerwa mumatare e data aripo yeAlation, Collibra, Privacera uye Immuta, kuitira kuti mutengi anokwanisa kuvaka pane iripo uye nekumisikidza yepakati neyemberi-chiratidzo hutongi modhi pasina yakakwira mari yekutama.
Finalmente kana iwe uchifarira kuziva zvakawanda nezvazvo, unogona kutarisa iyo ruzivo mune inotevera chinongedzo.