Amapulatifomu womthombo ovulekile we-4 wedatha enkulu

Idatha enkulu igama elisetshenziselwa ukuchaza ukuqoqwa kwemininingwane emikhulu futhi lokho kukhula kakhulu ngokuhamba kwesikhathi.

Idatha inkulu kakhulu futhi iyinkimbinkimbi kunanoma yimaphi amathuluzi wendabuko wokuphathwa kwedatha ungazigcina noma uzicubungule kahle.

Kepha kufanele sikuqonde ukuthi wonke umuntu idatha engagcinwa, ifinyelelwe futhi icutshungulwe ngefomethi engaguquki ibizwa ngokuthi 'idatha ehlelekile'.

Que ziphethwe esikalini esikhulu, lapho izixazululo kumele zenziwe ezikwazi ukuphatha, ukugcina nokuhlaziya idatha enkulu ngesikhathi esifushane

Lapho ubheka izibalo eziphathwa ngezinga elikhulu, umuntu angaqonda kalula ukuthi kungani igama 'i-Big Data' linikezwa futhi ucabange izinselelo zokugcina nokucubungula.

Kungakho namuhla sizofunda ngamanye amathuluzi wemithombo evulekile athandwayo angasetshenziswa ukwakha ipulatifomu yokuhlaziya idatha.

I-Apache Hadoop

I-Apache Hadoop iyi ipulatifomu yomthombo ovulekile ocubungula amasethi wedatha amakhulu kakhulu endaweni esatshalalisiwe.

Leli thuluzi kusekelwe kwisitoreji, amandla wokubala, futhi ikakhulukazi kuma-hardware ayisisekelo aphansi.

I-Apache Hadoop iyi yakhelwe ukukala kalula kusuka kumaseva ambalwa kuya ezinkulungwaneni.

Kukusiza ukuthi ucubungule idatha egcinwe endaweni ekucushweni okujwayelekile kokufana.

Enye yezinzuzo zeHadoop ukuthi iphatha ukwehluleka ezingeni lesoftware. I-Apache Hadoop inikeza uhlaka lwesendlalelo sohlelo lwefayela, isendlalelo sokuphathwa kweqoqo, kanye nesendlalelo sokucubungula.

Kushiya inketho yokuthi amanye amaphrojekthi nezinhlaka zingene futhi zisebenze ngokubambisana neHadoop Ecosystem futhi zithuthukise uhlaka lwazo nganoma yiziphi izingqimba ezitholakala ohlelweni.

Islastiki

I-Elasticsearch iyi injini egcwele yokusesha ne-analytics engine. Kuyindlela isatshalaliswa kakhulu futhi isatshalaliswe, yakhelwe ngqo ukusebenza kahle futhi ngokushesha ngezinhlelo ezinkulu zedatha, lapho elinye lamacala alo asetshenziswa kakhulu ukuhlaziywa kwelogi.

Iyakwazi ukusesha okuthuthukile nokuyinkimbinkimbi futhi kusondele ukucutshungulwa kwesikhathi sangempela kokuhlaziywa okuthuthukile nobuhlakani bokusebenza.

Islastiki ibhalwe eJava futhi isuselwa ku-Apache Lucene, I-Elasticsearch isuselwa kudokhumenti ye-JSON enesakhiwo esingena-schema, esenza kube lula futhi kube lula ukwamukela.

Ingenye yezinjini zokusesha zebanga lebhizinisi ezihola phambili. Ungabhala iklayenti lakho nganoma yiluphi ulimi lohlelo; I-Elasticsearch isebenza ngokusemthethweni neJava, .NET, PHP, Python, Perl, njll.

I-MongoDB

UMongoDB unjalo i-database ye-NoSQL ngokuya ngemodeli yedatha yedokhumenti. Ku-MongoDB yonke into iyiqoqo noma idokhumenti.

Ukuqonda amatemu we-MongoDB, iqoqo elinye igama elisho itafula, kuyilapho idokodo ligama elihlukile lemigqa.

I-MongoDB ngumthombo ovulekile, oqondiswe kudokhumenti, i-database yesikhulumi esinqamulelayo. Kubhalwe ikakhulukazi ku-C ++.

Futhi i-database ehamba phambili ye-NoSQL enikela ngokusebenza okuphezulu, ukutholakala okuphezulu, nokuqina kalula.

I-MongoDB isebenzisa amadokhumenti afana ne-JSON nge-schema futhi inikezela ngokusekelwa okuhle kombuzo. Eminye yemisebenzi yayo eyinhloko ifaka ukufaka inkomba, ukuphindaphinda, ukulinganisa umthwalo, ukuhlangana, kanye nokugcinwa kwefayela.

Cassandra

UCassandra unjalo iphrojekthi yomthombo ovulekile we-Apache eyenzelwe ukuphathwa kwedatha ye-NoSQL.

Imigqa kaCassandra ihlelwe kumatafula futhi yafakwa enkombeni ngokhiye. Isebenzisa i-append-only, engine-based storage engine.

Imininingwane eseCassandra isatshalaliswa kuma-master node amaningi, ngaphandle kwephuzu elilodwa lokwehluleka. Iphrojekthi esezingeni eliphakeme le-Apache, futhi ukuthuthuka kwayo manje kubhekwe yi-Apache Software Foundation (ASF).

UCassandra unjalo yakhelwe ukuxazulula izinkinga ezihambisana nokusebenza ngezinga elikhulu (iwebhu).

Ngokunikezwa kwezakhiwo zobuciko zikaCassandra, ingaqhubeka nokusebenza yize kunenombolo encane (kodwa ebalulekile) yokwehluleka kwehadiwe. ICassandra isebenza kuma-node amaningi ezikhungweni eziningi zedatha.

Phinda idatha kulezi zikhungo zedatha ukuze ugweme ukwehluleka noma isikhathi sokuphumula. Lokhu kwenza kube uhlelo olubekezelela amaphutha kakhulu.