Apache Hadoop yog ib qhov qhib loj ua ntaub ntawv platform. Nws muaj nws cov khoom eco-lawv txhawb xav tau ntau yam. Sib txawv loj heev cov ntaub ntawv tshuaj/platforms ua integrate Hadoop thiab NoSQL rau hauv ib lub platform ces nws kev kawm zoo thiab ua ib qhov kev tseeb tib. Peb tau saib npaum li cas NoSQL thiab Hadoop yuav ua hauj lwm ua ke rau txoj kev sib tw ntawv loj.
Sometime neeg feem ntau tau tsis meej pem tias Hadoop yog ib tug database raws li nws muaj ib tug cia lawv mob. Tab sis, peb hais meej nkag siab hais tias Apache Hadoop yog tsis txhua muaj database.
Apache Hadoop yog tus qhib qhov chaw loj platform muaj lub ntsiab hauv qab no Cheebtsam.
- HDFS: Ib daim ntawv uas hu ua Hadoop Distributed File System (HDFS)
- MapReduce: Ib distributed programming moj khaum hu ua MapReduce
- Hadoop Common: Nws muaj lub qiv thiab hlauv taws xob los txhawb tus kab Hadoop modules.
- Hadoop xov PAJ: Qhov no yog hu ua 'Tsis tau ib qho Negotiator'. Nws yuav yeej tau txoj kev pab tswj platform rau tswj xam kev pab thiab kev paub tab teem dua.
Hadoop kuj muaj lwm yam ntawd ntawm software tej pob khoom los txhawb lub zog eco Cheebtsam. Lub moj khaum txhawb tus ua cov ntaub ntawv muab distributed daim ntaub ntawv. Nws enables ntawv mus ua hauj lwm ib cheeb tsam distributed muaj nqaij txhiab o thiab petabytes ntawm cov ntaub ntawv. Cov ntshav uas xyuas hauv computer ywj siab, los yog hauv luv nqi kho vajtse. Ib pawg computational rau lwm pawg Hadoop txhais tau tias yog (yeej cav tov) nyob rau hauv cheeb tsam nrog Hadoop faib cov ntaub ntawv tsim kev khiav (HDFS) txhawb scaling.
Lub hom phiaj kev tsim kho ntawm Hadoop yog overcome cov tsis ua hauj lwm kho vajtse. Vim radon failures yog ib yam thas thiab lub moj khaum yuav tsum tau txais overcome. Hadoop eco-lawv achieves no lub hom phiaj ntawm txhua qhov modules.
Cov yam ntxwv tseem ceeb ntawm Hadoop platform yog ib tug cia distributed thiab lub moj khaum distributed ua. Cov kua distributed (HDFS) tawg loj ntaub ntawv rau hauv blocks me me (vim yog 64MB) thiab tau muab faib nyob rau clustered o. Lub moj khaum distributed ua kuj hu ua ' MapReduce’ txhawb rau thaum uas tig mus ua heev npaum. Qhov tseem ceeb feature ntawm MapReduce uas yog, nws ships tus (uas yuav ua tus ua) mus rau ntawm qhov uas cov ntaub ntawv nyob lub npe. Qhov no yog hu ua 'ntaub ntawv tas', qhov uas cov ntaub ntawv uas daig nws thawj qhov chaw thiab tus tuaj cuag nws rau koj ua tus ua. Qhov no xwb ib kiv puag ncig rau thaum uas tig mus ua sau.
Lub Cheebtsam lub ntsiab ntawm Hadoop (HDFS thiab MapReduce) derived hauv Google cov ntaub ntawv kaw lus (GFS) thiab tus Google MapReduce. Apart from lub Cheebtsam saum toj no, Hadoop muaj ib tug xov tooj uas muaj feem xyuam txug tej yaam zoo ib yam li Apache Hive, Apache HBase, thiab Apache tus npua thiab lwm yam.
Rau lwm cov tes, NoSQL (txhais 'xwb tsis SQL') yog ib qhov system database tsis-paub los xyuas dua. Nws yog muab los ntawm qhov uas tsis yog-mas rau cov paub database qauv. NoSQL databases yog tsis feem ntau raws cov ntxhuav.
NoSQL database tshuab qhia npaum mechanism cia thiab tus nqi ntawm cov ntaub ntawv, tiam sis nws yeej tsis zoo xws li paub cov qauv. Lub hom phiaj tseem ceeb tsim ntawm NoSQL databases yog yooj yim tsim, kab rov tav scaling thiab nyob zoo. Lub npe yog 'xwb tsis SQL' interprets, li ntawd, nws txhawb tej SQL lus nug lus zoo ib yam li cov HQL thiab lwm yam zoo ib yam li. NoSQL databases feem coob siv nyob hauv ntaub ntawv loj loj thiab cov kev siv analytic.
Li ntawd, ua short peb yuav txhais tau Hadoop thiab NoSQL raws li nram no
- Hadoop: Faib moj khaum xam.
- NoSQL: Cov-paub database.
Cas Hadoop thiab NoSQL yuav ua hauj lwm ua ke?
Ntawm qhov kev sib sab laj saum toj no, Nws yog tseeb tias Hadoop thiab NoSQL no tsis yog tus qub tshaj plaws, tab sis, lawv hnov txog cov ntaub ntawv muab xam muab. Moj khaum Hadoop feem coob siv rau zauv loj loj npaum ntawv (los yog ntaub ntawv loj) thiab NoSQL yog tsim rau storing npaum thiab nqi kev loj ntim ntawm cov ntaub ntawv. Li ntawd, muaj lawm yeej yuav tau muab sij hawm kom muaj NoSQL yog ib txoj kev yuav siv Hadoop. Feem ntau cov neeg, cov ntaub ntawv processed Hadoop uas muab rau ib tug NoSQL database. Tiam sis lawv yeej ib txwm ua ywj siab hais txog kev siv cov neeg uas tej zaum yuav tsis tau tus yug ntawm ob lub platforms. Piv txwv, Yog tias peb xav tau xwb tus mus tib seem khiav ntawm cov ntaub ntawv loj loj thiab nws nyob hauv lub HDFS storing, ces tej zaum yuav yog txaus nkaus xwb Hadoop. Piv, rau storing thiab cov nqi ntawm cov ntaub ntawv unstructured, tej NoSQL database thiab cov kab lus nug lus ua raws li qhov yuav tsum tau.
Ces tus xws li cov NoSQL muaj Hadoop yog ib chaw rau teev loj thaum uas tig mus ua thiab lub sij hawm ntawm cov ntaub ntawv mus thov dua. Sib txawv raws li Hadoop khoom muab rau xws li Hadoop thiab NoSQL nyob hauv ib lub platform. Thiab no 'hauv-Hadoop' NoSQL database muab lub sij hawm ntawm, tuition analytics ua hauj lwm zoo. Hadoop khoom xws li Apache Hadoop yog tus zoo haum kev lag luam zoo ntau lawm deployments. Cov khoom uas tsis tas yuav muaj ntxiv kev paub tab rau cov ntaub ntawv NoSQL. Lub platform integrated (NoSQL thiab Apache Hadoop) txhawb kev kawm ntawv siab, huab scalability, txaus siab, snapshots, rov qab muaj kev puas tsuaj, Integrated ruaj ntseg thiab ntau ntxiv, tsim kom muaj ntau lawm npaj txhij ua hauj lwm zoo analytics.
Vim li ntawd peb yuav xaus tias Apache Hadoop thiab NoSQL yog tsis lub tshuab platform qub, tab sis lawv yog ib txwm siv ua ib qho chaw integrated haum loj cov ntsiab.
