Txheej txheem cej luam:
Hadoop tau ua ntaub ntawv loj tuav sob thiab nws mus tsis tau hais tias lub ntsiab lus teb txog qhov tseem ceeb loj loj loj tej ntaub ntawv tau muab, Hadoop yog saib raws li ib tug tseem ceeb uas saib xyuas cov ntaub ntawv loj. Txawm li cas los, koom haum tej zaum yuav siv yooj yim thiab tuav ntawm Hadoop thiab qhov no yog qhov twg qhov Qhov rai Azure HDInsight los txog rau hauv kab zauv. Qhov rai Azure HDInsight pob Hadoop muaj raws li qhov hauv cov huab thiab ua raws kev Hadoop nyob tsis pub dhau lub moj khaum. Ntawm qhov rais Azure HDInsight xav tias zoo li koj muaj lwm yam raws li huab txojkev pab koj rau ib lub qauv subscription. Ntawm lub foundations ntawm cov neeg, thiab cov kev pab cuam, lub ntsiab tseem tsis tau zoo provisioning thiab cov neeg tswj.
Taw qhia:
Lub qhov rais Azure HDInsight yog ib pab uas deploys thiab provisions Apache Hadoop nyob rau hauv cov huab thiab muab ib qhov hau kev tswj, analysing thiab qhia txog tej ntaub ntawv loj. Tom qab txiag thiab provisioning, cov Apache Hadoop yuav muaj lwm lub sijhawm ntawm ib lub qauv software li-kev pab. Lub qhov rais Azure HDInsight ua rau lub moj khaum software HDFS/MapReduce thiab muaj feem xyuam txug tej yaam muaj nyob rau hauv ib sob, ib puag ncig ntau nqi-npaum thiab scalable. Zauv ua hauj lwm hauv Hadoop thiab tswj cov deployed Hadoop nyob, lub qhov rais Azure HDInsight muab JavaScript thiab nas muv sib tham sib consoles. Tus consoles qhia yooj yim moj khaum Hadoop txhua tus tag nrho cov software developers thiab cov tswj ntaub ntawv loj. Uas yuav muab ib tug ecosystem qhia ntawv rau Apache Hadoop. Qhov rai Azure HDInsight no yuav muaj kev qhib Connectivity Database (ODBC) tsav tsheb los integrate nrog cov txawj ntse ua lag ua luam (LIS) lwm yam cuab yeej xws li SQL neeg rau zaub mov tsom xam kev pab, Excel thiab lwm yam ntaub ntawv loj analytics thiab qhia txog cov kev pab cuam.
Loj cov ntaub ntawv yog dab tsi & thaum nws ua rau kev txiav txim zoo?
Loj cov ntaub ntawv hais txog cov loj ntim ntawm kev xyaum thiab unstructured tej ntaub ntawv uas originates los ntawm ntau qhov chaw sib txawv. Xyaum hais txog cov ntaub ntawv uas ncaav tej yam thiab cov yooj yim los decipher, Piv txwv, cov ntaub ntawv tabular thaum unstructured tej ntaub ntawv hais txog cov ntaub ntawv unorganized uas yog yam nyuab dua rau decipher, Piv txwv, cov ntaub ntawv rau lub sijhawm sib tham ntawm ib tug neeg zov tham thiab neeg tuaj noj. Loj cov ntaub ntawv yuav muaj ob peb yam xws li tooj, ntawv nyeem, dluab thiab ntaub ntawv. Nrog lub siab ntxiv ntawm cov kev tawm, smartphones thiab mobile pab kiag li lawm thiab interconnected pab kiag li lawm los yog hauv Internet ntawm tej (IoT), lub ntim, tshaj tawm thiab ntau yam ntawm cov ntaub ntawv muaj tag nrho cov burgeoned.
Loj cov ntaub ntawv tseem ceeb heev vim nws yuav uas muab tau sib sib zog nqus insights rau ntau yam xws li neeg behaviour, me nyuam kawm ntawv kev kawm, behaviour neeg ua hauj lwm thiab kev kawm ntawv thiab tus economy. Tus insights no zoo heev los ntawm cov foundations kev qhauj thiab hauv tsev thiab lawv yuav pab tau tej kev qhauj thiab tom cuag lawv lub hom phiaj. Piv txwv, reputed koom haum xws li Amazon yeej tau siv insights rau neeg behaviour muab cov tswv yim rau lawv cov khoom thiab offerings.
Txawm li cas los, cov ntaub ntawv loj rau nws tus kheej tsis muaj lwm tus nqi kom txog thaum nws tiav thiab cov insights yog muab rho tawm thiab uas yog ib tug hauj lwm yooj yim, muab qhov xwm ntawm cov ntaub ntawv txoj. Relentless tej ntaub ntawv thiab tawm tswv yim txoj ua noog txog insights ib yam hauj lwm uas yooj yim thiab qhauj muaj tau nrhiav ib cov tshuaj kom txog rau thaum Hadoop los txog.
Apache Hadoop yog dab tsi?
Apache Hadoop yog ib qhov chaw qhib software moj khaum loj uas tau muab ua loj loj tagnrho ntawm cov ntaub ntawv thiab khiav kev siv ntau yam rau hauv radon. Zuag qhia tag nrho, Hadoop muaj peev xwm loj heev cia, ua zog thiab paub tab unlimited txhawb los yog hauj lwm. Lub ntsiab lus teb ntawm tus ntxiv ntawm cov ntaub ntawv loj, lub sij hawm tuaj txog ntawm Apache Hadoop yog tu ncua vim uas twb muaj lawm, tshuab tsis-Hadoop yuav zog tswj ntaub ntawv loj. Yog cov yam ntxwv tseem ceeb ntawm Hadoop:
- Muaj peev xwm ceev ceev cia txhua yam ntawm cov ntaub ntawv nyob rau hauv lub ntim loj loj. Database paub tshuab tsis muaj peev xwm npaum cov ntaub ntawv cia kom sai.
- Xam cov qauv distributed pub rau cov high-speed loj loj cov ntaub ntawv ua.
- Thaiv cov kab mob tsis ua hauj lwm kho vajtse. Yog ib tug ntawm tsis, neeg ua hauj lwm yog hais los ntawm lwm. Ntau cov ntawv luam ntawm cov ntaub ntawv tib cov phwj.
- Tsis zoo li tus paub database, cov ntaub ntawv yuav tsis tau mus tos tso npe ua ntej storing.
- Muaj nqi them raws li tau siv hauv kho vajtse.
Hadoop rau HDInsight yog dab tsi?
Cov Hadoop rau HDInsight yog ib qhov kev pab uas muaj cov khoom Apache Hadoop ntawm tus SaaS qauv. Nws muaj tag nrho cov tseem ceeb cheebtsam uas Apache Hadoop tshuab pawg xws li Apache txim, HBase, Kafka, Cua daj, Npua, Nas muv thiab sib tham sib nas muv. Thaum lub Apache Hadoop pub qhauj coj kom zoo dua rau tej zaum uas muab los ntawm cov ntaub ntawv loj tas nrho, Nws yog ib qho tseem ceeb tias qhauj yuav tau saib xyuas thiab siv Apache Hadoop tsis ntau peev ntawm txoj kev kawm thiab acclimatisation. HDInsight moj khaum pob txiag txog Apache Hadoop tej pawg ua ke tau yooj yim. Nws nyob rau pem huab txhais tau hais tias nws yog ib tug scalable uas raws li qhov ntim ntawm cov ntaub ntawv uas yuav tsum tau. Lub moj khaum HDInsight ua tus nyob Hadoop los sis ib cheebtsam ntawm tus Hortonworks Data Platform (HDP) tis muaj nyob rau hauv cov huab. Nws tswj lub txiag ntawm tej pawg ua ke nrog kev txaus siab thiab kev cia siab rau thiab kev ruaj ntseg qib enterprise thiab tej kev coj zoo nrog kev pab los ntawm Active Directory.
Hadoop eco-system on HDInsight
Lub Hadoop tag nrho ecosystem deployed rau lub HDInsight thiab muaj nyob rau hauv cov qauv SaaS. Lub ntsiab lus teb uas tuav cov ntaub ntawv loj, cov HDInsight muaj peevxwm ob: loj cov ntaub ntawv tuav Apache Hadoop ecosystem thiab cov kev koom ua ke nrog BI cuab yeej kom kawg-rau-kawg loj cov ntaub ntawv tuav. HDInsight cov nta muaj cov consoles muaj Hive sib tham sib thiab JavaScript uas ua rau tus txheejtxheem thiab kov cov Apache Hadoop pawg yooj yim thiab sob. Hadoop ecosystem nyob HDInsight muaj xws li cov nram no:
- Ambari rau cov pawg provisioning, xyuas thiab tswj.
- Nas muv thiab HCatalog muaj querying peev xwm thiab lub rooj thiab cia tswj txheej.
- Mahout rau cov kev siv tshuab scalable kawm.
- MapReduce muab lub moj khaum distributed xam thiab chaw resource management.
- Oozie muaj workflow peevxwm tswj.
- Npua yog qhia zauv scripting nta rau MapReduce transformations.
- Sqoop muab cov ntaub ntawv import thiab export peevxwm.
- Tez pub rau cov dab uas tseem muaj ib cov ntaub ntawv-muab nraaj khiav.
- Xov paj yog ib sab ntawm lub tsev qiv ntawv hoob Hadoop thiab nruab nrab yog cov theem tom ntej ntawm lub moj khaum Hadoop MapReduce.
- Zookeeper muaj cuab kav ua cov hauj lwm muaj dab tag nrho ntawm txhua lub distributed tshuab hauv Hadoop.
HDInsight kuj muaj kev koom ua ke nrog BI cuab yeej xws li Excel, BI zog thiab cov kev pab cuam SQL neeg rau zaub mov Analytics. Yeej, lub Hadoop tag nrho ecosystem deployed ntawm HDInsight.
Getting started – Let’s try
Ntawm no peb yuav xub sim los ua ib tug account nyob rau hauv Microsoft Azure portal siv qhov link nram qab no. Ces peb yuav cav-nyob rau hauv thiab tshawb xyuas lub Cheebtsam muaj nyob ntawm cov dashboard.
https://azure.microsoft.com/en-us/free/
Nws yuav qhib ib qho screen li nram qab no.
Tam sim no, Ndliv qhov 'Pib dawb ' khawm li saum toj no. Nws yuav next rau qhov screen tau tsim thiab lis nyiaj tshiab no.
Ndliv qhov 'Tau ib cov nyiaj tshiab' txuas li saum toj no. Nws yuav next rau qhov screen nram qab no.
Sau tug tus id thiab lo lus zais.
Nyem qhov tom ntej no thiab nws yuav next rau qhov screen nram qab no.
Tam sim no, • ntsuam koj tus e-mail thiab koj yuav tau txais tej kev ruaj ntseg chaws zoo ib yam li hauv qab no raws li qhia hauv qab hauv lub e-mail cev.
Sau qhov chaws ruaj ntseg thiab cov xovxwmTom ntej' khawm.
Tom qab koj txhaj 'Tom ntej' khawm, koj yuav tsum tau navigated rau ib qho screen ruaj ntseg uas koj tau sau koj xov tooj li nram qab no.
Ndliv 'Xa txoj' khawm. Nws yuav xa ib cov code neeg siv rau koj ntse mobile thiab navigated rau cov nram qab no yog qho screen.
Sau ntawv code thiab nias covTom ntej' khawm li nram qab no.
Tom qab koj txhaj 'Tom ntej' khawm, nws yuav next mus dawb mus sib tuaj sau npe nplooj ntawv li nram qab no.
Tam sim no, ua kom paub meej thiab nyem 'Tom ntej' khawm. Nws yuav next rau qhov screen nram qab no.
Ntaus mobile tsawg thiab tau txais cov ntawv code. Sau qhov chaws rau tom ntej teb. Nyob rau qhov screen tom ntej koj yuav muab koj daim credit card txhawb los qhia peb txog koj xwb. Tiam sis nws yuav tsis them tej nqi yog koj ntsees upgrading kom ib tug them version.
Ndliv 'Tom ntej' thiab lees txais yuav qhov kev pom zoo. Tam sim no koj tsis mus sib cav-hauv creation yuav ua kom tiav.
Tom qab no qhib lub azure portal thiab ca-ntawm kev siv koj cov neeg siv tus id thiab lo lus zais. Nws yuav qhib ib dashboard li nram qab no. Koj siv tau cov lus hauv qab no txuas.
Sau npe tuaj rau https://portal.azure.com.
Ndliv '+ Tshiab ' rau cov zaub mov saum toj kawg nkaus lawm thiab nws yuav ua ib daim ntawv uas muaj kev xaiv li hauv qab no.
Nias tshiab
Tam sim no, koj yuav tau nyem rau ntawm HDInsight tshuab raj ua ib qhov rau ntawm tus pane lawm thiab siv nws as per koj xav.
Tswj khiav ceev
Nws mas siv kev txawj ntse thiab kev siv analytics. Koj yuav nrhiav tau qhov screen tua nram qab no.
Koj yuav kuj next rau qhov kev xaiv thiab ua rau koj tus kheej nyiam. Yog hais tias koj nyem rau ntawm HDInsight nws yuav qhia cov lus li nram qab no.
Ntawm no koj yuav tsim thij thiab txav tom ntej los ntawm kev siv ntau hom.
Nyob rau lub pane lawm, Yog hais tias koj nyem rau ntawm qhov 'Database' koj yuav saib tau SQL thiab NoSQL databases li qhov screen tua nram qab no.
Piv tias koj nias qhov report 'Cia' hauv lub pane lawm, koj yuav tau xaiv ntau li nram qab no.
Cia
Tam sim no, yog npaj rau kev siv koj cov qhov rais Azure HDInsight ib puag ncig.
HDInsight Emulator rau Azure yog dab tsi?
Apart from lub ntsiab Azure HDInsight portal cav-nyob rau hauv (li saum toj no), muaj lwm cov kev xaiv rau tus developers. Nws yog hu ua HDInsight Emulator rau Azure (dhau ntawd yog hu ua Microsoft HDInsight tsim tawm saib ua ntej). Nws yog ib txoj kev zoo heev txais ib lub tswv yim ntawm cov HDInsight uas muaj kev txhawb rau ib leeg ntawm txiag. Nws yuav yeej tau ib Hadoop sandbox los Hortonworks. Nws muab ib txoj kev loj hlob hauv cheeb tsam uas siv Hadoop eco-tsim khoom siv xws li HDInsight.
Conclusion:
Zuag qhia tag nrho, lub taub Tawvv cov nqi tseem ceeb ntawm lub qhov rais Azure HDInsight tau yooj yim nyob rau ntawm cov puv Apache Hadoop tshuab pawg pem huab, zauv tuav ntawm lub cuab tam Hadoop, ncig mus ncig loj cov ntaub ntawv los xyuas dua, scalability thiab ua ceev. Tseem, yog muaj cov yam ntxwv mus ntawm huab kuas subscriptions. Txawm li cas los, nyob kev txhawj xeeb txog qhov kev ruaj ntseg ntawm cov ntaub ntawv nyob rau hauv cov huab uas tseem yog tus qub drawback cov kev pab raws li huab. Txawm li cas los, cov nyob rau ntawm consoles yuav tsum xa cov teeb meem ntawm koj investing heev rau txoj kev kawm Hadoop ntawm qhauj. qhov tseeb, developers yuav pib nrog cov consoles thiab tswj ntaub ntawv loj los pib. Ib yam li Apache Hadoop, deploying tag nrho ecosystem Hadoop rau huab thiab kev pab rau kev qhauj idea no kuj yog ib lub tswv yim txoj. Thaum uas tsab cai idea yog maj mam nkag mus rau hauv traction, qhov kev txiav txim yog ib tug tseem tawm seb nws yuav tau txais.
