Ntawv loj (Hadoop) raws li qhov - Nws yuav ua li cas?

Cov ntaub ntawv loj raws li ib qho kev pab – Nws yuav ua li cas?

Txheej txheem cej luam: Hnub no lub tshuab ntiaj teb, software ua ib qhov kev pab cuam software (SaaS) qauv. Cov kev pab yog muab rau cov subscribers li ib tug xav tau kev pab. Cov ntaub ntawv loj no kuj raws li qhov kev pab qauv. Nyob rau cov tshooj no, Kuv yuav tham txog cov qauv ua raws li nyob rau hauv cov ntaub ntawv loj tshuab domain.

Ntawm no yog ib piav rau ib co qauv paub cov qauv rau cov ntaub ntawv loj raws li ib qho kev pab

Rackspace:

Rackspace Hadoop clusters yuav khiav Hadoop rau Rackspace tswj servers, pej xeem huab los yog lwm tus huab.

Ib tug huab loj cov ntaub ntawv yog muab los ntawm Rackspace rau Apache Spark thiab Hadoop. Nws muaj ib tug tswj hlau-hlau platform rau-nco ntsoov txoj kev.

Rackspace eliminates qhov teeb meem uas tswj thiab tuav ntaub ntawv loj manually. Nws tuaj nrog cov nta tom qab nta

Nws txo lub lag luam tab kaum yog muab 24x7365 fanatical kev them nyiaj yug.
Muab daim ntawv qhia txog Hortonworks Data Platforms (HDP) cuab tam, xws li npua, Nas muv, HBase, Sqoop, Flume, thiab Hcatalog.
Nws muaj ib tug yooj ywm network tsim nrog tsoos networking mus txog 10GB.

Mus rau lwm yam huab los nrog rau pej xeem huab hwj huab thiab efficiency thiab ruaj ntseg thiab tswj Private huab. Qhov loj disadvantage uas siv huab ntiav yog tias nws yog ib qho nyuaj los tswj thiab xav tau kev txawj ntse mus upgrade, patch thiab saib xyuas ib cheeb tsam huab. Rackspace muab tus excellent kev them nyiaj yug nyob rau hauv rooj plaub no thiab yuav tsis muaj kev txhawj xeeb txog huab.

Lus Nkaus:

Raws li Apache Hadoop Hadoop, Joyent yog ib tug huab raws li hosting tej ntaub ntawv loj tej yaam num. Cov tshuaj no yog los ua siv Hortonworks Data Platform (HDP).

Nws yog ib tug txuj ci high-native infrastructure rau hnub no xav tau kev pab mobile thiab real-time. Nws pub khiav ntawm enterprise-class Hadoop rau cov kev kawm zoo Joyent huab.

Cov nram qab no yuav tau teev tam sim no:

Ob feem peb ntawm cov nqi infrastructure yuav muab txiav los ntawm kev muab los ntawm Joyent nrog lub teb tib lub sij hawm.
3x sai disk I/O teb lub sij hawm los ntawm Hadoop clusters rau Joyent huab.
Nws accelerates lub sij hawm ntawm faib thiab parallel txheej txheem.
Nws kuj txhim khu cov scaling ntawm Hadoop clusters executing intensive ntaub ntawv analytics.
Cov ntaub ntawv zaum no sai tau soj ntsuam nrog teb zoo lub sij hawm.

Feem ntau, Cov ntaub ntawv loj cov ntaub ntawv yog kim kim thiab tsis yooj yim siv. Joyent yog targeting ntawm hloov qhov no yog muab ib tug cheaper thiab sai sai

Joyent muab pej xeem thiab hybrid huab infrastructure rau real-time thiab mobile applications. Cov neeg tau muaj LinkedIn, Voxer, yam.

Qubole:

Rau tej yaam num loj loj tej yaam num, Ib hadoop cluster yog muab los ntawm Qubole nrog ua cov ntaub ntawv connectors thiab graphical editor. Enables los siv ntau yam databases xws li MySQL, MongoDB, Oracle thiab teev Hadoop cluster rau auto-tsav. Nws muab ib query editor rau Hive, Npua thiab Mapreduce.

Nws muab txhua yam-ua-cov kev pab i.e.e..

editor editor rau Hive, Npua thiab Mapreduce
kev ntxhov siab
kev siv dashboard
ETL thiab cov ntaub ntawv pipeline builders

Nws cov nta muaj nuj nqis muaj nyob hauv qab no:

Sau sai dua Amazon EMR
Yooj yim siv GUI nrog ua-in connectors thiab seamless elastic huab infrastructure.
Optimization of resource allocation thiab tswj yog los ntawm QDS muaj cav uas siv daemons. Nws muab ib lub tswv yim Hadoop Hadoop zoo rau kev kawm zoo.

Siv cov xib fwb ua ntej yuav tuag thiab query acceleration, Qubole muaj demonstrated query speeds ntawm li 5 x sai li piv rau huab raws li huab muaj hadoop.

Rau sai queries, Kuv/O yog optimized rau cia. S3 yog ruaj ntseg thiab txhim khu kev qha. Qubole Data Service muaj 5x sai tiav tiv tsis tau cov ntaub ntawv nyob rau hauv S3.
Tsis muaj leej twg yuav tau them tsis nta thiab daim ntawv thov.
Huab Integration i.e.e.. Qubole cov ntaub ntawv tsis tas yuav hloov ua rau koj infrastructure i.e.e.. nws muab yooj ywm rau kev ua hauj lwm nrog tej platform. QDS connectors txhawb import thiab export ntawm huab databases MongoDB, Oracle, PostgressQL thiab cov chaw muab kev pab xws li Google Analytics.
Cluster lub neej cycle tswj nrog Qubole Data Service rau kev muab clusters hauv feeb, scaling nws nrog thov thiab khiav nws nyob rau hauv tej kev tswj yooj yim ntawm cov ntaub ntawv loj cov ntaub ntawv.

Elastic MapReduce:

Amazon Elastic MapReduce (NPAU SUAV) muab ib tug tswj Hadoop Hadoop framework rau cov ntaub ntawv loj txoj kev yooj yim. Nws yog ib qho yooj yim, thiab nqi zoo rau distributing thiab txheej txheem txheej txheem coob tus nqi

Lwm yam frameworks faib frameworks xws li spark, Presto yuav tau khiav hauv Amazon EMR interact nrog cov ntaub ntawv nyob rau hauv Amazon S3 thiab DynamoDB. EMR kov cov ntaub ntawv siv nrog kev ntseeg:

Web Indexing	kev kawm tshuab
Kev xeeb Txawm	Cov ntaub ntawv Warehousing
Log tsom xam	Bioinformatics

Cov neeg tau muaj Yelp, Nokia, dluab, liab, thiab lwm tus. Qee yam ntawm nws cov nta muaj nuj nqis nyob hauv qab no:

Yooj siv cov hauv paus hniav kom txhua txhua zaus, txhawb ntau haiv neeg Hadoop Hadoop thiab kev siv. Nws yog ib qho yooj yim rau customize txhua cluster thiab nruab nrab ntxiv.
Nws yog ib qho yooj yim rau nruab Amazon EMR cluster.
Txaus siv sij hawm xyuas koj cluster; Retrying tejyam hauj lwm thiab yuav tsum hloov cov kev kawm tsis tau zoo.
Ruaj ntseg li nws yuav configures Amazon EC2 firewall teev. Qhov no yog rau kev tswj network mus saib tau.
Nrog Amazon EMR, koj yuav txheej txheem ntawm tej teejtug. Tej zaum cov zauv yuav yooj yim ntau zog thiab tsis yooj yim.
Nqi pricing uas tsis muaj nkaum kim nqi; them txhua txhua teev twg siv. Piv txwv, tso ib 10-node Hadoop cluster kom tsawg li tsawg $0.15 teev.

Nws siv rau analyze nias cov ntaub ntawv rau kev to taub cov neeg siv xovxwm. Advertisers yuav analyze nias streams thiab advertising impression logs.

Nws kuj siv tau los ua txheej txheem so los siav cov ntaub ntawv genomic thiab cov ntaub ntawv loj txheej txheem npaum li cas. Genomic cov ntaub ntawv hosted rau AWS yuav tau accessed los ntawm kev soj ntsuam ntawm rau dawb.

Amazon EMR yuav muab siv rau cov txheej txheem thiab pab lawv nyob rau hauv cov tsiaj ntawv uas unstructured thiab semi-structured cov ntaub ntawv rau hauv insights.

Cug:

Nws yog ib lub platform rau cov ntaub ntawv science high-scale thiab ua rau cov Amazon Web Services huab. Nws ua tau rau Elastic Mapreduce (NPAU SUAV) tso Hadoop clusters. Mortar founded yog K hluas nkauj, Jeremy Kam, Doug Daniels 2011 nrog ib vim li cas mus tua lub sij hawm haus cov hauj lwm tsis yooj yim. Qhov no yog ua li ntawd tus zaum yuav siv lawv lub sij hawm ua hauj lwm ua lwm tseem ceeb heev tej hauj lwm.

Nws sau rau Java, Jythoo, Hadpoo etc. rau lub sij hawm txo sij hawm thov los ntawm cov neeg siv thiab qhia rau lawv kub siab rau cov ntaub ntawv kev kawm.

Nws tuaj nrog cov nta tom qab nta:

Nws frees koj pab neeg teamed thiab time-consuming plahaum thiab kho.
Txuag lub sij hawm uas Mortal los tau txais cov tshuaj ua haujlwm hauv ib span tsis ntev ntawm lub sij hawm.
Cov neeg siv alerts rau tej glitches hauv tshuab thiab daim ntawv thov kom paub tseeb tias lawv nyob nraum tau txais thiab real-time.
Vendor hloov tsis rau cov neeg siv ntau vim hais tias nws twb tau khiav ntawm kev qhib tshuab.

Daim ntawv thov Mortor platform:

Rau deploying ib haib, scalable pom zoo cav, lub platform fastest yog Mortor.
Mortor yog mas automated li nws sau cov cav tswv yim los xaus rau tsuas muaj ib command.
Nws siv kev lag luam txuj version tswj uas yuav pab tau yooj yim thiab kev lis kev cai.
Rau analyzing, yooj yim txuas nrog ntau cov ntaub ntawv los mus rau cov ntaub ntawv warehouses.
Nws rua lub sij hawm ua hauj lwm ntawm koj pab neeg los ntawm tuav infrastructure, nyiaj poob haujlwm, thiab lwm yam haujlwm.
Predict tsom xam los siv cov ntaub ntawv uas koj nyob nraum twb muaj. Mortar txhawb kev ncaaj ncees xws li kab regression, classification rau tsom xam.
Txhawb kev kawm technologies zoo ib yam li R, Npua, Python rau delivering kev parallelization rau txoj hauj lwm.
Nrog 99.9% up-time thiab xaiv yaam xyuas kom cov ntseeg cov neeg siv thiab delivering ntawm analytics pipeline dua thiab rov.
Predictive algorithms siv rau kev cog cov lag luam zoo li predicting thov, paub hais tias tus nqi ntau tus neeg muas zaub.
Analyzing loj ntim ntawm cov ntawv nyeem yog yooj yim, seb nws cov tokenization, stemming los YOG LDA, npe.

Txoj kev:

Muaj ntau cov ntaub ntawv muaj hnub no thiab yav tom ntej yuav muaj sai thiab cheaper solutions muaj rau cov neeg siv. Tshaj tej ntawm, Cov neeg zov me nyuam yuav tuaj nrog cov ntsiab lus uas yuav ua rau plahaum thiab kho raws li tus nqi cheaper tus nqi.