Apache Sqoop yog ib tug uas siv rau Identify tej ntaub ntawv los ntawm/rua Hadoop faib cov ntaub ntawv kaw lus. Hadoop architecture muaj txheej txheem rau cov ntawv loj loj thiab muab tso rau hauv HDFS. Tab sis, yog hais tias peb yuav siv cov ntaub ntawv ntawd ces peb yuav tsum siv tej cuab tam ntshuam/export nws nraaj. Apache Sqoop cia yooj yim ntshuam thiab export ntawm cov ntaub ntawv los ntawm cov ntaub ntawv xyaum khw muag khoom noj xws li paub databases, Enterprise ntaub warehouses, thiab lub nruab NoSQL.
Apache Sqoop tseem ceeb thaum xav txog kev siv tshuaj Hadoop analytics thiab ua cov ntaub ntawv. Qhov ob lub ntsiab yaam twg Sqoop chaw nyob yog
ib) Tej chaw thau khoom(ntau lawm) cov ntaub ntawv rau hauv Hadoop.
b) Tus txheejtxheem tej ntaub ntawv los ntawm daim ntawv qhia/txo kev siv khiav rau tej pawg ua ke loj.
Dhau peb lub neej qub teev/siv scripts rau ntshuam/export cov ntaub ntawv los ntawm ntau lub. Tiam sis txoj kev no yog inefficient thiab tsis xyuas cov ntaub ntawv li qub tas li, neeg thiab lwm yam ntsiab lus critical.
Sqoop siv ncaj pem mechanism rho cov ntaub ntawv. Lub dataset tas nrho yog splitted rau hauv slices thiab txhua ib nplais yog ib txoj hauj lwm daim ntawv qhia nkaus xwb. Tam sim no txhua txoj hauj lwm daim ntawv qhia nkaus xwb li Identify hlais ib ntawm cov ntaub ntawv-txheej.
Raws li peb tau tham txog, Sqoop yuav siv tau los import cov ntaub ntawv ntawm ib lub RDBMS rau hauv HDFS. Lub tswv yim mus ntshuam txheej txheem yog ib cov lus database thiab Sqoop nyeem cov lus uake los leej rau hauv HDFS. Tus txheej txheem input yam nyob mus tib seem kom cov zis yuav muaj ntau yam ntaub ntawv. Cov ntaub ntawv rau cov zis yuav muaj cov ntawv luam cov ntaub ntawv los yog lwm yam ntaub ntawv uas muaj cov tshuaj serialized ntaub ntawv.
Nws muaj nws ib cov by-product ntawm tus txheej txheem ntshuam Sqoop. Nws yog ib tug Java kawm uas tau encapsulate ib tug uake ntawm cov lus txawv teb. Java kawm no yog siv los ntawm lub Sqoop xwb durng ntshuam taug txoj cai. Qhov chaws no by-product Java hoob kawm no kuj muaj nyob rau kev siv customized.
Tom qab xyuas cov ntaub ntawv txawv teb, yuav tsum exported rau yam paub database siv Sqoop. Sqoop yuav nyeem phau ntawv delimited ntaub ntawv txheej HDFS (nyob mus tib seem) thiab ntxig lawv li tshiab natwm rau lub
hom lus. Tam sim no cov ntaub ntawv no tseem muaj cov consumtion los ntawm qhov kev siv lwm.
Sqoop tseem muab ib co hlauv taws xob hais kom ua tau cov lus qhia txog tus databaes uas nws ua hauj lwm. Daim ntawv ntawm database schemas, ntxhuav yuav kuj pub siv Sqoop commands. Sqoop yuav muaj kev SQL txheej thaum ub tso plhaub.
Sqoop haujlwm li ntshuam,export,Code kev cim tau raug Mekas thiab lwm yam. Rau ntshuam, yog hom twg/txhua leej yuav tsum teev. Lub delimiters, txoj kev khiav cim rau sawv cev raws li cov ntaub ntawv kuj yuav hloov as per lub. Lub pob/kawm npe cov chaws generated kuj yog Mekas kom tau raws li qhov yuav tsum tau ua daim ntawv thov.
Sqoop connectors yog ib feem tseem ceeb ntawm cov cuab tam. Connectors muaj plugin Cheebtsam ua tau rau tus extension Sqoop lub moj khaum. Cov connectors no yuav muab ntxiv rau txhua tus plahaum Sqoop thiab ces cov ntaub ntawv kuj yuav kis ntawm Hadoop thiab lwm lub khw.
Sqoop tuaj ti rau neej ntawd connectors rau ntau yam nrov databases xws li MySQL, PostgreSQL, Oracle, Neeg rau zaub mov SQL thiab DB2. Sqoop kuj muaj xws li ib tug generic JDBC connector uas yuav siv tau los txuas rau tej database populations ntawm JDBC.
Los xaus kev sib tham no peb yuav hais tias Sqoop yuav siv rho cov datasets loj loj ntawd ntawm Hadoop thiab datastores lwm nraaj. Dhau qhov no, Sqoop kuj muaj ntau yam tshaj nta zoo ib yam li lwm cov ntaub ntawv tawm tswv yim,compression,customization,koom tes nrog queries thiab lwm yam.
