Txheej txheem cej luam: Analytics ntawv yog tus haib mechanism siv extract xyaum cov ntaub ntawv los ntawm unstructured los yog semi structured ntawv nyeem. Qhov no yog ua los ntawm txoj kev cai kom. Txoj cai no yog siv los ntawm cov kev pab cuam extraction extract cov ntaub.
Nyob rau cov tshooj no peb yuav tham txog qhov IBnnotation Query language los sis AQL uas yog siv rau cov ntawv analytics.
Taw qhia: IBM Infosphere yog ib lub platform uas siv rau kev tsom xam cov insights ua hauj lwm nyob rau hauv lub ntim loj loj ntawm cov ntaub ntawv uas yog ib yam uas muaj ntau yam diversified. Feem ntau cov ntaub ntawv yog ignored vim hais tias nws yuav tsis mus ua ntaub ntawv rau tej lub ntim ntawm cov ntaub ntawv uas siv cov tshuaj DBMS los yog RDBMS cuab yeej yuav. Annotation lus nug lus los AQL yog muaj lus nug lus siv hauv IBM InfoSphere ib tivthaiv kom lawv muaj cov extractors uas tau extract kev qhia xyaum los ntawm unstructured los yog semi structured ntsiab lus.
Cheebtsam ntawm phau ntawv Analytics:
- Sau los tawm tswv yim – cov tswv yim Input sau los yog ib daim ntawv los yog ib pawg ntawm cov ntaub ntawv uas yog siv ib phau ntawv input ntawm qhov chaw uas peb yuav tsum mus extract cov lus. Feem ntau ib input sau los yuav tsum yog ib qhov ntawm cov nram qab no tawm tswv yim –
- UTF-8 encoded ntawv nyeem ntaub ntawv nrog rau tej yam qab extensions –
- .txt
- .htm los yog .html los yog .xhtml
- .xml
- Ib directory uas muaj UTF-8 encoded ntawv luam ntaub ntawv.
- Ib archive tej ntaub ntawv uas muaj cov nram qab no extensions uas muaj UTF-8 encoded ntawv nyeem cov ntaub ntawv –
- .ib
- .zauv teb
- .gz
- UTF-8 encoded comma cais ntaub ntawv.
- Ib cov ntaub ntawv JSON dawb.
- UTF-8 encoded ntawv nyeem ntaub ntawv nrog rau tej yam qab extensions –
- Kev qhia – Feem ntau cov kab zauv mus los mus ntawv nrhiav mechanism. Tej zaum peb yuav siv builders kev qhia uas yog siv los tsim kev kab zauv thiab sub kab zauv.
- Multilingual Support- Phau ntawv analytics Cheebtsam tau kev them nyiaj yug rau ntau hom lus uas los mus sib sau. Analytics ntawv nyeem raws li ob qho loj hom kev kawm – tokenization thiab lus.
- Qauv – Tus qauv foundations feature pawg input contexts uas muaj ntsis zoo ib yam los yog tau ib qho txawv.
- Hom lus nug lus annotation los yog AQL- AQL yog tus thawj hom lus siv rau phau ntawv analytics. Qhov no yuav muab siv los tsim cov extractors uas ces yuav siv los extract yam ntaub ntawv los ntawm cov ntawv luam ua unstructured Cheebtsam. Qhov no yog qhov ntau SQL cov lus zoo ib yam li.
Analytics ntawv sib nrauj:
- Declarative lus – Ib cov lus declarative yog siv thiab extract tuav ntaub ntawv los ntawm cov chav kawm ntawv. Annotation lus nug lus los AQL enables peb muaj peb li collections ntawm cov ntaub ntawv los sis views uas qhov khoom ib daim kev cai tswjhwm cai. Cov views cov qhov tso zis ntsiab lus AQL extractor. Views siv los tso saib daim ntawv qhia txog IBM Bigsheets. IBM Bigsheet yog tus inbuilt qhia thiab dashboard tivthaiv platform IBM Infosphere Biginsight.
- Dictionaries neeg txhais- Phau ntawv txhais lus muaj peev xwm qhia tau hais tias tej yam ntawv luam ntawm cov ntawv luam input rau extract lub lag luam insights. Nyob rau AQL peb yuav muaj peb phau ntawv txhais lus customized uas yuav pab kom tau qhov tshwm sim yam ncees npaum.
- Txoj cai hais tseg neeg – Nrog kev pab los ntawm cov qauv thiab kab zauv mus peb yuav qhia kev cai los yog mechanism uas peb puas yuav siv cov ntaub ntawv los ntawm ib pawg loj loj ntawm cov ntaub ntawv.
Peb saib cov piv txwv hauv qab no – peb yuav hais tej yam keywords uas yuav los kuj yuav tsis tshwm sim nyob rau hauv ib chav muab kev hlub. E.g. muab peb lo lus – "Kua", "Mac" thiab "Steve". Yog hais tias tag nrho cov ntsiab lus tshwm sim nyob rau hauv ib chav hais tseg tias yuav cuab kev uas peb yuav tham txog kua xyuas hauv computer uas founded los ntawm hauj lwm Steve thiab Mac siv operating lawv ntawm no. Tiam sis yog tias lo lus "Waugh" zoo li yog tom qab lo lus "Steve" thiab lwm ob ntsiab lus – "Kua" thiab "Mac" tsis tam sim no, ces nws yuav tseeb tias peb yuav sib tham txog cov npe nrov hauv pawg cricketer – Steve Waugh.
- Mus txog qhovtwg – Txoj kev tsom xam ntawv yog ib txoj kev iterative. Nws yuav mus hloov cov cai thiab lwm tus neeg siv txhais dictionaries raws li lub ntsiab li cas peb tau tawm ntawm koj cov cai uas twb muaj lawm.
Phau ntawv txoj kev Analytics:
Tus txheej txheem phau ntawv analytics yog nqa ntawm tus plaub ruam hauv qab no –
- Kauj ruam 1 -Muab thiab zaub coj mus kuaj tej ntaub ntawv – Ib daim ntawv thov raws li phau ntawv analytics yog tsim nrog kev pab los ntawm tej ntaub ntawv coj mus kuaj. No cov qauv ntaub ntawv yog tsim los ntawm muaj ib subset ntawm cov ntaub ntawv loj uas peb tau ceev. Peb cov hom ntawv uas peb cov ntaub ntawv input nyob tau ua ib los yog ntau tawm tswv yim txog tej ntaub ntawv uas ua raws li BigInsights. Nyob rau hauv qhov kev piv txwv uas hais saum toj no peb nrhiav lub keywords input – "Kua", "Mac" thiab "Steve". Cov input tsis pab tau daim ntawv thov kom muab cov ntaub ntawv los ntawm cov websites uas muaj cov keywords lum.
- Kauj ruam 2 – Tsim cov ntawv extractor mus sim zoo li qub – BigInsights Plugins no muaj nyob rau hauv feem ntau poj Java IDE – dab noj hnub. Raws li wizards peb tau yooj yim tshwm rau phau ntawv extractors thiab ntsuam xyuas lawv siv cov dab noj hnub. Lub chaw BigInsights muaj tag nrho cov lus qhia nyob rau requisite tos software uas yuav tsum tau tsim cov ntawv extractors. Nyob rau sab npaum li, cov kauj ruam hauv qab no yuav tsum muab nqa los ua ib phau ntawv extractor rau dab noj hnub, thaum lub BigInsights plugin yog ntsia ntse-
- Ua kom muaj ib tug yog ib qhov BigInsights tshiab.
- Ntshuam tus qauv ntawv uas yuav tsum tau mus soj ntsuam. Cov qauv ntaub ntawv nyob hauv peb tus piv txwv yog li ntawm ib hom ntawv JSON array. Rau peb ntawd homphiaj peb cia siv rau qhov chaw Bigsheets export export tej ntaub ntawv (ncig 10000) cov ntaub ntawv nyob rau hauv ib daim ntawv CSV. Ces peb khiav Jaql tsab ntawv. Tsab ntawv no converts CSV ntawv ib hom ntaub ntawv kom haum delimited uas yog tshwmsim los ntawm BigInsights. Cov ntaub ntawv no tshiab ces siv input ua ntaub ntawv thov rau cov dab noj hnub analytical tuam.
- Ua tau ib lub artifacts uas yuav tsum tau los ntawm cov ntawv e.g. AQL modules, AQL scripts, neeg txhais dictionaries ua luaj rau.
- Kuaj koj cov cai tiv thaiv koj cov ntaub ntawv coj mus kuaj cov input sau yog muab raws li tam sim no. Cov yam ntxwv ntawm built xws li annotation explorer thiab cov cav pane yuav siv los xyuas cov ntsiab. Tw no yuav tsum tau nqa iteratively.
- Kauj ruam 3 – Luam tawm tsab thiab deploy – Daim ntawv thov no kom deployed thiab luam tawm thaum peb txaus siab rau cov qhabnias uas yog ua los ntawm cov ntawv extractor. Feem ntau nws yog luam hauv lub catalog tshiab uas sawv. Thiaj li deploy published ntaub ntawv rau peb siv lub BigInsights web console. Tej zaum peb yuav siv tus ID nkag mus siv uas muaj cov kev tsim nyog tau.
- Kauj ruam 4 – Khiav cov ntawv extractor- Tom qab cov ntawv extractor deploying ntse, Yog tam sim no lub caij rau txim tuag rau nws. Raws li peb paub BigInsights muaj peev xwm ua tau rau tus tus ntawv extractors siv Java API nrog kev pab los ntawm Jaql thiab Bigsheets. Qhov kom zoo dua siv Bigsheets yog tias muaj no tsis muaj ntxiv coding los yog scripting yuav tsum tau nyob ntawm no. Kev ua lag ua luam Analyst yuav noj mus ua hauj lwm no.
AQL Views:
Yog tsis muaj dab tsi tshwj xeeb txog AQL views. Cov no zoo ib yam li tus txheem views ntawm ib tug paub database. Txhua AQL pom muaj ib lub npe, thiab muaj natwm thiab txhua. Nyob rau hauv AQL, views yeej ib txwm materialized. Cov lus AQL phais views. Ntawm no peb muaj ib saib tshwj xeeb hu ua daim ntawv. No pom yog mapped rau ib daim ntawv input thaum lub sij hawm ntawm koj sau los ntawm runtime. Tswv kom extract lub subset ntawm tus txheej loj ntawm cov ntaub ntawv no saib yog.
Txoj kev: Phau ntawv analytics yog lub plawv tej ntaub ntawv analytics. Ces nws tseem ceeb heev kom paub cov cuab yeej thiab cov coj yuav tsum tau tsim ntawv analytics daim ntaub ntawv. IBM Infosphere Biginsight yog ib lub yam zoo tshaj rau cov ntawv analytics. Peb cia saib lub ntsab lug peb sib tham nyob rau hauv daim ntawv uas cia nyias qhov hauv qab no –
- Analytics ntawv yog tus haib mechanism siv extract ntxiv ntawm txheej cov ntaub ntawv unstructured.
- Cov loj Cheebtsam ntawm phau ntawv analytics-
- Hom ntawv sau los tawm tswv yim
- Kev qhia
- Multilingual yug
- Annotation lus nug lus los AQL
- Cov loj sib nrauj ntawv analytics-
- Declarative lus
- Cov neeg siv txhais dictionaries
- Txoj cai hais tseg neeg
- Nrhiav
