Cov txheej txheem:

Pom cov ntaub ntawv los ntawm Magicbit hauv AWS: 5 Kauj Ruam
Pom cov ntaub ntawv los ntawm Magicbit hauv AWS: 5 Kauj Ruam

Video: Pom cov ntaub ntawv los ntawm Magicbit hauv AWS: 5 Kauj Ruam

Video: Pom cov ntaub ntawv los ntawm Magicbit hauv AWS: 5 Kauj Ruam
Video: Xyw By Nquab Tsab New Song 2022-2023 2024, Kaum ib hlis
Anonim
Visualizing Data From Magicbit in AWS
Visualizing Data From Magicbit in AWS

Cov ntaub ntawv sau los ntawm cov ntsuas ntsuas txuas nrog Magicbit yuav tshaj tawm rau AWS IOT core los ntawm MQTT kom pom tau qhov tseeb hauv lub sijhawm. Peb tab tom siv khawv koob raws li pawg thawj coj loj hauv txoj haujlwm no uas yog raws ESP32. Yog li ntawd ib qho ESP32 pawg thawj coj loj tuaj yeem siv tau hauv txoj haujlwm no.

Khoom siv:

Magicbit

Kauj ruam 1: Zaj dab neeg

Dab neeg
Dab neeg
Dab neeg
Dab neeg
Dab neeg
Dab neeg

Txoj Haujlwm no yog hais txog kev txuas koj lub cuab yeej Magicbit rau AWS Cloud los ntawm MQTT. Cov ntaub ntawv xa los ntawm MQTT tau tshuaj xyuas thiab pom tau hauv huab siv cov kev pabcuam AWS. Yog li cia pib

Ua ntej koj yuav tsum mus rau AWS Console thiab kos npe rau hauv. Nws yuav txaus rau txoj haujlwm no.

Txhawm rau ua kom yooj yim dua kuv yuav faib txoj haujlwm ua ob ntu.

Qhov no yuav yog thawj theem ntawm peb tes num. Qhov kawg ntawm thawj theem cov ntaub ntawv yuav muab khaws cia rau hauv S3 thoob.

AWS cov kev pabcuam uas yuav raug siv nyob rau thawj ntu,

  • Kinesis Firehose
  • AWS Glue
  • AWS S3

Ua ntej mus rau AWS Kinesis kev pabcuam.

Xaiv Kinesis Data Firehose raws li qhia hauv qab no thiab nyem Tsim

Tom qab ntawd koj yuav raug coj mus rau Kauj Ruam 1 ntawm kev tsim cov kev pabcuam Firehose. Nkag mus rau lub npe xa khoom xa tuaj thiab xaiv Ncaj Ncaj lossis Lwm Qhov Chaw. Nyem Tom ntej no.

Hauv Kauj ruam 2 qhov rai tawm txhua yam raws li lub hauv paus thiab nyem tom ntej. Tom qab tsim cov AWS Glue Service peb yuav rov los kho cov kauj ruam no.

Hauv Kauj Ruam 3 xaiv S3 thoob yog tias koj tau tsim nws ua ntej. Txwv tsis pub nyem tsim thiab tsim ib lub thoob. Hauv S3 cov ntawv ua ntej siv siv dest/ thiab hauv kev ua yuam kev ua ntej nkag yuam kev/. Koj tuaj yeem sau ib lub npe rau ob qho saum toj no. Tab sis kom yooj yim dua peb yuav txuas ntxiv nrog lub npe ib txwm muaj. Nco ntsoov tsim daim nplaub tshev npe hu ua dest hauv lub thoob uas koj tau xaiv. Nyem Tom ntej no.

Hauv Kauj Ruam 4 xaiv qhov tsawg tshaj plaws tsis loj thiab tsis ncua rau lub sijhawm hloov pauv cov ntaub ntawv. Hauv Tshooj Lus Tso Cai xaiv Tsim lossis hloov kho IAM lub luag haujlwmKinesisFirehoseServiceRole. Khaws txhua yam ua ntej. Nyem tom ntej no.

Hauv ntu tom ntej kev tshuaj xyuas ntawm cov kev hloov pauv uas koj tau ua yuav raug qhia. Nyem OK. Tom qab ntawd koj yuav muaj qhov ua haujlwm Kinesis Firehose.

Yog tias koj ua tiav tsim qhov kev pabcuam Firehose koj yuav tau txais qee yam zoo li no.

Kauj Ruam 2: Kuaj Cov Hluav Taws Xob thiab S3 Thoob

Kuaj Cov Hluav Taws Xob thiab S3 Thoob
Kuaj Cov Hluav Taws Xob thiab S3 Thoob
Kuaj Cov Hluav Taws Xob thiab S3 Thoob
Kuaj Cov Hluav Taws Xob thiab S3 Thoob

Txhawm rau sim tias lub qhov hluav taws kub thiab S3 thoob ua haujlwm tau zoo, xaiv IOT core hauv lub console. Koj yuav raug coj mus rau nplooj ntawv zoo li no. Xaiv Txoj Cai thiab tsim txoj cai.

AWS IOT txoj cai yog dab tsi?

Nws yog siv los xa cov ntaub ntawv tau txais los ntawm MQTT mus rau qhov kev pabcuam tshwj xeeb. Hauv qhov piv txwv no peb yuav xa mus rau Kinesis Firehose.

Xaiv lub npe rau Txoj Cai. Tawm ntawm Txoj Cai thiab Lus Nug nqe lus raws li nws yog. Qhov no qhia peb tias txhua yam luam tawm rau iot/cov ncauj lus yuav raug xa mus rau kinesis Firehose los ntawm txoj cai no.

Hauv qab ntu Teeb ib lossis ntau qhov kev ua nyem nyem ua ntxiv. Xaiv Xa lus mus rau Amazon Kinesis Firehose Stream. Xaiv teeb tsa. Tom qab ntawv xaiv lub npe ntawm cov dej tua hluav taws tsim ua ntej. Tom qab ntawd nyem Tsim Txoj Cai thiab tsim lub luag haujlwm. Tam sim no koj tau ua tiav lub luag haujlwm hauv AWS.

Txhua cov lus koj tshaj tawm yuav raug xa mus los ntawm Kinesis Firehose mus rau S3 thoob.

Nco ntsoov Firehose xa cov ntaub ntawv thaum nws tsis puv lossis thaum lub sijhawm tsis mus txog. Qhov tsawg kawg nkaus ncua sijhawm yog 60 sec.

Tam sim no peb tuaj yeem txav mus rau ntu thib ob ntawm txoj haujlwm. Qhov no yuav yog peb daim duab qhia chaw.

Kauj ruam 3: Configuring AWS Glue

Configuring AWS Glue
Configuring AWS Glue

Vim li cas peb thiaj xav tau AWS Glue thiab AWS Athena?

Cov ntaub ntawv khaws cia hauv S3 thoob tsis tuaj yeem siv ncaj qha raws li kev nkag mus rau AWS Quicksight. Ua ntej peb yuav tsum npaj cov ntaub ntawv hauv daim ntawv ntawm cov ntxhuav. Rau qhov no peb siv ob qho kev pabcuam saum toj no.

Go to AWS Glue. Xaiv Crawler ntawm lub cuab yeej sab. Tom qab ntawd xaiv Ntxiv Crawler.

Hauv thawj kauj ruam sau lub npe rau koj tus menyuam nkag. Nyem tom ntej no. Hauv cov kauj ruam tom ntej cia nws ua lub neej ntawd. Hauv qib peb nkag mus rau txoj hauv kev rau koj xaiv S3 thoob. Tawm ntawm lub qhov rais tom ntej raws li lub neej ntawd. Hauv lub qhov rai thib tsib nkag mus rau IAM lub luag haujlwm. Hauv cov kauj ruam tom ntej xaiv qhov zaus ntawm kev ua haujlwm.

Nws raug nquahu kom xaiv kev cai nyob hauv lub npov nco thiab xaiv sijhawm tsawg kawg.

Hauv cov kauj ruam tom ntej nyem Ntxiv Database thiab tom ntej no. Nyem tag.

Tam sim no peb yuav tsum koom nrog peb Kinesis Firehose nrog AWS Glue peb tsim.

Mus rau AWS Kinesis firehose peb tsim thiab nyem hloov.

Scroll cia rau seem Hloov Hloov Cov Ntaub Ntawv thiab xaiv Enabled.

Xaiv hom ntawv tso tawm ua Apache Parquet. Rau qhov seem ntawm cov ntsiab lus sau rau hauv cov ntsiab lus ntawm Glue database koj tsim. Ib lub rooj yuav tsum tau tsim hauv cov database thiab lub npe yuav tsum tau ntxiv rau hauv ntu no. Nyem Txuag.

Kauj ruam 4: Configuring AWS Athena

Configuring AWS Athena
Configuring AWS Athena

Xaiv lub database thiab cov ntaub ntawv cov ntaub ntawv koj tsim. Hauv nqe lus nug nqe lus no yuav tsum tau ntxiv.

lub npe-lub npe yuav tsum raug hloov pauv los ntawm lub npe tseeb ntawm Cov lus Glue uas koj tau tsim.

Nyem Run Query. Yog tias nws ua haujlwm cov ntaub ntawv khaws cia hauv AWS S3 thoob yuav tsum tau muab nthuav tawm ua cov lus ntawm cov ntaub ntawv.

Tam sim no peb tau npaj kom pom cov ntaub ntawv peb tau txais.

Kauj Ruam 5: Txheeb Xyuas QuickSight

Kev teeb tsa QuickSight
Kev teeb tsa QuickSight

Nkag mus rau AWS Quicksight

Nyem Kev Ntsuam Xyuas Tshiab nyob rau sab xis saum toj thiab tom qab ntawv nyem Tshiab Dataset.

Xaiv Athena los ntawm cov npe. Nkag mus rau Cov Ntaub Ntawv npe lub npe ntawm daim npav pop up.

Xaiv cov ntaub ntawv nplaum los ntawm lub npov nco thiab lub rooj uas cuam tshuam. Qhov no yuav coj koj mus rau nplooj ntawv no.

Luag thiab xa ib daim teb los ntawm daim ntawv teev npe thiab xaiv yam pom kev.

Tam sim no koj tuaj yeem pom cov ntaub ntawv xa los ntawm koj li MagicBit Siv AWS cov kev pabcuam !!!

Nco ntsoov tso cai nkag mus rau qhov nrawm rau cov thoob S3 txhawm rau txhawm rau pom cov ntaub ntawv hauv lawv.

Pom zoo: