Tus Kws Qhia Lus Askiv Tus Kheej - AI Lub Suab Pab: 15 Kauj Ruam

2024 Tus sau: John Day | [email protected]. Kawg hloov kho: 2024-01-30 09:27

Txoj haujlwm no yuav pab cov tub ntxhais kawm uas tab tom npaj rau txhua qhov kev xeem lus, qhov uas lawv tuaj yeem raug cob qhia los ntawm kev cuam tshuam nrog Snips AI.

Kauj ruam 1: Zaj dab neeg

Vim Li Cas Peb Tsim Qhov No?

Los ntawm kuv tus kheej kev paub, Kuv tau pom ntau tus neeg npaj rau ntau yam kev xeem lus xws li GRE, TOEFL, IELTS. Lawv xav tau ib tus neeg los pab lawv hauv kev cim thiab nkag siab cov lus. Nrog rau qhov kev daws teeb meem no, peb tuaj yeem txo cov neeg ua haujlwm los ntawm kev siv lub suab pab.

Kauj ruam 2: Tsim Kho Vajtse

Ua ntej tshaj plaws, Kuv xav ua tsaug rau SNIPS thiab SEEED rau kev txhawb nqa txoj haujlwm no nrog qhov ua tau zoo Snips Voice Interaction Development Kit (Base Kit), Kuv yeej xav tias muaj ntaub ntawv siv lub rooj tsav xwm no thiab tuaj yeem ua tiav qee txoj haujlwm nyuaj ua ke hauv PCB.

Koj tuaj yeem yuav Snips Voice Interaction Base Kit rau $ 115 thiab Snips Voice Interaction Satellite Kit rau $ 85

Kauj Ruam 3: Pib Nrog SNIPS

Ua ntej pib, cia peb tshuaj xyuas yam koj xav tau.

• Raspberry Pi 3B/B+ (Pom Zoo) lossis Pi 2 Qauv B (Txhawb Nqa).
• Micro-USB Cable & Micro-USB lub zog hloov pauv rau Raspberry Pi.
• Micro SD Card (Yam tsawg kawg 8 GB) - Yuav tsum siv lub tshuab ua haujlwm kom pib. Koj tuaj yeem rub tawm Raspbian Stretch thiab siv cov lus qhia rau Mac OS, Linux, thiab Windows Hauv Raspberry Pi lub vev xaib.
• USB Keyboard & Mouse, thiab sab nraud HDMI Saib - peb kuj pom zoo kom muaj USB keyboard thiab nas ntxiv nrog rau HDMI saib tau yooj yim.
• Kev sib txuas Internet (Ethernet lossis WiFi)

Snips Voice Interaction Base Kit

Snips Voice Interaction Development Kits txhawb cov neeg siv kom dhia-pib lawv txoj kev txhim kho lub suab cuam tshuam thiab yooj yim sib koom ua ke Snips AI Voice Platform nrog kho vajtse. Snips khiav ntawm lub cuab yeej, txhais tau tias txhua yam ntawm koj lub suab hais kom ua thiab cov ntaub ntawv tau ua tiav hauv zos tsis yog xa mus rau huab. Kev ua haujlwm ntawm lub cuab yeej no ua rau muaj kev nyab xeeb kiag li lub suab pab offline uas khaws koj cov ntaub ntawv ntiag tug, zoo li nws yuav tsum yog.

Cov Khoom Siv Sib Tham Hauv Lub Suab tso cai rau koj los khiav tag nrho Snips AI Lub Suab Platform. Tsim los ntawm Raspberry Pi 3 Qauv B+ thiab ReSpeaker 2-Mics Pi HAT, nws muaj peev xwm ua tus neeg hais lus zoo hauv tsev. Nrog rau cov khoom siv los hais lus, Grove - Kub & Huab Cua Sensor (SHT31), Grove - Relay, thiab pegboard txhawm rau dai nws ntawm phab ntsa lossis tsim kom sawv ntsug zoo.

Tab sis qhov ntawd tsis yog tag nrho! Lub Suab Sib Txuas Sib Tham Satellite Kit yuav nthuav koj lub hauv paus chaw nres tsheb kom mus txog txhua chav ntawm koj lub tsev thiab tso cai rau koj los cuam tshuam nrog kho vajtse raws li qhov koj tshaj tawm koj cov lus txib!

Cov khoom siv no muaj Raspberry Pi3 B+ board, ReSpeaker 2 -Mics Pi HAT, Grove - Relay, Grove - Kub & Vaum Sensor (SHT31), Hais lus 6 Ohm 2W, MicroSD Card, Lub zog txuas nrog Micro USB txuas, Grove cable x 2, Acrylic Base vaj huam sib luag

Cov Rooj Sib Tham: (Cov Ntsiab Lus los ntawm SNIPS) Cov duab hauv qab no yog cov ntsiab lus ntawm cov khoom sib dhos.

Ntawm no cov khoom sib dhos tau teeb tsa ntawm lub hauv paus vaj huam sib luag.

Tom qab ntawd, txhua qhov khoom siv hluav taws xob tau teeb tsa ntawm lub rooj tsavxwm.

Tom qab ntawd rub lub Acrylic Protective cover rau saum Grove -Relay.

2 ntu no yog siv los ua Cov Khoom rau hauv lub rooj sawv.

Thaum kawg, koj tau npaj ua si nrog Snips.

Cov khoom siv muab ob txoj hauv kev tso rau. Nws tuaj yeem muab tso rau ntawm kab rov tav zoo li sawv ntsug lossis tuaj yeem dai ntawm phab ntsa siv xov hlau lossis xov. Thov ceev faj nrog Relay thaum cov khoom siv tau qhib vim tias qhov ua haujlwm voltage yuav siab.

NCO TSEG: Peb kuj tseem muaj Snips Voice Interaction Satellite Kit uas muaj Raspberry Pi xoom rau ntawm Raspberry Pi 3B+

Kauj Ruam 4: Sib cuam tshuam nrog Snips AI (Txoj Haujlwm Tseem Ceeb)

• Fais cov khoom siv los ntawm lub hwj chim hloov pauv hauv cov khoom siv lossis siv 5V-2A DC adapter nrog Micro USB txuas.
• Cov kauj ruam tom ntej yog teeb tsa tus pab Snips rau hauv Raspberry Pi. Txhawm rau txuag koj lub sijhawm teeb tsa, daim npav MicroSD hauv cov khoom siv tau nthuav tawm nrog cov duab ua haujlwm tau zoo, uas txhais tau tias tus pab Snips tau npaj rau koj cov lus txhais.
• Peb xav qhia koj kom kawm ib qib zuj zus phau ntawv qhia kev teeb tsa los ntawm kev mus xyuas: https://docs.snips.ai/getting-started/quick-start… thiab kawm paub cov cuab yeej sam hauv kab hais kom ua.
• Ua tus pabcuam los ntawm kev hais "Hey-snips", thiab ua raws li cov lus txib:

Koj tuaj yeem pom cov vis dis aus ntawm qhov piv txwv ua ntej teeb tsa hauv Snips Voice Interaction puag pob khoom hauv qab no.

Kauj Ruam 5: Sib cuam tshuam nrog Snips AI (Project AI)

Yog li no nws ua haujlwm li cas. Ua ntej, peb siv cov lus kub los pib Snips paub. Nws nkag siab cov kab lus siv Snips NLU thiab txiav txim siab lub hom phiaj. Tom ntej siv lub hom phiaj, rho tawm cov ntu raws. Nrog rau txoj cai txiav txim, peb ua haujlwm AI cov lus teb nrog rau cov kab lus.

Kauj Ruam 6: Tsim App thiab Nkag Siab

• Tsim Tus Pabcuam. Hauv kuv qhov xwm txheej, Kuv tau tsim tus pabcuam nrog lub npe JARVIS thiab nrog lo lus zais JARVIS.
• Tsim daim ntawv thov tshwj xeeb lossis rau cov pib, siv Daim Ntawv Thov los ntawm lub tsev qiv ntawv.
• Kuv tau tsim Daim Ntawv Thov nrog lub Npe Cov Lus
• Tsim Kev Xav thiab pib qhia AI. Qhov no ua lub luag haujlwm tseem ceeb hauv kev ua rau koj AI muaj zog. Qhia nws nrog txhua qhov ua tau.
• Tsim ib lub qhov los txheeb xyuas cov lus. Muab lub qhov tso rau ntawm kab lus xav tau ntawm kab lus. Rau kuv tus piv txwv, muab lo lus yog lub npe lub npe thiab nws tau hais nrog xiav.
• Thaum nws ua tiav, koj qhov kev cai ASR yuav npaj txhij. Sim nrog cov tswv yim. Peb tuaj yeem pom cov lus teb ntawm koj sab xis, hauv qab tus pabcuam. Qhov no muab rau koj rho tawm ntawm tus nqi nyoos, lub npe lub hom phiaj, thiab lub qhov.
• Txhais qhov qhib nrog ntau tus piv txwv raws li tau hais hauv qab no
• Thaum kawg, Tso koj tus neeg pab cuam kom paub txog koj tus kheej AI.

Kauj Ruam 7: Hlawv Raspbian rau SD Card

Raspbian yog Linux faib kev xaiv khiav ntawm Raspberry Pi. Hauv phau ntawv qhia no, peb yuav siv Lite version, tab sis Desktop version (uas los nrog cov duab ib puag ncig) tuaj yeem siv tau ib yam.

• Rub tawm Etcher thiab nruab nws.
• Txuas tus nyeem daim npav SD nrog daim npav SD sab hauv.
• Qhib Etcher thiab xaiv los ntawm koj lub hard drive Raspberry Pi.img lossis.zip cov ntaub ntawv koj xav sau rau SD daim npav
• Xaiv daim npav SD koj xav sau koj daim duab rau.
• Txheeb xyuas koj cov kev xaiv thiab nyem 'Flash!' pib sau cov ntaub ntawv rau SD daim npav

Txuas lub cuab yeej rau koj lub network

• Pab kom SSH nkag los ntawm kev ntxiv cov ntaub ntawv khoob ssh, rov tso rau ntawm lub hauv paus ntawm lub ntim ntim ntawm koj daim npav SD.
• Ntxig daim npav SD rau hauv Raspberry Pi. Nws yuav khau raj kwv yees li 20 vib nas this. Tam sim no koj yuav tsum muaj SSH nkag mus rau koj li Raspberry Pi. Los ntawm lub neej ntawd, nws lub npe host yuav raspberrypi.local. Hauv koj lub khoos phis tawj, qhib lub qhov rai qhib thiab ntaus cov hauv qab no:

ssh [email protected]

Tus password tsis raug yog raspberry

Kauj Ruam 8: Nruab Snips Platform

Yog tias koj tsis tau ua tiav, teeb tsa Sam Command Line Interface ntawm koj lub computer. Qhib lub davhlau ya nyob twg qhov rai, thiab nkag mus:

sudo npm nruab -g snips -samor npm nruab -g snips -sam // Windows

Nrhiav koj li Raspberry Pi ntawm lub network los ntawm kev khiav:

sam cov khoom siv

Tom ntej no, tsim kev sib txuas rau lub cuab yeej. Koj yuav tau txais kev ceeb toom rau lub cuab yeej username thiab password (lub neej ntawd yog pi thiab raspberry, feem):

sam sib

Tam sim no peb tau npaj rau nruab Snips platform ntawm Raspberry Pi. Sau cov lus txib:

sam pib

Kauj Ruam 9: Kho Kho Vajtse

Sam muab qee cov lus txib kom yooj yim teeb tsa thiab teeb tsa cov khoom siv kho vajtse. Hauv ntu no, peb yuav teeb tsa tus hais lus thiab lub microphone. Nyob ntawm koj qhov teeb tsa, qee qhov kev teeb tsa kev cai yuav tsum tau ua.

sam setup audio

Ntsuas tus neeg hais lus

Txhawm rau txheeb xyuas tus neeg hais lus ua haujlwm, khiav

sam xeem hais lus

Yog tias txhua yam ua haujlwm tau zoo, koj yuav tsum hnov ntawm koj tus neeg hais lus lub suab hais ob peb lo lus. Kho lub microphone Koj tuaj yeem tshawb xyuas tias koj lub microphone ua haujlwm li cas:

sam sim microphone

Piv txwv tias koj muaj tus hais lus, yog tias koj tuaj yeem hnov qhov koj nyuam qhuav hais, koj tuaj yeem txav mus yam tsis muaj teeb tsa lub microphone ntxiv.

Thaum koj txaus siab tias koj lub khoos phis tawj teeb tsa ua haujlwm, koj npaj tau txav mus rau qib tom ntej, qhov uas koj yuav tso koj thawj tus pabcuam.

Kauj Ruam 10: Ntshuam AI Qauv Los Ntawm Console

Thaum koj tau tsim koj tus pabcuam los ntawm cov kauj ruam dhau los, nkag mus rau lub console los ntawm lub qhov rai davhlau ya nyob twg los ntawm kev khiav:

sam login

Koj yuav raug nug kom nkag mus rau koj li Snips Console daim ntawv pov thawj.

Tom ntej no, teeb tsa tus pabcuam:

sam nruab pab

Yog tias koj tau tsim ntau tus pab hauv Console, koj yuav raug nug kom xaiv qhov twg los teeb tsa los ntawm cov npe.

Kauj Ruam 11: Tus Neeg Ua Haujlwm & Txoj Cai Ua

Txhawm rau Raspberry Pi teb, peb yuav tau sau qee tus lis dej num. Nov yog tus lej uas ua tiav thaum muaj qee qhov xwm txheej tshwm sim ntawm Snips platform, xws li thaum lub hom phiaj tau raug kuaj pom.

Koj muaj ntau txoj hauv kev los tsim Handler nyob ntawm qhov ua haujlwm.

Tsim daim nplaub tshev ntawm koj lub computer uas koj xav khaws koj tus lej tswj hwm. Los ntawm lub davhlau ya nyob twg qhov rai, hloov mus rau phau ntawv ntawd, thiab nkag mus:

npm pib

Qhov no yuav tsim cov ntaub ntawv npe hu ua package.json uas muaj koj li haujlwm piav qhia, kev vam khom thiab ntau ntxiv. Tom ntej no, ntxiv mqtt pob kev vam khom:

npm nruab mqtt --save

Tam sim no, tsim cov ntaub ntawv hu ua index.js, thiab muab cov cai hauv qab no, hloov pauv lub npe hostname sib txawv nrog lub hostname ntawm koj tus Raspberry Pi (yog tias nws txawv ntawm qhov pib raspberrypi):

var mqtt = xav tau ('mqtt');

var hostname = "mqtt: //raspberrypi.local"; var tus neeg siv = mqtt.connect (hostname); client.on ('txuas', ua haujlwm () {console.log ("[Snips Log] Txuas nrog MQTT broker" + hostname); client.subscribe ('hermes/#');}); client.on ('lus', ua haujlwm (ncauj lus, lus) {yog (lub ncauj lus === "hermes/asr/startListening") {onListeningStateChanged (tseeb);} ntxiv yog (npe === "hermes/asr/stopListening") {onListeningStateChanged (cuav);} lwm qhov yog (topic.match (/hermes \/hotword / /.+ \/kuaj/g)! == null) {onHotwordDetected ()} ntxiv yog (topic.match (/hermes / /intent\/.+/g)! == null) {onIntentDetected (JSON.parse (message));}}); muaj nuj nqi onIntentDetected (txhob txwm) {console.log ("[Snips Log] Lub siab xav pom:" + JSON.stringify (txhob txwm)); } muaj nuj nqi onHotwordDetected () {console.log ("[Snips Log] Hotword kuaj pom"); } muaj nuj nqi onListeningStateChanged (mloog) {console.log ("[Snips Log]" + (mloog? "Pib": "Nres") + "mloog"); }

Khiav cov cai no siv Node:

node index.js

Koj yuav tsum pom cov lus ntawm kev sib txuas tau zoo rau Snips MQTT broker. Raws li ua ntej, ua lub suab sib cuam tshuam nrog koj li Raspberry Pi:

Hav Snips, huab cua hauv Chennai yog dab tsi?

Koj yuav tsum pom cov cav hloov kho tshiab:

[Snips Log] Txuas nrog MQTT broker mqtt: //raspberrypi.local

[Snips Log] Tshawb nrhiav lo lus tseem ceeb [Snips Log] Pib mloog [Snips Log] Nres mloog [Snips Log] Lub siab xav pom: {"sessionId": "c84b5aa5-3f14-4218-975e-8872b9217933", "customData": null, "siteId ":" default "," input ":" huab cua hauv chennai "," txhob txwm ": {" intentName ":" searchWeatherForecast "," probability ": 0.73845243}," slots ": [{" rawValue ":" chennai "," value ": {" kind ":" Custom "," value ":" Chennai "}," range ": {" start ": 44," end ": 53}," entity ":" locality ", "slotName": "forecast_locality"}]}

Kauj ruam 12: Troubleshooting

Rho tawm tus pabcuam yav dhau los yog tias muaj

$ sudo rm -rf/usr/qhia tawm/snips/pab/

Txhawm rau hloov cov npe rau Tus Pabcuam

cd/var/lib/snips/txuj ci/

Txhawm rau Clone cov ntsiab lus ntawm repo rau hauv zos

clit ua

Txhawm rau teeb tsa setup.sh tsab ntawv

./setup.sh

Qhib virtual ib puag ncig

qhov chaw venv/bin/qhib

Khiav qhov kev txiav txim

./action-.py

Txhawm rau tso cai rau Python Script

chmod +x ua-.py

Kauj Ruam 13: Cov ntaub ntawv kaw

• Kuv tau siv tus lej IP ntsuas rau qhov haujlwm no
• Ua ntej tshaj, Kuv tau tsim qhov tsim nyog txhawm rau txhawm rau txhim kho cov khoom siv hluav taws xob & qhov qhib rau Lub hwj chim qaum thiab HDMI cable.
• Tom qab ntawd kuv tso tag nrho Raspberry Pi sab hauv lub thawv thiab ntsia nws kom khov kho.
• Kuv tau qhib qhov me me rau Tus Hais Lus thiab Microphone thiab npog nws siv daim me me ntawm daim ntawv acrylic.
• Txuas tus neeg hais lus rau lub kaus mom ReSpeaker.
• Thaum kawg, tag nrho cov ntsia hlau tau khov kho thiab txuas lub zog txuas los ntawm lub qhov.
• Nov yog qhov AI zoo li cas thaum kawg: D

Kauj Ruam 14: Ua haujlwm ntawm AI

Koj tuaj yeem pom cov ntaub ntawv uas tau saib xyuas siv Snips-watch

Tam sim no nws yog lub sijhawm ua yeeb yam. Kuv pib ua nrog Kev Txais Tos Yooj Yim AI. Ua tibzoo saib nws Ua Haujlwm Li Cas.

Tus Kws Qhia Ntawv AI tau ua haujlwm rau cov lus txwv. Qhov no tuaj yeem txuas ntxiv nrog kev hloov kho me ntsis. Qhov no pab Cov Tub Ntxhais Kawm kom cim lub ntsiab lus sai dua li txoj hauv kev ib txwm muaj.

Ua tib zoo mloog: Txoj haujlwm no tau kawm rau 25 lo lus kwv yees. Nws tuaj yeem nthuav dav ntxiv los ntawm kev hloov kho me me hauv cov cai ua.

Koj tuaj yeem pom Cov Ntawv Sau Ua Haujlwm ntawm kuv Github Cov Chaw Cia Khoom txuas nrog.

Project Repo rau Txais tos AI-https://github.com/Rahul24-06/Greetings_Assistant-TTS

Project Repo rau Tus Kws Qhia Ntawv AI-https://github.com/Rahul24-06/Personal-English-Trainer---TTS

Txuas rau Kuv daim ntawv thov:

Kev teeb tsa tag nrho tus nqi kwv yees li $ 115 uas tuaj yeem yuav los ntawm SNIPS thiab cov kev daws teeb meem no pheej yig heev thiab muaj txiaj ntsig zoo thaum piv rau cov txheej txheem ib txwm muaj. Kwv yees ntau dua 100, 000 qhov kev sim raug coj los hauv Is Nrias teb thiab Cov khoom no yuav yog qhov zoo tshaj ntxiv rau cov neeg siv GRE.

Muab tus ntiv tes xoo yog tias nws tau pab koj tiag tiag thiab ua raws kuv li channel rau cov phiaj xwm txaus nyiam.:) Qhia tawm daim vis dis aus no yog koj nyiam. Zoo siab uas koj tau sau npe: https://console.snips.ai/store/en/skill_xBKlxnE5K… Ua tsaug rau kev nyeem!