Yadda Ake Girman Ƙarfin Ƙirƙirar NPU don Kayayyakin Gani Masu Haɗaka

1. Fahimtar Matsalar Tsarin Ƙarfin NPU Ya Warware

Na'urori da yawa da aka haɗa, gami da robot, kyamarori masu wayo da tashoshin hangen nesa na masana'antu, yanzu suna amfani da NPUs don gudanar da algorithms na hangen nesa na AI. NPU wani yanki ne na kayan aiki a cikin guntu wanda aka keɓe don ƙididdigar AI.

Lokacin zabar guntu, ƙungiyoyi da yawa suna fara duba ƙimar NPU TOPS ɗinsa kuma suna ɗauka cewa lamba mafi girma tana nufin guntu mafi ƙarfi. A aikace, haɓaka samfura yana fuskantar matsaloli guda biyu na yau da kullun:

Na farko shine ƙarancin ƙarfin lissafi. Na'urar tana aiki da ƙarancin saurin firam, bidiyo yana yin stuttering, firam ɗin suna raguwa lokacin da kyamarori da yawa ke aiki a lokaci guda, kuma gane AI na iya gazawa.

Na biyu kuma shine ƙarfin da ya wuce kima. Chip ɗin yana da tsada, yana cinye ƙarin ƙarfi kuma yana samar da zafi mai yawa. Ikon lissafi mara amfani yana rage ribar riba.

Babban abin da ake la'akari da shi a fannin injiniya shi ne, a cikin ayyukan hangen nesa da yawa da aka haɗa, aikin yana iyakance ta hanyar canja wurin hoto, bandwidth na ƙwaƙwalwar ajiya ko sarrafa bayanai na tushen CPU maimakon ƙarfin lissafin NPU.

2. Ka'idoji na Asali da Ma'auni Biyu Masu Muhimmanci

Tsarin lissafi ba ya buƙatar dogon jerin kalmomin fasaha. Rarraba muhimman ra'ayoyi guda biyu yana taimakawa hana ƙayyadaddun guntu su zama masu ɓatarwa.

Adadin TOPS da masu sayar da guntu suka tallata shine aikin lissafin kololuwar ka'ida: matsakaicin ikon sarrafawa da NPU zai iya cimmawa a cikakken kaya a ƙarƙashin yanayin dakin gwaje-gwaje mai kyau. Tsarin samfura yana buƙatar sarari, don haka ba za a iya amfani da aikin kololuwar kai tsaye don girman ba.

Muna amfani da GMAC don tantance nauyin aikin lissafi na samfurin AI. MAC aiki ne na yau da kullun da ke tara abubuwa, kuma GMAC yana wakiltar irin waɗannan ayyuka biliyan ɗaya. Yana auna adadin lissafi a cikin samfurin. Lura cewa GMAC yana auna nauyin aiki, yayin da GMAC/s ke auna yawan aiki. Manyan samfura suna da ƙimar GMAC mafi girma.

Amfani da NPU ba madaidaicin tsari bane. Yana wakiltar rabon ƙarfin NPU da ake amfani da shi don ƙididdigewa mai inganci. Ga hanyoyin sadarwa masu sauƙin juyawa, kamar ƙarshen gaba na VIO ko samfuran gano abubuwa masu sauƙi, masu aiki masu sauƙi da ingantaccen haɓaka guntu na iya samar da amfani na 60%–80%. Samfura waɗanda ke ɗauke da canje-canje masu rikitarwa ko tubalan Transformer na iya buƙatar aiwatar da tayal akai-akai, rage amfani zuwa 20% ko ma ƙasa da haka.

Amfani da ƙayyadadden ƙimar amfani na kashi 40% babban dalili ne na ƙiyasin da ba daidai ba. ƙuduri kuma yana shafar aikin kai tsaye: ninka faɗin da tsayin hoton shigarwar sau huɗu a yankinsa kuma kusan ninka lissafin don samfurin iri ɗaya.

TOPS kawai rufin kayan aiki ne. Fara ƙididdige kimantawa da aikin GMAC na samfurin, kuma daidaita su da ma'auni akan allon haɓakawa. Kada ku zaɓi guntu kawai daga mafi girman aikin ka'idarsa.

3. Bayyana Aikace-aikace Bukatu da Tsarin Kyamara Da yawa

Kafin a kimanta buƙatun lissafi, a tsara nauyin aikin samfurin. Babban bambanci shine ko kyamarori da yawa suna amfani da ƙididdiga masu layi ɗaya ko ƙididdiga masu zagaye-zagaye, domin wannan yana ƙayyade yadda ake haɗa buƙatun lissafin su.

Yanayin layi ɗaya: Duk kyamarori suna gudanar da ƙididdigar AI a lokaci guda, don haka ana ƙara buƙatun lissafin su kai tsaye. Misali, na'urar tsaro mai kyamarori huɗu tana yin gano abu a ainihin lokaci a firam 30 a kowace daƙiƙa akan kowace tasha tana haɗa nauyin dukkan tashoshi huɗu.

Yanayin Raba Lokaci: NPU wata hanya ce ta kayan aiki da aka raba wacce ke sarrafa hotunan kyamara a jere, tana sarrafa tashoshi ɗaya a lokaci guda yayin da tashoshi ke juyawa a layi. Yawancin aiwatar da hangen nesa na kyamarori da yawa akan dandamalin Rockchip RK suna amfani da wannan hanyar.

Tattara waɗannan bayanai yayin da ake ayyana aikin:

Saurin ƙuduri da saurin firam ga kowace kyamara.

Jerin samfuran AI: waɗanne samfura ne ke aiki akan NPU da kuma waɗanne ayyuka bayan sarrafawa ke aiki akan CPU.

Daidaiton ƙididdiga: INT8 babban zaɓi ne ga na'urorin da aka haɗa saboda ingantaccen ingancinsa.

Hanyar jawo hankali: ci gaba da sarrafa AI akan kowane firam, ko aikin da ke haifar da abubuwan da suka faru wanda algorithms masu rikitarwa ke farawa ne kawai lokacin da aka cika yanayin jawo hankali.

Muhimmi: Fitar da samfurin GMAC ta amfani da kayan aiki kamar RKNN ko ONNX Runtime maimakon kimanta shi daga gogewa. Amfani da nauyin babban samfurin YOLO don girman hanyar sadarwa mai sauƙi ta VIO na iya wuce gona da iri da buƙatun lissafi.

MV11 ɗinmu dandamali ne na kwamfuta mai kyamarori huɗu, wanda aka haɗa shi da na'urar hangen nesa da kuma tsarin haɗa hanyoyin sadarwa ta inertial-navigation bisa ga babban aikin Rockchip RK3576. Ya haɗa da TOPS NPU 6 da 4 GB na ƙwaƙwalwar LPDDR4 kuma yana goyan bayan daidaitawar matakin microsecond a tsakanin kyamarori huɗu. Aikace-aikacen da suka dace sun haɗa da gane robot da gano bayanai, VIO, SLAM da tattara bayanai na EGO na kyamarori da yawa. Zai iya zama dandamalin kayan aiki don gwajin jadawalin matakin allo, bandwidth da gwaje-gwajen tashoshi da yawa da aka bayyana a sama. Ana samun samfura don kimanta aikin da wuri, kuma ana iya keɓance cikakkun mafita na hangen nesa don tallafawa tura su. Tuntuɓe mu a [email protected].

4. Takunkumin da ke Sau da yawa Yana Iyakance Aiki Kafin NPU Compute Ya Yi

Yawancin ayyuka suna mai da hankali ne kawai kan NPU TOPS yayin zaɓe, sannan a lokacin da aka gabatar da kwamitin gudanarwa, tsarin ba zai iya ci gaba ba duk da cewa fiye da rabin ƙarfin NPU yana nan. Waɗannan ƙuntatawa sune cikas gama gari a cikin hangen nesa da aka haɗa.

4.1 Bandwidth ɗin ƙwaƙwalwar DDR

A lokacin nazarin AI, NPU tana ci gaba da karanta hotuna da nauyin samfuri daga ƙwaƙwalwa kuma tana rubuta taswirar fasali na matsakaici zuwa ƙwaƙwalwar ajiya. Matsakaicin bandwidth na DDR yana ƙayyade saurin waɗannan canja wurin. Lokacin da bandwidth bai isa ba, har ma NPU mai isasshen ƙarfin lissafi dole ne ta jira bayanai, wanda ke hana haɓaka ƙimar firam. A yawancin ayyukan kyamarori da yawa akan dandamalin RK, matsakaicin bandwidth yana cika yayin da ake amfani da ƙaramin ɓangare na ƙarfin NPU kawai.

4.2 Ƙarfin Ƙwaƙwalwa

Abubuwan da ke adana hotuna, nauyin samfurin AI da taswirar fasali na matsakaici duk suna cinye ƙwaƙwalwa. Amfani da ƙwaƙwalwa yana ƙaruwa sosai lokacin da tashoshi da yawa ke aiki a lokaci guda. Rashin isasshen ƙwaƙwalwar ajiya na iya lalata aikace-aikacen. Na'urorin da aka haɗa gabaɗaya ba su da ƙwaƙwalwar kama-da-wane, don haka yanayin rashin ƙwaƙwalwar ajiya (OOM) na iya sa na'urar ta tsaya.

4.3 Tsarin Gabatar da Hoto na ISP

Hotunan da kyamarori suka ɗauka ba su da inganci suna buƙatar yankewa, ƙara girma da canza launuka da sarari. Wasu shirye-shiryen riga-kafi ana yin su ne ta hanyar kayan aikin ISP, yayin da wasu ke amfani da albarkatun CPU. Samun kyamarori da yawa yana ƙara buƙatar sarrafawa kafin lokaci kuma yana iya haifar da jinkiri a duk faɗin bututun koda lokacin da NPU ba ta aiki.

4.4 Amfani da Wutar Lantarki da Gudanar da Zafi

Mafi girman TOPS na guntu da aka tallata ya yi daidai da yawan amfani da wutar lantarki mafi girma. Yawancin na'urori da aka haɗa ba su da fan kuma ba za su iya ɗaukar cikakken nauyin NPU ba tsawon lokaci. Ko da lokacin da ƙarfin lissafin ka'ida ya yi yawa, yanayin zafi yana iyakance ƙarfin da ake da shi don aiki mai ɗorewa.

4.5 Daidaitawar Mai Aiki

Idan samfurin AI ya ƙunshi masu aiki na musamman waɗanda NPU ba za ta iya hanzartawa ba, suna komawa ga aiwatar da CPU. Tsarin AI akan CPU yana da jinkiri kuma yana iya dakatar da bututun sosai koda lokacin da ƙarfin NPU ya isa. Tabbatar da tallafin haɓaka mai aiki kafin zaɓar dandamali.

5. Tsarin Tsarin Aiki

1. Kafa tushen aiki da yanayin aiki. Bayyana bututun AI: ƙuduri, ƙimar firam, ƙidayar tashoshi, dabarun jawowa (ci gaba ko wanda ke kan taron), aiwatarwa a layi ɗaya ko lokaci, jerin samfura da daidaiton turawa. Kula da yadda aka tsara tashoshi da yawa.

2. Ƙididdige nauyin aiki na samfuri kuma a fitar da GMAC/s. Yi amfani da kayan aiki don fitar da GMAC/s ga kowane samfuri, tare da raba lissafin da aka hanzarta NPU daga CPU bayan sarrafawa.

3. Auna a kan allon manufa don tantance ingancin aiwatarwa. Canza samfura zuwa tsarin dandamali akan SoCs na takara kamar RK3576 ko RK3588. Auna lokacin ƙididdiga a kowane firam don tantance ainihin ƙarfin wannan samfurin akan wannan NPU. Wannan shine mafi mahimmancin mataki don kawar da bambance-bambance a cikin kimantawa na takarda: dole ne a daidaita duk kimantawa akan ma'aunin matakin allo maimakon dabarun gabaɗaya.

4. Tattara ayyukan aiki na tashoshi da yawa kuma a tantance matsalolin tsarin. A tantance duka yanayin aiki na yau da kullun da kuma mafi munin yanayi lokacin da duk tashoshi ke tashi a lokaci guda. A duba bandwidth na DDR da amfani da ƙwaƙwalwar ajiya a lokaci guda. Yawancin kyamarori masu yawa na RK suna nuna bandwidth na fitarwa yayin da ƙarfin lissafi ya kasance akwai.

5. Ajiye wurin zama mai dacewa kuma saita iyaka. Yi amfani da gefe na 1.1–1.2 don samfuran ɗan gajeren lokaci waɗanda ke da tsauraran algorithms, da kuma 1.3–1.4 don samfuran da ake tsammanin za su sami sabuntawar samfura. Ya kamata wurin zama ya rufe juyin halittar samfura, yanayin kololuwa da tsara jadawalin kuɗin da za a kashe maimakon samar da ƙarin kuɗi ba bisa ƙa'ida ba. Saita iyakokin farashin BOM da wutar lantarki a lokaci guda.

6. Matsaloli guda biyar da suka shafi Tsarin Ƙarfin NPU

6.1 Amfani da ƘARIN GIRMA Kawai da Ƙayyadadden Ƙimar Amfani

Yin amfani da ƙayyadadden ƙimar amfani da kashi 40% ga TOPS ɗin da aka tallata zai iya wuce gona da iri kan buƙatun lissafi sau da yawa kuma ya bambanta sosai daga yanayin injiniya na gaske. Amfani ya bambanta sosai a cikin samfura da tsarin NPU.

6.2 Ninkuwa ta hanyar ƙidayar tashoshi da kuma yin watsi da raba lokaci

A cikin aikin da aka raba lokaci, NPU tana sarrafa tashoshi bi da bi kuma ana sake amfani da ƙarfin lissafinta. Kawai ninka adadin tashoshi ta hanyar buƙatar lissafin tashoshi ɗaya na iya wuce gona da iri sosai, wanda ke haifar da guntu mai ƙarfi da tsada ba tare da wata matsala ba.

6.3 Kimanta NPU Compute amma Yin watsi da DDR Bandwidth

Matsalolin bandwidth sun fi yawa fiye da ƙididdige matsaloli a ayyukan hangen nesa na kyamarori da yawa. NPU na iya samun isasshen ƙarfin aiki, amma canja wurin bayanai ba zai iya ci gaba ba, wanda ke iyakance ƙimar firam. Dole ne a fara tantance girman bandwidth a ayyukan kyamarori da yawa.

6.4 Idan Aka Yi La'akari da Matsakaicin Nauyi Amma Ba a Yi Watsi da Kololuwar Wucin Gadi ba

Samfuri na iya aiki da ƙarancin kaya a mafi yawan lokuta amma yana fuskantar kololuwar wucin gadi lokacin da duk kyamarori ke kunna AI a lokaci guda. Tsarin dole ne ya dace da waɗannan kololuwar, amma layin aiki na iya daidaita buƙatar wucin gadi, don haka ba lallai ne a auna guntu kai tsaye zuwa ga ƙimar ƙimar mafi girma ba.

6.5 Ƙirgawa Kawai Tsarin Lissafi da Yin Watsi da Tsarin Sama

Kiyasi da yawa suna ƙidaya GMAC na tushen AI kawai kuma suna watsi da sarrafa ISP kafin lokaci, kwafin hoto da kuma bayan sarrafa CPU. Ko da tare da isasshen ƙarfin NPU, waɗannan abubuwan da suka wuce gona da iri suna ƙara jinkirin ƙarshe zuwa ƙarshe kuma suna hana cimma ƙimar firam ɗin da ake tsammani.

7. Jerin Abubuwan da Aka Yi Amfani da Su don Zaɓin Dandalin

Jerin duk sigogin kyamara: ƙuduri, ƙimar firam da adadin tashoshi. Tabbatar ko tashoshi suna amfani da jadawalin lokaci ɗaya ko na lokaci.

Fitar da GMAC ga kowane samfuri kuma ka bambanta lissafin NPU daga CPU bayan sarrafawa.

Auna lokacin da aka yi amfani da samfurin guda ɗaya a kan dandamalin 'yan takara don tabbatar da ingancin aiwatarwa na gaske.

Tattara ayyukan yi na tashoshi da yawa da kuma tantance amfani da NPU a ƙarƙashin yanayi mai kyau da kuma yanayi mafi kyau.

Auna bandwidth na DDR da amfani da ƙwaƙwalwar ajiya don tantance ko bandwidth shine matsala.

Tabbatar da masu aiki da samfuri kuma tabbatar da tallafin hanzarta kayan aikin NPU don guje wa faɗuwar CPU.

Ajiye lissafin headroom bisa ga taswirar sabunta samfurin kuma saita farashin BOM da iyakokin wutar lantarki.

Gudanar da gwaje-gwajen damuwa masu tsawo tare da abubuwan da ke haifar da matsaloli da yawa a lokaci guda. Duba bambancin ƙimar firam da haɗurra da gajiyar ƙwaƙwalwa ke haifarwa.

Girman ƙarfin NPU don hangen nesa da aka haɗa ba aikin lissafi bane mai sauƙi wajen amfani da dabarar TOPS. Kimanta takardu yana ba da kwatancen tsari na farko kawai. Dole ne a yi tantancewa ta ƙarshe akan allon haɓaka guntu da aka yi niyya.

Cikakken kimantawa yana bin wannan jerin: tantance ko lissafi shine gibin → tabbatar da daidaito ko jadawalin lokaci → auna samfurin GMAC → fifita kimanta bandwidth na DDR → daidaita ta hanyar gwajin matakin allo → ajiye ɗakin kwamfuta mai dacewa.

Manufar ita ce a daidaita aiki, amfani da wutar lantarki da kuma farashi. Zaɓi isasshen ƙarfin aiki don aikin maimakon neman mafi girman matakin NPU TOPS.

MV11 ɗinmu dandamali ne na kwamfuta mai kyamarori huɗu, wanda aka haɗa shi da na'urar hangen nesa da kuma tsarin haɗa hanyoyin sadarwa ta inertial-navigation bisa ga babban aikin Rockchip RK3576. Ya haɗa da TOPS NPU 6 da 4 GB na ƙwaƙwalwar LPDDR4 kuma yana goyan bayan daidaitawar matakin microsecond a tsakanin kyamarori huɗu. Aikace-aikacen da suka dace sun haɗa da gane robot da gano bayanai, VIO, SLAM da tattara bayanai na EGO na kyamarori da yawa. Zai iya zama dandamalin kayan aiki don gwajin jadawalin matakin allo, bandwidth da gwaje-gwajen tashoshi da yawa da aka bayyana a sama. Ana samun samfura don kimanta aikin da wuri, kuma ana iya keɓance cikakkun mafita na hangen nesa don tallafawa tura su. Tuntuɓe mu a [email protected].