Iqela le Abaphandi beYunivesithi yaseTel Aviv basanda kuveza i-HyperStyle, oko ikukuthi inguqulelo eguqulweyo yenkqubo yokufunda koomatshini I-NVIDIA StyleGAN2 eye yahlengahlengiswa ukwenza amaqhekeza angekhoyo xa uhlela imifanekiso yehlabathi yokwenyani.
I-StyleGAN ibonakaliswe ngokuvumela ukudibanisa ubuso obutsha babantu ngenkangeleko yokwenyani, ukuseta iiparamitha ezinje ngobudala, isini, ubude beenwele, umlinganiswa woncumo, ukumila kwempumlo, umbala wolusu, iiglasi kunye ne-engile yefoto.
Ngakolunye uhlangothi, I-HyperStyle yenza kube lula ukutshintsha iiparamitha ezifanayo kwezikhoyo, Ngamanye amazwi, ikuvumela ukuba wenze iifoto ngaphandle kokuguqula iimpawu zabo kunye nokugcina ukubonakala kobuso bokuqala.
I-HyperStyle yazisa i-hypernetworks ukufunda indlela yokucokisa iintsimbi zejenereyitha esele iqeqeshiwe ye-StyleGAN xa kuthelekiswa nomfanekiso onikiweyo. Ukwenza njalo kuvumela inqanaba lokukhulisa kwakhona kunye namaxesha anje nge-encoder kunye nokuhleleka okuphezulu.
Umzekelo, xa usebenzisa I-HyperStyle, inokulinganisa utshintsho kwiminyaka yobudala bomntu kwifoto, utshintshe i-hairstyle, yongeza iiglasi, iindevu okanye amadevu, wenze umfanekiso ufane nomlingiswa wekhathuni okanye umfanekiso owenziwe ngesandla, wenze ubuso obudabukisayo okanye obonwabileyo.
Kule meko, Inkqubo inokuqeqeshwa kuphela ukuba itshintshe ubuso babantu, kodwa nayo nayiphi na into, kuba Umzekelo, ukuhlela imifanekiso yemoto.
Uninzi lwemisebenzi ephonononga ukuguqulwa ijonge ikhowudi efihlakeleyo ephinda iphinde iphinde iphinde iphinde icacise umfanekiso onikiweyo. Omnye umsebenzi wakutsha nje wenze isindululo sokulungiswa komfanekiso wobunzima bejenereyitha ukuphumeza ukwakhiwa ngokutsha komgangatho ophakamileyo womfanekiso ekujoliswe kuwo. Nge-HyperStyle, sijonge ukuzisa ezi ndlela zokulungiswa kwejenereyitha kwindawo yezicelo ezisebenzisanayo ngokuziqhelanisa nendlela esekwe kwi-encoder.
Siqeqeshe i-hypernetwork enye ukuze sifunde ukucokisa iintsimbi zejenereyitha xa kuthelekiswa nomfanekiso ofunekayo. Ngokufunda le mephu, i-HyperStyle iqikelela ngokufanelekileyo ubunzima obujoliswe kwijeneretha ngaphantsi kwemizuzwana emi-2 ngomfanekiso ngamnye, iyenza isebenze kuluhlu olubanzi lwezicelo.
Indlela ecetywayo ijolise ekusombululeni ingxaki yokwakhiwa ngokutsha kweendawo ezilahlekileyo zomfanekiso ngexesha lokuhlela. Ubuchule obucetywayo ngaphambili bulungise ulungelelwaniso phakathi kolwakhiwo ngokutsha kunye nokuhlelwa ngokulungisa kakuhle umzobi ukuze athathe indawo yezahlulo zomfanekiso ekujoliswe kuwo ngelixa kuyilwa kwakhona imimandla ehlelekayo ebingekho ekuqaleni. Icala elisezantsi lezo ndlela ziyimfuneko yoqeqesho olujoliswe kwixesha elide lwe-neural network kumfanekiso ngamnye.
Indlela esekwe kwi-algorithm ye-StyleGAN ivumela ukusebenzisa imodeli eqhelekileyo, iqeqeshelwe ukuqokelelwa kwemifanekiso eqhelekileyo, ukuvelisa iimpawu zeempawu zomfanekiso wokuqala kunye nenqanaba lokuzithemba elithelekiseka kwii-algorithms ezifuna uqeqesho lomntu ngamnye lwemodeli yomfanekiso ngamnye.
Enye yeenzuzo zendlela entsha kukukwazi ukuguqula imifanekiso kunye nokusebenza ngokusondeleyo kwixesha langempela, ukongeza kwinto yokuba. imodeli ilungele ukuqeqesha okulungiselelwe abo bantu, iimoto kunye nezilwanyana ezisekelwe kwiiqoqo ukusuka kwi-Flickr-i-Faces-HQ (FFHQ, i-70,000 imifanekiso ye-PNG ephezulu yobuso babantu), Iimoto zaseStanford (imifanekiso ye-16 yeemoto) kunye ne-AFHQ (iifoto zezilwanyana).
Kwakhona, iseti yezixhobo zinikezelwe ukuqeqesha imifuziselo yakhokunye neemodeli ezisele zilungele ukusebenzisa eziqeqeshiweyo zeekhowudi eziqhelekileyo kunye neejenereyitha ezifanelekileyo ukusetyenziswa nazo. Umzekelo, kukho iijeneretha ezikhoyo ekudaleni imifanekiso ye-Toonify-style, abalinganiswa bePixar, ukwenza imizobo, kunye nesimbo esifana namakhosazana eDisney.
Gqibela kwabo banomdla wokwazi ngakumbi Malunga nesi sixhobo, unokujonga iinkcukacha Kule khonkco ilandelayo.
Kwakhona kubalulekile ukukhankanya ukuba ikhowudi ibhalwe kwiPython usebenzisa isakhelo sePyTorch kwaye i-MIT ilayisenisi. Ungajonga ikhowudi apha eli khonkco lilandelayo.