{"id":2884,"date":"2022-06-19T15:15:11","date_gmt":"2022-06-19T06:15:11","guid":{"rendered":"https:\/\/www.codedojo.com\/?p=2884"},"modified":"2022-07-17T13:53:09","modified_gmt":"2022-07-17T04:53:09","slug":"more-dall%c2%b7e-2-fun-replacing-things-in-existing-photos","status":"publish","type":"post","link":"https:\/\/www.codedojo.com\/?p=2884","title":{"rendered":"More DALL\u00b7E 2 fun – replacing things in existing photos"},"content":{"rendered":"\n

Inpainting tests<\/h2>\n\n\n\n

Inpainting is a technique where you start with a picture (in this case me) and ask the AI to replace a specific part of it. My first test was to try to add a second nose to myself, so I could smell things better. (All pictures\/modifications created with OpenAI’s DALL\u00b7E 2 – all “original” pics used for inpainting are owned by me)<\/p>\n\n\n\n

\"\"
“Man with second nose growing out of forehead”<\/figcaption><\/figure>\n\n\n\n

<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

Um, not what I was going for.<\/p>\n\n\n\n

Let’s stay away from the face and try to change Akiko’s dress. I use the brush to remove the area below her neck, slightly larger than the area of her dress.<\/p>\n\n\n\n

\"\"
“A beautiful elegant blue dress”<\/figcaption><\/figure>\n\n\n\n

Incredible. It also filled in small parts of the person\/stroller that is out of focus behind her as needed.<\/p>\n\n\n\n

\"\"
Retro actively changing clothes in any picture? Useful.<\/figcaption><\/figure>\n\n\n\n

Another test. We’ll replace my son’s baseball glove with a pizza.<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

These results aren’t as convincing (I should have given it more arm to replace for a more natural pose I think), but I do appreciate how it was able to add missing detail to his hair after the glove was removed.<\/p>\n\n\n\n

Well, you know what I have to do… <\/p>\n\n\n\n

\"\"
“Extremely muscled handsome man without a shirt”<\/figcaption><\/figure>\n\n\n\n
\"\"<\/figure>\n\n\n\n

Hmm. Not great. I guess changing my body into one with muscles is just one step too far for today’s technology. My guess is Dall-e actually doesn’t know much about bare skin (nipples and belly button seem to be missing?) due to using a censored training set to stop it from.. well, doing certain things. I’ll bet a suit works better, let’s try that.<\/p>\n\n\n\n

\"\"
“Three people wearing classy colorful suits.”<\/figcaption><\/figure>\n\n\n\n
\"\"<\/figure>\n\n\n\n

This time I did all three of us is one go. Not perfect – I wonder if it would work better if I did it in three separate operations, one for each person? Hrm. If you’re curious how I set which areas it could fill, it looked like this:<\/p>\n\n\n\n

\"\"
I left the holding hands in as a constraint for the image created.<\/figcaption><\/figure>\n\n\n\n

Random Dall-e 2 test pictures<\/h2>\n\n\n\n

More random pics with the prompts used, some prompts created by friends.<\/p>\n\n\n\n

\"\"
“pyramid head on late night with conan o\u2019brien”<\/figcaption><\/figure>\n\n\n\n
\"\"
Another try: “Still from silent hill movie, pyramid head on late night with conan o\u2019brien, dramatic lighting”<\/figcaption><\/figure>\n\n\n\n

<\/p>\n\n\n\n

\"\"
“flaming headed monkey holding paperwork”<\/figcaption><\/figure>\n\n\n\n
\"\"
“hot dog being thrown down a hallway”<\/figcaption><\/figure>\n\n\n\n
\"\"<\/figure>\n\n\n\n
\"\"
“winnie the pooh and Confucius in the delorean from back to the future”<\/figcaption><\/figure>\n\n\n\n
\"\"
“Winnie the pooh and Confucius in the DeLorean, a still from the movie back to the future, 4k”<\/figcaption><\/figure>\n\n\n\n
\"\"
“Winnie the pooh fixing the flux capacitor, still from the movie Back To the Future”<\/figcaption><\/figure>\n\n\n\n
\"\"<\/figure>\n","protected":false},"excerpt":{"rendered":"

Inpainting tests Inpainting is a technique where you start with a picture (in this case me) and ask the AI to replace a specific part of it. My first test was to try to add a second nose to myself, so I could smell things better. (All pictures\/modifications created with OpenAI’s DALL\u00b7E 2 – all […]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[35,34,3],"tags":[],"class_list":["post-2884","post","type-post","status-publish","format-standard","hentry","category-ai","category-dalle","category-development"],"_links":{"self":[{"href":"https:\/\/www.codedojo.com\/index.php?rest_route=\/wp\/v2\/posts\/2884","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.codedojo.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.codedojo.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.codedojo.com\/index.php?rest_route=\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.codedojo.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=2884"}],"version-history":[{"count":3,"href":"https:\/\/www.codedojo.com\/index.php?rest_route=\/wp\/v2\/posts\/2884\/revisions"}],"predecessor-version":[{"id":2911,"href":"https:\/\/www.codedojo.com\/index.php?rest_route=\/wp\/v2\/posts\/2884\/revisions\/2911"}],"wp:attachment":[{"href":"https:\/\/www.codedojo.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=2884"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.codedojo.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=2884"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.codedojo.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=2884"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}