{"id":1156,"date":"2013-11-18T00:52:15","date_gmt":"2013-11-18T00:52:15","guid":{"rendered":"http:\/\/aaron-sherwood.com\/blog\/?p=1156"},"modified":"2013-11-18T00:52:15","modified_gmt":"2013-11-18T00:52:15","slug":"shapes-as-audio","status":"publish","type":"post","link":"https:\/\/aaron-sherwood.com\/blog\/?p=1156","title":{"rendered":"Shapes as audio"},"content":{"rendered":"<p>In an attempt to translate the visual world into audio I wondered what if the shapes of objects could be contours of a sound wave. As an experiment I took the contour of an oak leaf and turned it into a wave form.<\/p>\n<p>I first found an outline of an oak leaf online then cut it in two:<\/p>\n<p><a href=\"http:\/\/aaron-sherwood.com\/blog\/wp-content\/uploads\/2013\/11\/oakleafside.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-1161\" alt=\"oakleafside\" src=\"http:\/\/aaron-sherwood.com\/blog\/wp-content\/uploads\/2013\/11\/oakleafside.jpg\" width=\"512\" height=\"219\" srcset=\"https:\/\/aaron-sherwood.com\/blog\/wp-content\/uploads\/2013\/11\/oakleafside.jpg 512w, https:\/\/aaron-sherwood.com\/blog\/wp-content\/uploads\/2013\/11\/oakleafside-300x128.jpg 300w, https:\/\/aaron-sherwood.com\/blog\/wp-content\/uploads\/2013\/11\/oakleafside-500x213.jpg 500w\" sizes=\"auto, (max-width: 512px) 100vw, 512px\" \/><\/a><\/p>\n<p>Next, using computer vision (openCV in Cinder), I analyzed the image for feature points:<\/p>\n<p><a href=\"http:\/\/aaron-sherwood.com\/blog\/wp-content\/uploads\/2013\/11\/Screen-Shot-2013-11-17-at-4.38.03-PM.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-1157\" alt=\"Screen Shot 2013-11-17 at 4.38.03 PM\" src=\"http:\/\/aaron-sherwood.com\/blog\/wp-content\/uploads\/2013\/11\/Screen-Shot-2013-11-17-at-4.38.03-PM.png\" width=\"511\" height=\"219\" srcset=\"https:\/\/aaron-sherwood.com\/blog\/wp-content\/uploads\/2013\/11\/Screen-Shot-2013-11-17-at-4.38.03-PM.png 511w, https:\/\/aaron-sherwood.com\/blog\/wp-content\/uploads\/2013\/11\/Screen-Shot-2013-11-17-at-4.38.03-PM-300x128.png 300w, https:\/\/aaron-sherwood.com\/blog\/wp-content\/uploads\/2013\/11\/Screen-Shot-2013-11-17-at-4.38.03-PM-500x214.png 500w\" sizes=\"auto, (max-width: 511px) 100vw, 511px\" \/><\/a><\/p>\n<p>Using javascript I converted these points from a csv into a table that Max\/MSP could use as a waveform. Since some of the points are over\/under each other (and with a waveform you can&#8217;t have more then one value happening at any given point in time) the waveform in max has some interesting\u00a0striations:<\/p>\n<p><a href=\"http:\/\/aaron-sherwood.com\/blog\/wp-content\/uploads\/2013\/11\/Screen-Shot-2013-11-17-at-7.22.26-PM.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-1163\" alt=\"Screen Shot 2013-11-17 at 7.22.26 PM\" src=\"http:\/\/aaron-sherwood.com\/blog\/wp-content\/uploads\/2013\/11\/Screen-Shot-2013-11-17-at-7.22.26-PM.png\" width=\"512\" height=\"258\" srcset=\"https:\/\/aaron-sherwood.com\/blog\/wp-content\/uploads\/2013\/11\/Screen-Shot-2013-11-17-at-7.22.26-PM.png 512w, https:\/\/aaron-sherwood.com\/blog\/wp-content\/uploads\/2013\/11\/Screen-Shot-2013-11-17-at-7.22.26-PM-300x151.png 300w, https:\/\/aaron-sherwood.com\/blog\/wp-content\/uploads\/2013\/11\/Screen-Shot-2013-11-17-at-7.22.26-PM-500x251.png 500w\" sizes=\"auto, (max-width: 512px) 100vw, 512px\" \/><\/a><\/p>\n<p>With an\u00a0oscilloscope the wave coming from the synthesizer\u00a0looks like:<\/p>\n<p><a href=\"http:\/\/aaron-sherwood.com\/blog\/wp-content\/uploads\/2013\/11\/Screen-Shot-2013-11-17-at-4.33.13-PM.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-1159\" alt=\"Screen Shot 2013-11-17 at 4.33.13 PM\" src=\"http:\/\/aaron-sherwood.com\/blog\/wp-content\/uploads\/2013\/11\/Screen-Shot-2013-11-17-at-4.33.13-PM.png\" width=\"407\" height=\"358\" srcset=\"https:\/\/aaron-sherwood.com\/blog\/wp-content\/uploads\/2013\/11\/Screen-Shot-2013-11-17-at-4.33.13-PM.png 407w, https:\/\/aaron-sherwood.com\/blog\/wp-content\/uploads\/2013\/11\/Screen-Shot-2013-11-17-at-4.33.13-PM-300x263.png 300w, https:\/\/aaron-sherwood.com\/blog\/wp-content\/uploads\/2013\/11\/Screen-Shot-2013-11-17-at-4.33.13-PM-341x300.png 341w\" sizes=\"auto, (max-width: 407px) 100vw, 407px\" \/><\/a><\/p>\n<p>It sounds real buzzy:<audio class=\"wp-audio-shortcode\" id=\"audio-1156-1\" preload=\"none\" style=\"width: 100%;\" controls=\"controls\"><source type=\"audio\/wav\" src=\"http:\/\/aaron-sherwood.com\/blog\/wp-content\/uploads\/2013\/11\/oakpulse.wav?_=1\" \/><a href=\"http:\/\/aaron-sherwood.com\/blog\/wp-content\/uploads\/2013\/11\/oakpulse.wav\">http:\/\/aaron-sherwood.com\/blog\/wp-content\/uploads\/2013\/11\/oakpulse.wav<\/a><\/audio><\/p>\n<p>But in layers and with some filtering it can have a nice effect:<audio class=\"wp-audio-shortcode\" id=\"audio-1156-2\" preload=\"none\" style=\"width: 100%;\" controls=\"controls\"><source type=\"audio\/wav\" src=\"http:\/\/aaron-sherwood.com\/blog\/wp-content\/uploads\/2013\/11\/oakLayeredFiltered.wav?_=2\" \/><a href=\"http:\/\/aaron-sherwood.com\/blog\/wp-content\/uploads\/2013\/11\/oakLayeredFiltered.wav\">http:\/\/aaron-sherwood.com\/blog\/wp-content\/uploads\/2013\/11\/oakLayeredFiltered.wav<\/a><\/audio><\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>In an attempt to translate the visual world into audio I wondered what if the shapes of objects could be contours of a sound wave. As an experiment I took the contour of an oak leaf and turned it into &hellip; <a href=\"https:\/\/aaron-sherwood.com\/blog\/?p=1156\">Continue reading <span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[3,76],"tags":[],"class_list":["post-1156","post","type-post","status-publish","format-standard","hentry","category-itp","category-temporaryexpert"],"_links":{"self":[{"href":"https:\/\/aaron-sherwood.com\/blog\/index.php?rest_route=\/wp\/v2\/posts\/1156","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/aaron-sherwood.com\/blog\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/aaron-sherwood.com\/blog\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/aaron-sherwood.com\/blog\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/aaron-sherwood.com\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=1156"}],"version-history":[{"count":17,"href":"https:\/\/aaron-sherwood.com\/blog\/index.php?rest_route=\/wp\/v2\/posts\/1156\/revisions"}],"predecessor-version":[{"id":1181,"href":"https:\/\/aaron-sherwood.com\/blog\/index.php?rest_route=\/wp\/v2\/posts\/1156\/revisions\/1181"}],"wp:attachment":[{"href":"https:\/\/aaron-sherwood.com\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=1156"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/aaron-sherwood.com\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=1156"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/aaron-sherwood.com\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=1156"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}