{"id":26386,"date":"2020-10-04T12:00:07","date_gmt":"2020-10-04T12:00:07","guid":{"rendered":"http:\/\/routenote.com\/blog\/?p=26386"},"modified":"2020-10-02T17:19:57","modified_gmt":"2020-10-02T17:19:57","slug":"turn-any-sound-into-an-instrument-with-googles-tone-transfer-magenta-project","status":"publish","type":"post","link":"https:\/\/routenote.com\/blog\/turn-any-sound-into-an-instrument-with-googles-tone-transfer-magenta-project\/","title":{"rendered":"Turn any sound into an instrument with Google&#8217;s Tone Transfer Magenta project"},"content":{"rendered":"\n<h4 style=\"user-select: auto;\"><span style=\"color: #3366ff; user-select: auto;\">Google&#8217;s latest Magenta project uses machine learning to take any inputted sound and convincingly output as a chosen instrument.<\/span><\/h4>\n\n\n\n<p><a style=\"user-select: auto;\" href=\"https:\/\/routenote.com\/blog\/google-magentas-lo-fi-player-is-your-customisable-hip-hop-beats-producer\/\">Google&#8217;s Magenta projects use machine learning to create art and music,<\/a> while providing open source data for all to use and learn. <a href=\"https:\/\/sites.research.google\/tonetransfer\">Tone Transfer<\/a> is no different, <a style=\"user-select: auto;\" href=\"https:\/\/magenta.tensorflow.org\/ddsp\">using DDSP<\/a> to convert sounds into musical instruments. DDSP learns characteristics of a musical instrument and maps them to different sounds.<\/p>\n\n\n\n<p>Play with the sample sounds or record your own music instruments, vocal performances or sound effects to accurately hear what they would sound like performed on flute, saxophone, trumpet or violin. For example turn your acapella into a saxophone solo or dog barking into a trumpet performance. You can then mix the original recording with the machine learned output.<\/p>\n\n\n\n<p>Tone Transfer could be a great way to add some new instruments into your mix without sequencing, thus still retaining a real &#8220;recorded&#8221; element. <a style=\"user-select: auto;\" href=\"https:\/\/sites.research.google\/tonetransfer\">Explore, create and input your new musical instrument into your next big project.<\/a><\/p>\n\n\n\n<p>Google worked with five artists including Gabriel Garzon-Montano, Andrew Huang, Mija, Adam Taylor and Tems to turn their instrumental performances into machine learning models:<\/p>\n\n\n\n<figure class=\"wp-block-embed-youtube wp-block-embed is-type-video is-provider-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"Turning everyday sounds into music with Tone Transfer\" width=\"720\" height=\"405\" src=\"https:\/\/www.youtube.com\/embed\/bXBliLjImio?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture\" allowfullscreen><\/iframe>\n<\/div><\/figure>\n\n\n\n<blockquote class=\"wp-block-quote\"><p>This development is important because it enables music technologies to become more inclusive. Machine learning models inherit biases from the datasets they are trained on, and music models are no different. Many are trained on the structure of western musical scores, which excludes much of the music from the rest of the world. Rather than following the formal rules of western music, like the 12 notes on a piano, DDSP transforms sound by modeling frequencies in the audio itself. This opens up machine learning technologies to a wider range of musical cultures.<\/p><cite><a href=\"https:\/\/blog.google\/technology\/ai\/what-if-you-could-turn-your-voice-any-instrument\/\">Nida Zada &#8211; UX Lead, Google Research<\/a><\/cite><\/blockquote>\n\n\n\n<p><a style=\"user-select: auto;\" href=\"https:\/\/sites.research.google\/tonetransfer\">Find Google&#8217;s write-up on exactly how the model works here.<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Google&#8217;s latest Magenta project uses machine learning to take any inputted sound and convincingly output as a chosen instrument. Google&#8217;s Magenta projects use machine learning to create art and music, while providing open source data for all to use and learn. Tone Transfer is no different, using DDSP to convert sounds into musical instruments. DDSP learns characteristics of a musical instrument and maps them to different sounds. Play with the sample sounds or record your own music instruments, vocal performances or sound effects to accurately hear what they would sound like performed on flute, saxophone, trumpet or violin. For example&#8230;<\/p>\n","protected":false},"author":9,"featured_media":26387,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[8614],"tags":[17620,774,16850,2327,7597,17618,7114,17619,17617],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v18.4.1 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Turn any sound into an instrument with Google&#039;s Tone Transfer Magenta project - RouteNote Blog<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/routenote.com\/blog\/turn-any-sound-into-an-instrument-with-googles-tone-transfer-magenta-project\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Turn any sound into an instrument with Google&#039;s Tone Transfer Magenta project - RouteNote Blog\" \/>\n<meta property=\"og:description\" content=\"Google&#8217;s latest Magenta project uses machine learning to take any inputted sound and convincingly output as a chosen instrument. Google&#8217;s Magenta projects use machine learning to create art and music, while providing open source data for all to use and learn. Tone Transfer is no different, using DDSP to convert sounds into musical instruments. DDSP learns characteristics of a musical instrument and maps them to different sounds. Play with the sample sounds or record your own music instruments, vocal performances or sound effects to accurately hear what they would sound like performed on flute, saxophone, trumpet or violin. For example...\" \/>\n<meta property=\"og:url\" content=\"https:\/\/routenote.com\/blog\/turn-any-sound-into-an-instrument-with-googles-tone-transfer-magenta-project\/\" \/>\n<meta property=\"og:site_name\" content=\"RouteNote Blog\" \/>\n<meta property=\"article:published_time\" content=\"2020-10-04T12:00:07+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2020-10-02T17:19:57+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/routenote.com\/blog\/wp-content\/uploads\/2020\/10\/maxresdefault.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1280\" \/>\n\t<meta property=\"og:image:height\" content=\"720\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Tom Newman\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"1 minute\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Organization\",\"@id\":\"https:\/\/routenote.com\/blog\/#organization\",\"name\":\"RouteNote\",\"url\":\"https:\/\/routenote.com\/blog\/\",\"sameAs\":[],\"logo\":{\"@type\":\"ImageObject\",\"@id\":\"https:\/\/routenote.com\/blog\/#logo\",\"inLanguage\":\"en-US\",\"url\":\"https:\/\/routenote.com\/blog\/wp-content\/uploads\/2020\/11\/routenote-logo.jpg\",\"contentUrl\":\"https:\/\/routenote.com\/blog\/wp-content\/uploads\/2020\/11\/routenote-logo.jpg\",\"width\":1000,\"height\":1000,\"caption\":\"RouteNote\"},\"image\":{\"@id\":\"https:\/\/routenote.com\/blog\/#logo\"}},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/routenote.com\/blog\/#website\",\"url\":\"https:\/\/routenote.com\/blog\/\",\"name\":\"RouteNote Blog\",\"description\":\"The World of Digital Music - Distribution - Stores and Free Music\",\"publisher\":{\"@id\":\"https:\/\/routenote.com\/blog\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/routenote.com\/blog\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"ImageObject\",\"@id\":\"https:\/\/routenote.com\/blog\/turn-any-sound-into-an-instrument-with-googles-tone-transfer-magenta-project\/#primaryimage\",\"inLanguage\":\"en-US\",\"url\":\"https:\/\/routenote.com\/blog\/wp-content\/uploads\/2020\/10\/maxresdefault.jpg\",\"contentUrl\":\"https:\/\/routenote.com\/blog\/wp-content\/uploads\/2020\/10\/maxresdefault.jpg\",\"width\":1280,\"height\":720,\"caption\":\"Tone Transfer\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/routenote.com\/blog\/turn-any-sound-into-an-instrument-with-googles-tone-transfer-magenta-project\/#webpage\",\"url\":\"https:\/\/routenote.com\/blog\/turn-any-sound-into-an-instrument-with-googles-tone-transfer-magenta-project\/\",\"name\":\"Turn any sound into an instrument with Google's Tone Transfer Magenta project - RouteNote Blog\",\"isPartOf\":{\"@id\":\"https:\/\/routenote.com\/blog\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/routenote.com\/blog\/turn-any-sound-into-an-instrument-with-googles-tone-transfer-magenta-project\/#primaryimage\"},\"datePublished\":\"2020-10-04T12:00:07+00:00\",\"dateModified\":\"2020-10-02T17:19:57+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/routenote.com\/blog\/turn-any-sound-into-an-instrument-with-googles-tone-transfer-magenta-project\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/routenote.com\/blog\/turn-any-sound-into-an-instrument-with-googles-tone-transfer-magenta-project\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/routenote.com\/blog\/turn-any-sound-into-an-instrument-with-googles-tone-transfer-magenta-project\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/routenote.com\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Turn any sound into an instrument with Google&#8217;s Tone Transfer Magenta project\"}]},{\"@type\":\"Article\",\"@id\":\"https:\/\/routenote.com\/blog\/turn-any-sound-into-an-instrument-with-googles-tone-transfer-magenta-project\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/routenote.com\/blog\/turn-any-sound-into-an-instrument-with-googles-tone-transfer-magenta-project\/#webpage\"},\"author\":{\"@id\":\"https:\/\/routenote.com\/blog\/#\/schema\/person\/c60547d8a210a794c037e6b1450a9626\"},\"headline\":\"Turn any sound into an instrument with Google&#8217;s Tone Transfer Magenta project\",\"datePublished\":\"2020-10-04T12:00:07+00:00\",\"dateModified\":\"2020-10-02T17:19:57+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/routenote.com\/blog\/turn-any-sound-into-an-instrument-with-googles-tone-transfer-magenta-project\/#webpage\"},\"wordCount\":311,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\/\/routenote.com\/blog\/#organization\"},\"image\":{\"@id\":\"https:\/\/routenote.com\/blog\/turn-any-sound-into-an-instrument-with-googles-tone-transfer-magenta-project\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/routenote.com\/blog\/wp-content\/uploads\/2020\/10\/maxresdefault.jpg\",\"keywords\":[\"DDSP\",\"google\",\"Google Magenta\",\"instruments\",\"machine learning\",\"ML\",\"project\",\"record sound\",\"Tone Transfer\"],\"articleSection\":[\"Fun\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/routenote.com\/blog\/turn-any-sound-into-an-instrument-with-googles-tone-transfer-magenta-project\/#respond\"]}]},{\"@type\":\"Person\",\"@id\":\"https:\/\/routenote.com\/blog\/#\/schema\/person\/c60547d8a210a794c037e6b1450a9626\",\"name\":\"Tom Newman\",\"image\":{\"@type\":\"ImageObject\",\"@id\":\"https:\/\/routenote.com\/blog\/#personlogo\",\"inLanguage\":\"en-US\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/5da7d72f206ebde5e8c57869795c438f?s=96&d=blank&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/5da7d72f206ebde5e8c57869795c438f?s=96&d=blank&r=g\",\"caption\":\"Tom Newman\"},\"sameAs\":[\"https:\/\/routenote.com\/blog\/author\/tom\/\",\"https:\/\/www.instagram.com\/tomnew1000\/\",\"https:\/\/www.linkedin.com\/in\/tomnewman3\"],\"url\":\"https:\/\/routenote.com\/blog\/author\/tom\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Turn any sound into an instrument with Google's Tone Transfer Magenta project - RouteNote Blog","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/routenote.com\/blog\/turn-any-sound-into-an-instrument-with-googles-tone-transfer-magenta-project\/","og_locale":"en_US","og_type":"article","og_title":"Turn any sound into an instrument with Google's Tone Transfer Magenta project - RouteNote Blog","og_description":"Google&#8217;s latest Magenta project uses machine learning to take any inputted sound and convincingly output as a chosen instrument. Google&#8217;s Magenta projects use machine learning to create art and music, while providing open source data for all to use and learn. Tone Transfer is no different, using DDSP to convert sounds into musical instruments. DDSP learns characteristics of a musical instrument and maps them to different sounds. Play with the sample sounds or record your own music instruments, vocal performances or sound effects to accurately hear what they would sound like performed on flute, saxophone, trumpet or violin. For example...","og_url":"https:\/\/routenote.com\/blog\/turn-any-sound-into-an-instrument-with-googles-tone-transfer-magenta-project\/","og_site_name":"RouteNote Blog","article_published_time":"2020-10-04T12:00:07+00:00","article_modified_time":"2020-10-02T17:19:57+00:00","og_image":[{"width":1280,"height":720,"url":"https:\/\/routenote.com\/blog\/wp-content\/uploads\/2020\/10\/maxresdefault.jpg","type":"image\/jpeg"}],"twitter_card":"summary_large_image","twitter_misc":{"Written by":"Tom Newman","Est. reading time":"1 minute"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Organization","@id":"https:\/\/routenote.com\/blog\/#organization","name":"RouteNote","url":"https:\/\/routenote.com\/blog\/","sameAs":[],"logo":{"@type":"ImageObject","@id":"https:\/\/routenote.com\/blog\/#logo","inLanguage":"en-US","url":"https:\/\/routenote.com\/blog\/wp-content\/uploads\/2020\/11\/routenote-logo.jpg","contentUrl":"https:\/\/routenote.com\/blog\/wp-content\/uploads\/2020\/11\/routenote-logo.jpg","width":1000,"height":1000,"caption":"RouteNote"},"image":{"@id":"https:\/\/routenote.com\/blog\/#logo"}},{"@type":"WebSite","@id":"https:\/\/routenote.com\/blog\/#website","url":"https:\/\/routenote.com\/blog\/","name":"RouteNote Blog","description":"The World of Digital Music - Distribution - Stores and Free Music","publisher":{"@id":"https:\/\/routenote.com\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/routenote.com\/blog\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"ImageObject","@id":"https:\/\/routenote.com\/blog\/turn-any-sound-into-an-instrument-with-googles-tone-transfer-magenta-project\/#primaryimage","inLanguage":"en-US","url":"https:\/\/routenote.com\/blog\/wp-content\/uploads\/2020\/10\/maxresdefault.jpg","contentUrl":"https:\/\/routenote.com\/blog\/wp-content\/uploads\/2020\/10\/maxresdefault.jpg","width":1280,"height":720,"caption":"Tone Transfer"},{"@type":"WebPage","@id":"https:\/\/routenote.com\/blog\/turn-any-sound-into-an-instrument-with-googles-tone-transfer-magenta-project\/#webpage","url":"https:\/\/routenote.com\/blog\/turn-any-sound-into-an-instrument-with-googles-tone-transfer-magenta-project\/","name":"Turn any sound into an instrument with Google's Tone Transfer Magenta project - RouteNote Blog","isPartOf":{"@id":"https:\/\/routenote.com\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/routenote.com\/blog\/turn-any-sound-into-an-instrument-with-googles-tone-transfer-magenta-project\/#primaryimage"},"datePublished":"2020-10-04T12:00:07+00:00","dateModified":"2020-10-02T17:19:57+00:00","breadcrumb":{"@id":"https:\/\/routenote.com\/blog\/turn-any-sound-into-an-instrument-with-googles-tone-transfer-magenta-project\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/routenote.com\/blog\/turn-any-sound-into-an-instrument-with-googles-tone-transfer-magenta-project\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/routenote.com\/blog\/turn-any-sound-into-an-instrument-with-googles-tone-transfer-magenta-project\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/routenote.com\/blog\/"},{"@type":"ListItem","position":2,"name":"Turn any sound into an instrument with Google&#8217;s Tone Transfer Magenta project"}]},{"@type":"Article","@id":"https:\/\/routenote.com\/blog\/turn-any-sound-into-an-instrument-with-googles-tone-transfer-magenta-project\/#article","isPartOf":{"@id":"https:\/\/routenote.com\/blog\/turn-any-sound-into-an-instrument-with-googles-tone-transfer-magenta-project\/#webpage"},"author":{"@id":"https:\/\/routenote.com\/blog\/#\/schema\/person\/c60547d8a210a794c037e6b1450a9626"},"headline":"Turn any sound into an instrument with Google&#8217;s Tone Transfer Magenta project","datePublished":"2020-10-04T12:00:07+00:00","dateModified":"2020-10-02T17:19:57+00:00","mainEntityOfPage":{"@id":"https:\/\/routenote.com\/blog\/turn-any-sound-into-an-instrument-with-googles-tone-transfer-magenta-project\/#webpage"},"wordCount":311,"commentCount":0,"publisher":{"@id":"https:\/\/routenote.com\/blog\/#organization"},"image":{"@id":"https:\/\/routenote.com\/blog\/turn-any-sound-into-an-instrument-with-googles-tone-transfer-magenta-project\/#primaryimage"},"thumbnailUrl":"https:\/\/routenote.com\/blog\/wp-content\/uploads\/2020\/10\/maxresdefault.jpg","keywords":["DDSP","google","Google Magenta","instruments","machine learning","ML","project","record sound","Tone Transfer"],"articleSection":["Fun"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/routenote.com\/blog\/turn-any-sound-into-an-instrument-with-googles-tone-transfer-magenta-project\/#respond"]}]},{"@type":"Person","@id":"https:\/\/routenote.com\/blog\/#\/schema\/person\/c60547d8a210a794c037e6b1450a9626","name":"Tom Newman","image":{"@type":"ImageObject","@id":"https:\/\/routenote.com\/blog\/#personlogo","inLanguage":"en-US","url":"https:\/\/secure.gravatar.com\/avatar\/5da7d72f206ebde5e8c57869795c438f?s=96&d=blank&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/5da7d72f206ebde5e8c57869795c438f?s=96&d=blank&r=g","caption":"Tom Newman"},"sameAs":["https:\/\/routenote.com\/blog\/author\/tom\/","https:\/\/www.instagram.com\/tomnew1000\/","https:\/\/www.linkedin.com\/in\/tomnewman3"],"url":"https:\/\/routenote.com\/blog\/author\/tom\/"}]}},"jetpack_featured_media_url":"https:\/\/routenote.com\/blog\/wp-content\/uploads\/2020\/10\/maxresdefault.jpg","_links":{"self":[{"href":"https:\/\/routenote.com\/blog\/wp-json\/wp\/v2\/posts\/26386"}],"collection":[{"href":"https:\/\/routenote.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/routenote.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/routenote.com\/blog\/wp-json\/wp\/v2\/users\/9"}],"replies":[{"embeddable":true,"href":"https:\/\/routenote.com\/blog\/wp-json\/wp\/v2\/comments?post=26386"}],"version-history":[{"count":0,"href":"https:\/\/routenote.com\/blog\/wp-json\/wp\/v2\/posts\/26386\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/routenote.com\/blog\/wp-json\/wp\/v2\/media\/26387"}],"wp:attachment":[{"href":"https:\/\/routenote.com\/blog\/wp-json\/wp\/v2\/media?parent=26386"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/routenote.com\/blog\/wp-json\/wp\/v2\/categories?post=26386"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/routenote.com\/blog\/wp-json\/wp\/v2\/tags?post=26386"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}