{"id":403,"date":"2019-08-15T18:19:55","date_gmt":"2019-08-15T16:19:55","guid":{"rendered":"https:\/\/futuregadgetlab.de\/?p=403"},"modified":"2019-10-15T17:22:37","modified_gmt":"2019-10-15T15:22:37","slug":"making-ais-out-of-steinsgate-characters","status":"publish","type":"post","link":"https:\/\/futuregadgetlab.de\/index.php\/2019\/08\/15\/making-ais-out-of-steinsgate-characters\/","title":{"rendered":"Making AI&#8217;s out of Steins;Gate characters"},"content":{"rendered":"\n<p>In the past couple of weeks, I&#8217;ve been working on a project to make characters of the visual novel Steins;Gate come to life through AI &#8211; the usage of certain machine learning algorithms. So far, I&#8217;ve looked into GPT-2 (AI\/machine learning model that generates somewhat coherent text) and finetuned the 117M model from OpenAI for GPT-2 to the ingame lines of Faris, Okabe and Kurisu, creating a new model for each character that enables GPT-2 to behave like that character. GPT-2 and the programs to retrain it can be <a href=\"https:\/\/github.com\/nshepperd\/gpt-2\">found on GitHub<\/a>. The models can be tested through a Discord bot, whose <a href=\"https:\/\/github.com\/KaitoCross\/gpt2-discord-bot\">source code is available on GitHub<\/a>. It is currently running on my Discord server. If you&#8217;d like to test it on my Discord server, please send me an email to bot[at]futuregadgetlab.de<\/p>\n\n\n\n<p>There&#8217;s more that can be done. Using Tacotron2, it seems possible that we can create a Text-To-Speech AI that uses the voice we choose and create! It has to be trained on many pairs of text lines &amp; voice recordings of the desired voice. The Steins;Gate visual novel provides these pairs for their characters, making Text to Speech AI, that uses the voice of the ingame character Kurisu possible. <a href=\"https:\/\/github.com\/KaitoCross\/Steins-Prep\/blob\/master\/README.md\">This GitHub project of mine<\/a> roughly outlines how to make the game content readable for GPT-2 and Tacotron2. The text-voice pairs generated for Tacotron2 have to be proofread, proofheard and corrected before training a Tacotron2 model on that dataset. To help do so, I have created <a href=\"https:\/\/github.com\/KaitoCross\/TacoTranscribe\">TacoTranscribe.<\/a> I still have to write a README for it to explain how to use it correctly.<\/p>\n\n\n\n<p>However, since Kurisu has 2,8k text-voice pairs, I ask for your help in proofreading, proofhearing and correcting the pairs. If you&#8217;d like to help, please send me an email to the address above.<br><\/p>\n\n\n\n<p>If we manage to couple the output of a Speech to Text system with GPT-2, and then couple GPT-2&#8217;s output with Tacotron2, we can make a bot that autocompletes your sentences and reads it in a way Kurisu would do.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>In the past couple of weeks, I&#8217;ve been working on a project to make characters of the visual novel Steins;Gate come to life through AI &#8211; the usage of certain machine learning algorithms. So far, I&#8217;ve looked into GPT-2 (AI\/machine learning model that generates somewhat coherent text) and finetuned the 117M model from OpenAI for [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"Call to Action: Making AI's out of Steins;Gate characters - It's theoretically possible. Let's start making one!","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","enabled":false},"version":2}},"categories":[33],"tags":[84,87,85,88,91,90,89,86,7,92,93],"class_list":["post-403","post","type-post","status-publish","format-standard","hentry","category-experiments","tag-amadeus","tag-amadeus-kurisu","tag-artificial-intelligence","tag-bot","tag-discord","tag-gpt-2","tag-kurisu","tag-steinsgate","tag-tacotron2","tag-tts"],"jetpack_publicize_connections":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v23.6 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Making AI&#039;s out of Steins;Gate characters - Future Gadget Laboratory<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/futuregadgetlab.eu\/index.php\/2019\/08\/15\/making-ais-out-of-steinsgate-characters\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Making AI&#039;s out of Steins;Gate characters - Future Gadget Laboratory\" \/>\n<meta property=\"og:description\" content=\"In the past couple of weeks, I&#8217;ve been working on a project to make characters of the visual novel Steins;Gate come to life through AI &#8211; the usage of certain machine learning algorithms. So far, I&#8217;ve looked into GPT-2 (AI\/machine learning model that generates somewhat coherent text) and finetuned the 117M model from OpenAI for [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/futuregadgetlab.eu\/index.php\/2019\/08\/15\/making-ais-out-of-steinsgate-characters\/\" \/>\n<meta property=\"og:site_name\" content=\"Future Gadget Laboratory\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/inukaito.cosplay\/\" \/>\n<meta property=\"article:published_time\" content=\"2019-08-15T16:19:55+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2019-10-15T15:22:37+00:00\" \/>\n<meta name=\"author\" content=\"Daru\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@kaitocross\" \/>\n<meta name=\"twitter:site\" content=\"@kaitocross\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Daru\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/futuregadgetlab.eu\/index.php\/2019\/08\/15\/making-ais-out-of-steinsgate-characters\/\",\"url\":\"https:\/\/futuregadgetlab.eu\/index.php\/2019\/08\/15\/making-ais-out-of-steinsgate-characters\/\",\"name\":\"Making AI's out of Steins;Gate characters - Future Gadget Laboratory\",\"isPartOf\":{\"@id\":\"https:\/\/futuregadgetlab.eu\/#website\"},\"datePublished\":\"2019-08-15T16:19:55+00:00\",\"dateModified\":\"2019-10-15T15:22:37+00:00\",\"author\":{\"@id\":\"https:\/\/futuregadgetlab.eu\/#\/schema\/person\/c9fcc06508b58cb3f618b1b58225b6cf\"},\"breadcrumb\":{\"@id\":\"https:\/\/futuregadgetlab.eu\/index.php\/2019\/08\/15\/making-ais-out-of-steinsgate-characters\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/futuregadgetlab.eu\/index.php\/2019\/08\/15\/making-ais-out-of-steinsgate-characters\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/futuregadgetlab.eu\/index.php\/2019\/08\/15\/making-ais-out-of-steinsgate-characters\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/futuregadgetlab.eu\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Making AI&#8217;s out of Steins;Gate characters\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/futuregadgetlab.eu\/#website\",\"url\":\"https:\/\/futuregadgetlab.eu\/\",\"name\":\"Future Gadget Laboratory\",\"description\":\"Bending  space, time and data\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/futuregadgetlab.eu\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/futuregadgetlab.eu\/#\/schema\/person\/c9fcc06508b58cb3f618b1b58225b6cf\",\"name\":\"Daru\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/futuregadgetlab.eu\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/be62ed8726fcb3326b65b2d6d0cad4fe?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/be62ed8726fcb3326b65b2d6d0cad4fe?s=96&d=mm&r=g\",\"caption\":\"Daru\"}}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Making AI's out of Steins;Gate characters - Future Gadget Laboratory","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/futuregadgetlab.eu\/index.php\/2019\/08\/15\/making-ais-out-of-steinsgate-characters\/","og_locale":"en_US","og_type":"article","og_title":"Making AI's out of Steins;Gate characters - Future Gadget Laboratory","og_description":"In the past couple of weeks, I&#8217;ve been working on a project to make characters of the visual novel Steins;Gate come to life through AI &#8211; the usage of certain machine learning algorithms. So far, I&#8217;ve looked into GPT-2 (AI\/machine learning model that generates somewhat coherent text) and finetuned the 117M model from OpenAI for [&hellip;]","og_url":"https:\/\/futuregadgetlab.eu\/index.php\/2019\/08\/15\/making-ais-out-of-steinsgate-characters\/","og_site_name":"Future Gadget Laboratory","article_publisher":"https:\/\/www.facebook.com\/inukaito.cosplay\/","article_published_time":"2019-08-15T16:19:55+00:00","article_modified_time":"2019-10-15T15:22:37+00:00","author":"Daru","twitter_card":"summary_large_image","twitter_creator":"@kaitocross","twitter_site":"@kaitocross","twitter_misc":{"Written by":"Daru","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/futuregadgetlab.eu\/index.php\/2019\/08\/15\/making-ais-out-of-steinsgate-characters\/","url":"https:\/\/futuregadgetlab.eu\/index.php\/2019\/08\/15\/making-ais-out-of-steinsgate-characters\/","name":"Making AI's out of Steins;Gate characters - Future Gadget Laboratory","isPartOf":{"@id":"https:\/\/futuregadgetlab.eu\/#website"},"datePublished":"2019-08-15T16:19:55+00:00","dateModified":"2019-10-15T15:22:37+00:00","author":{"@id":"https:\/\/futuregadgetlab.eu\/#\/schema\/person\/c9fcc06508b58cb3f618b1b58225b6cf"},"breadcrumb":{"@id":"https:\/\/futuregadgetlab.eu\/index.php\/2019\/08\/15\/making-ais-out-of-steinsgate-characters\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/futuregadgetlab.eu\/index.php\/2019\/08\/15\/making-ais-out-of-steinsgate-characters\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/futuregadgetlab.eu\/index.php\/2019\/08\/15\/making-ais-out-of-steinsgate-characters\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/futuregadgetlab.eu\/"},{"@type":"ListItem","position":2,"name":"Making AI&#8217;s out of Steins;Gate characters"}]},{"@type":"WebSite","@id":"https:\/\/futuregadgetlab.eu\/#website","url":"https:\/\/futuregadgetlab.eu\/","name":"Future Gadget Laboratory","description":"Bending  space, time and data","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/futuregadgetlab.eu\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/futuregadgetlab.eu\/#\/schema\/person\/c9fcc06508b58cb3f618b1b58225b6cf","name":"Daru","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/futuregadgetlab.eu\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/be62ed8726fcb3326b65b2d6d0cad4fe?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/be62ed8726fcb3326b65b2d6d0cad4fe?s=96&d=mm&r=g","caption":"Daru"}}]}},"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/p9MGZe-6v","_links":{"self":[{"href":"https:\/\/futuregadgetlab.de\/index.php\/wp-json\/wp\/v2\/posts\/403"}],"collection":[{"href":"https:\/\/futuregadgetlab.de\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/futuregadgetlab.de\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/futuregadgetlab.de\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/futuregadgetlab.de\/index.php\/wp-json\/wp\/v2\/comments?post=403"}],"version-history":[{"count":7,"href":"https:\/\/futuregadgetlab.de\/index.php\/wp-json\/wp\/v2\/posts\/403\/revisions"}],"predecessor-version":[{"id":502,"href":"https:\/\/futuregadgetlab.de\/index.php\/wp-json\/wp\/v2\/posts\/403\/revisions\/502"}],"wp:attachment":[{"href":"https:\/\/futuregadgetlab.de\/index.php\/wp-json\/wp\/v2\/media?parent=403"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/futuregadgetlab.de\/index.php\/wp-json\/wp\/v2\/categories?post=403"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/futuregadgetlab.de\/index.php\/wp-json\/wp\/v2\/tags?post=403"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}