Researches -Music Information Technology

SoundScopePad

VR concert experience SoundScopePad provides an active music listening experience using AI, virtual reality (VR), and spatial acoustics. Users can find the performer that they want to hear and focus on them by emphasizing their performance. RIKEN’s SoundScopePad provides an… (READ MORE)

Cast (MusicScopePad): MAI (ELEVENPLAY) 紹介映像からのキャプチャー映像

MusicScopePad

Video exploration using AR MusicScopePad is a tool for quickly finding a desired video by playing multiple videos at the same time in AR space. You can explore videos using AI, augmented reality (AR), and spatial sound. RIKEN’s MusicScopePad is… (READ MORE)

MelodySlotMachineHD

Melody variation switcher MelodySlotMachineHD is an application that allows you to experience the possibilities of generating melodies using music structures while playing a slot machine. RIKEN’s MelodySlotMachineHD is an application developed by RIKEN towards the integration of music and AI…. (READ MORE)

SoundScopePhone

The Sound Scope Phone introduces a new way of listening to music that enables you to focus on the part you want to listen to simply by facing the corresponding section and putting your hand on your ear.

MelodySlotMachine

Melody Slot Machine features a dial interface which enables users to select a melody from multiple variations to generate a new combination melody.

BandNavi HD

Band-member-backtracking BandNavi has been developed that enables a user to discover new songs and bands by tracing musicians who have played in different bands. BandNavi HD enables you to find new bands and musics from relations between musicians. Member changing,… (READ MORE)

Melody Slot Machine

An interactive music system that provides an experience of manipulating a music performance

分析データ・ツール

Manual time-span generation tool (2018) 国際会議論文 [PDF] [GTTM] [分析データ・ツール] Masatoshi Hamanaka, Keiji Hirata, Satoshi Tojo: “GTTM Database and Manual Time-span Tree Generation Tool”, Proceedings of the 15th Sound and Music Computing Conference (SMC2018), pp.462-467, July 2018. [PDF] [GTTM] [分析データ・ツール] Masatoshi Hamanaka, Keiji… (READ MORE)

演奏支援

国際会議論文 [GTTM] [演奏支援] Nami Iino, Mayumi Shimada, Takuichi Nishimura, Hideki Takeda, Masatoshi Hamanaka: “Proposal of an Annotation Method for Integrating Musical Technique Knowledge Using a GTTM Time-Span Tree”, Proceedings of the 25th International Conference on MultiMedia Modeling (MMM2019), Lecture Notes in Computer… (READ MORE)

deep GTTM

International conference paper [LINK] [GTTM] [deepGTTM] Masatoshi Hamanaka, Keiji Hirata and Satoshi Tojo: “Time-span Tree Leveled by Duration of Time-span”, the 15th International Symposium on Computer Music Multidisciplinary Research (CMMR2021), pp.155-164, November 2021. [PDF] [GTTM] [Deep GTTM] Masatoshi Hamanaka, Keiji… (READ MORE)

Structures of films

References [PDF] Seiko Takeuchi, Masatoshi Hamanaka, Junichi Hoshino: “Method of structuring a film based on the Generative Theory of Tonal Music”, IPSJ Special Interest Group on Human Computer Interaction, 2015-HCI-162, No. 6, 8 pages, March 2015. [PDF] [Structures of films] [exGTTM] Seiko Takeuchi, Masatoshi Hamanaka: “Structure… (READ MORE)

Separation of music signal sources

This  research  proposes  a  method  to  separate  polyphonic music signal into  signals of  each  musical instrument by NMF: Non-negative Matrix Factorization based on preservation of spectrum envelope.

Music Analysis based on Implication-Realization Model

We propose a melody generation system based on the Implication-Realization Model (IRM) of music theory. The IRM is a music theory, which was proposed by Eugene Narmour. The IRM abstracts music. It then expresses music according to symbol sequences based… (READ MORE)

Guitarist Simulator: Learning-based jam session system

This paper describes a jam session system that enables a human player to interplay with virtual players which can imitate the player personality models of various human players. Previous systems have parameters that allow some alteration in the way virtual… (READ MORE)

Fingering Simulator: Guitar fingering estimation from monophony

Fingering Simulator optimizes guitar fingering of monophony by using physical simulator called Springhead2. Unlike most previous guitar fingering optimization systems focusing on moving distances, our method deals with the torque of the finger joints. Experimental results showed that the maximum… (READ MORE)

Concert Viewing Headphones

We designed concert scope headphones that are equipped with a projector, an inclination sensor on the top of the headphones, and a distance sensor on the outside right headphone. We previously developed sound scope headphones that enable users to change… (READ MORE)

Composing music with Twitter

We built “Twitracker” that can post a monophonic melody on Twitter and can create a song by placing posted melodies as materials on Twitter. A shared unfinished song is put into the compositional process by allowing modifying. Most previous composing… (READ MORE)

BandNavi

BandNaviVer. 1.1Language: Japanese, EnglishNewForestar Co,.Ltd A band-member-backtracking application called BandNavi has been developed that enables a user to discover new songs and bands by tracing musicians who have played in different bands.Previous similarity-based song recommendation systems only retrieve similar songs,… (READ MORE)

Discussion structure editor based on music theory

The discussion structure editor generates time-span trees expressing degree of importance of statements. 会議記録の自動要約には、会議の流れや重要発言の認識といった、会議記録の分析が必要です. 本研究では、音楽の分析手法であるGTTMを応用して、会議記録の分析方法の構築を行っています. 音楽においては音イベントが、会議においては発言が時間の進行とともに発生し、ゲシュタルトを生成する相似点に着目しています。 References [PDF] Hiroya Miura, Kenta Togashi, Masatoshi Hamanaka, Katashi Nagao, Satoshi Tojo, Keiji Hirata: “音楽理論を応用したディスカッションマイニングにおけるタイムスパン木と延長木の自動生成について”, IPSJ SIG Digital Contents Creation, Vol. 2013-DCC-3, No.10, January 2013…. (READ MORE)

Polyphonic Music Time-Span Tree Analyzer

We have been developing a music analysis system called a polyphonic music time-span tree analyzer (PTTA). A time-span tree assigns a hierarchy of ‘structural importance’ to the notes of a piece of music on the basis of the Generative Theory… (READ MORE)

Melody expectation method based on GTTM and TPS

A method that predicts the next notes is described for assisting musical novices to play improvisations. Melody prediction is one of the most difficult problems in musical information retrieval because composers and players may or may not create melodies that… (READ MORE)

Melody morphing method based on GTTM

ShakeGuitar (Free), based on the morphing method, is available on App Store (Released on September 26, 2009) This paper describes a melody morphing method that generates an intermediate melody between a melody and another melody with a systematic order according… (READ MORE)

σGTTM System

σGTTM combines the generative theory of tonal music (GTTM) and statistical learning. We previously devised exGTTM, which has accommodated the original GTTM to computer implementations. The exGTTM has adjustable parameters, these parameters have to be manually configured. Therefore, it is… (READ MORE)

Interactive GTTM Analyzer

This paper describes an automatic grouping system, which segments the music into units such as phrases or motives, based on the Generative Theory of Tonal Music (GTTM in short, hereafter). The GTTM is considered to be one of the most… (READ MORE)