komuro

News-2022 March

Tetsuya Komuro joined RIKEN AIP Music Information Intelligence Team as Senior Visiting Scientist.New content: Wild Birds in Fukushima by the National Institute for Environmental Studies.3 new iPad apps released and 1 re-released.Featured in TV Tokyo’s “Tankyu no kaidan”.Musician Tetsuya Komuro… (READ MORE)

SoundScopePad

VR concert experience SoundScopePad provides an active music listening experience using AI, virtual reality (VR), and spatial acoustics. Users can find the performer that they want to hear and focus on them by emphasizing their performance. RIKEN’s SoundScopePad provides an… (READ MORE)

Cast (MusicScopePad): MAI (ELEVENPLAY) 紹介映像からのキャプチャー映像

MusicScopePad

Video exploration using AR MusicScopePad is a tool for quickly finding a desired video by playing multiple videos at the same time in AR space. You can explore videos using AI, augmented reality (AR), and spatial sound. RIKEN’s MusicScopePad is… (READ MORE)

MelodySlotMachineHD

Melody variation switcher MelodySlotMachineHD is an application that allows you to experience the possibilities of generating melodies using music structures while playing a slot machine. RIKEN’s MelodySlotMachineHD is an application developed by RIKEN towards the integration of music and AI…. (READ MORE)

SoundScopePhone

The Sound Scope Phone introduces a new way of listening to music that enables you to focus on the part you want to listen to simply by facing the corresponding section and putting your hand on your ear.

MelodySlotMachine

Melody Slot Machine features a dial interface which enables users to select a melody from multiple variations to generate a new combination melody.

TimespanTreeEditor

GTTMeditor

The GTTMeditor app is an editor used to analyze music structure. The app enables users to view music score files in MusicXML format and edit the time-span tree in GTTM theory.

BandNavi HD

Band-member-backtracking BandNavi has been developed that enables a user to discover new songs and bands by tracing musicians who have played in different bands. BandNavi HD enables you to find new bands and musics from relations between musicians. Member changing,… (READ MORE)

Melody Slot Machine

An interactive music system that provides an experience of manipulating a music performance

Links

The 15th International Symposium on Computer Music Multidisciplinary Research Theme: AI Era 15-19 November 2021 https://www.cmmr2021.gttm.jp/

分析データ・ツール

Manual time-span generation tool (2018) 国際会議論文 [PDF] [GTTM] [分析データ・ツール] Masatoshi Hamanaka, Keiji Hirata, Satoshi Tojo: “GTTM Database and Manual Time-span Tree Generation Tool”, Proceedings of the 15th Sound and Music Computing Conference (SMC2018), pp.462-467, July 2018. [PDF] [GTTM] [分析データ・ツール] Masatoshi Hamanaka, Keiji… (READ MORE)

演奏支援

国際会議論文 [GTTM] [演奏支援] Nami Iino, Mayumi Shimada, Takuichi Nishimura, Hideki Takeda, Masatoshi Hamanaka: “Proposal of an Annotation Method for Integrating Musical Technique Knowledge Using a GTTM Time-Span Tree”, Proceedings of the 25th International Conference on MultiMedia Modeling (MMM2019), Lecture Notes in Computer… (READ MORE)

deep GTTM

International conference paper [PDF] [GTTM] [Deep GTTM] Masatoshi Hamanaka, Keiji Hirata, Satoshi Tojo: deepGTTM-II: Automatic Generation of Metrical Structure based on Deep Learning Technique, 13th Sound and Music Conference (SMC2016), pp.221-249, 2016. [PDF] [GTTM] [Deep GTTM] Masatoshi Hamanaka, Keiji Hirata,… (READ MORE)

Structures of films

References [PDF] Seiko Takeuchi, Masatoshi Hamanaka, Junichi Hoshino: “Method of structuring a film based on the Generative Theory of Tonal Music”, IPSJ Special Interest Group on Human Computer Interaction, 2015-HCI-162, No. 6, 8 pages, March 2015. [PDF] [Structures of films] [exGTTM] Seiko Takeuchi, Masatoshi Hamanaka: “Structure… (READ MORE)

Masatoshi Hamanaka

About (en)

Masatoshi Hamanaka received PhD degree from the University of Tsukuba, Japan, in 2003. He is currently a leader of Music Information Intelligence team in Center for Advanced Intelligence Project, RIKEN. His research interest is in music information technology, biomedical and unmanned aircraft systems…. (READ MORE)

Researches- Drone

我々は,救急車に先駆けて到着し,救急管制への状況の連絡や,AEDなどの携帯型の医療機器による初期治療を行う「救急ドローン」を開発し救命率を向上させることを目指している.

Researches- Drug discovery

本稿では,医薬品となる化合物を発見するための第一段階のスクリーニングである,タンパク質と化合物の相互作用の予測について述べる.

Separation of music signal sources

This  research  proposes  a  method  to  separate  polyphonic music signal into  signals of  each  musical instrument by NMF: Non-negative Matrix Factorization based on preservation of spectrum envelope.

Music Analysis based on Implication-Realization Model

We propose a melody generation system based on the Implication-Realization Model (IRM) of music theory. The IRM is a music theory, which was proposed by Eugene Narmour. The IRM abstracts music. It then expresses music according to symbol sequences based… (READ MORE)

Guitarist Simulator: Learning-based jam session system

This paper describes a jam session system that enables a human player to interplay with virtual players which can imitate the player personality models of various human players. Previous systems have parameters that allow some alteration in the way virtual… (READ MORE)

Fingering Simulator: Guitar fingering estimation from monophony

Fingering Simulator optimizes guitar fingering of monophony by using physical simulator called Springhead2. Unlike most previous guitar fingering optimization systems focusing on moving distances, our method deals with the torque of the finger joints. Experimental results showed that the maximum… (READ MORE)

Concert Viewing Headphones

We designed concert scope headphones that are equipped with a projector, an inclination sensor on the top of the headphones, and a distance sensor on the outside right headphone. We previously developed sound scope headphones that enable users to change… (READ MORE)