Portrait of Makoto Shing

Makoto Shing

Research Scientist · Tokyo

I'm a Research Scientist and founding team member at Sakana AI. My goal is to make powerful AI accessible to anyone, anywhere. I pursue this through efficient training, knowledge distillation, and model composition. I work end to end—from first-principles formulation and implementation to large-scale experiments and open release. Previously, I led the end-to-end development and open release of Japanese multimodal models at Stability AI. I hold an M.S. in Applied Mathematics (probability, statistics, and information theory) from Waseda University.

Selected Publications

All publications

DiffusionBlocks

ICLR 2026 · First author

AuthorsMakoto Shing, Masanori Koyama, Takuya Akiba

DiffusionBlocks trains residual networks one block at a time, storing activations for only one block during training. It reduces activation memory by a factor of B while matching end-to-end performance across five architectures for vision and language.

Standard training compared with the block-wise DiffusionBlocks method

TAID

ICLR 2025 Spotlight · First author

AuthorsMakoto Shing, Kou Misaki, Han Bao, Sho Yokoi, Takuya Akiba

TAID adapts the teacher distribution to the student's learning progress, stabilizing distillation across large capacity gaps. We validated it across pre-training and instruction tuning for language and vision-language models. Using TAID, I developed TAID-LLM-1.5B for English, TAID-VLM-2B for vision-language tasks, and TinySwallow-1.5B for Japanese. TinySwallow demonstrates fully local inference on an iPhone.

TAID dynamically adapting an intermediate teacher distribution as the student learns

Evolutionary Model Merge

Nature Machine Intelligence 2025 · Co-author

AuthorsTakuya Akiba, Makoto Shing, Yujin Tang, Qi Sun, David Ha

Evolutionary search automatically discovers model-merging recipes without gradient training. I extended the parameter-space method to vision-language and diffusion models. The resulting releases include EvoVLM-JP-v1-7B, a Japanese vision-language model, and EvoSDXL-JP, which generated Japanese images in four steps—10× faster than the 40-step Japanese baseline in our evaluation. EvoSDXL-JP later became the base for Evo-Ukiyoe and Evo-Nishikie.

Multiple foundation models being composed into a new model

Percept-Lens

CVPR Workshop 2025 · Accepted to ECCV 2026

BenchmarkShashank Kotyan, Yuki Imajuku, Makoto Shing, Tarin Clanuwat

ECCV studyShashank Kotyan, Makoto Shing, Yuki Imajuku, Rujikorn Charakorn, Tarin Clanuwat

Percept-Lens evaluates detector transfer across broad distribution shifts. Across 39 public datasets and 7.1 million images, a closed-form Mah-NCM head on frozen features outperformed released heads in 10 of 11 matched comparisons and reached 90.89% accuracy with 219 labeled images.

Local Curvature Smoothing

NeurIPS 2024 · Co-author

AuthorsGenki Osada, Makoto Shing, Takashi Nishide

Local Curvature Smoothing uses Stein's identity to bypass the expensive Jacobian trace in score matching. It reports results comparable to denoising score matching on standard metrics and demonstrates image generation at 1024×1024 resolution.

Generated samples · Osada, Shing & Nishide, paper · CC BY 4.0 · resized and compressed

Models & Releases

TAID model family

Project lead

I led the training and open release of TAID-LLM-1.5B (English), TAID-VLM-2B (vision-language), and TinySwallow-1.5B (Japanese). At release, these models achieved state-of-the-art performance in their respective size classes in the reported evaluations.

I developed TinySwallow with the Swallow team, distilling knowledge from a 32B teacher with TAID and demonstrating fully local inference on an iPhone.

TinySwallow-1.5B on an iPhone, at actual generation speed.

Japanese Stable Diffusion XL

Project lead

I led the end-to-end development and release of a Japanese-specific SDXL, adapting it for Japanese prompts and cultural expressions with a Japanese-compatible text encoder and OFT.

A grid of Japanese-themed images generated by Japanese Stable Diffusion XL

Japanese Stable CLIP

Project lead

I led the development and release of a Japanese image–text representation model for retrieval, zero-shot classification, and multimodal generation systems.

An abstract colorful image used for the Japanese Stable CLIP release

Japanese Stable VLM

Project lead

I led the development and release of a Japanese vision-language model for detailed image description and image-conditioned question answering.

A Shiba Inu in samurai armor used for the Japanese Stable VLM release

Japanese InstructBLIP Alpha

Project lead

I led the development and release of an InstructBLIP-based Japanese model for image captioning and visual question answering.

A colorful parrot in front of Mount Fuji from the Japanese InstructBLIP Alpha model card

The Dog & The Boy

Project lead

I led the AI research and implementation on rinna's side, building an assisted workflow used to support anime background production for the short film.

The boy and robot dog from the animated short The Dog & The Boy