Juyoung Suk

M.S. Student in Artificial Intelligence

I am a graduate student at KAIST researching machine learning and artificial intelligence, advised by Minjoon Seo. My work focuses on language model evaluation, multilingual AI systems, and developing novel approaches to deep learning architectures.

News

2025-08

We released Tri-7B, Tri-21B, and Tri-70B models! Come check out our models on HuggingFace!

2025-06

Glad to share that The BiGGen Bench has won the best paper award in NAACL 2025!

2025-03

We released Trillion-7B Technical Whitepaper detailing our compute-efficient multilingual frontier model.

2024-11

Started position as Member of Technical Staff at Trillion Labs, working on next-generation multilingual language models.

Projects

Prometheus-Eval

Led development of a 900+ stars open-source repository for evaluating language models using specialized LMs

PythonPyTorchHuggingFaceOpenAI API

Code Coming Soon

Publications

Trillion 7B Technical Report

S Han, J Suk, S An, H Kim, ...

Technical Whitepaper • 2025

arXiv Paper

Prometheus 2: An open source language model specialized in evaluating other language models

S Kim, J Suk, S Longpre, BY Lin, ...

Preprint • 2024

arXiv Paper Code

CLIcK: A Benchmark Dataset of Cultural and Linguistic Intelligence in Korean

E Kim, J Suk, P Oh, H Yoo, J Thorne, A Oh

Preprint • 2024

arXiv Paper Code

The BiGGen Bench: A Principled Benchmark for Fine-grained Evaluation of Language Models with Language Models

S Kim, J Suk, JY Cho, S Longpre, ...

Preprint • 2024

arXiv Paper Code

Evaluating Language Models as Synthetic Data Generators

S Kim, J Suk, X Yue, V Viswanathan, ...

Preprint • 2024

arXiv Paper Code

LLM-AS-AN-INTERVIEWER: Beyond Static Testing Through Dynamic LLM Evaluation

E Kim, J Suk, S Kim, N Muennighoff, D Kim, A Oh

Preprint • 2024

arXiv Paper

MM-Eval: A Multilingual Meta-Evaluation Benchmark for LLM-as-a-Judge and Reward Models

G Son, D Yoon, J Suk, J Aula-Blasco, ...

Preprint • 2024

arXiv Paper

Work Experience

Member of Technical Staff

Trillion Labs

Nov. 2024 - Present

Core developer of Trillion-7B multilingual LLM.

•Trillion-7B development (HuggingFace, NVIDIA GTC)

Machine Learning Engineer

ThetaOne

Feb. 2023 - July. 2023

RAG pipeline development for Metabuddy.

•End-to-end ML pipeline with LangChain

Machine Learning Engineer Intern

NAVER Corp.

Aug. 2022 - Feb. 2023

Hate speech detection for AI Clean Bot 2.0.

•40+ million user production model