{"id":6949,"date":"2026-02-01T11:36:16","date_gmt":"2026-02-01T02:36:16","guid":{"rendered":"https:\/\/new.krafton.ai\/?p=6949"},"modified":"2026-02-20T08:47:50","modified_gmt":"2026-02-19T23:47:50","slug":"finding-an-llm-thats-truly-good-at-gaming-the-birth-of-the-orak-benchmark","status":"publish","type":"post","link":"https:\/\/krafton.ai\/en\/finding-an-llm-thats-truly-good-at-gaming-the-birth-of-the-orak-benchmark\/","title":{"rendered":"Finding an LLM That\u2019s Truly Good at Gaming! The Birth of the \u2018Orak\u2019 Benchmark"},"content":{"rendered":"[vc_row type=”full_width_background” full_screen_row_position=”middle” column_margin=”default” column_direction=”default” column_direction_tablet=”default” column_direction_phone=”default” bg_color=”#FFFFFF” scene_position=”center” text_color=”dark” text_align=”left” row_border_radius=”none” row_border_radius_applies=”bg” row_position_desktop=”default” row_position_tablet=”inherit” row_position_phone=”inherit” overflow=”visible” overlay_strength=”0.3″ gradient_direction=”left_to_right” shape_divider_position=”bottom” bg_image_animation=”none” gradient_type=”default” shape_type=””][vc_column column_padding=”no-extra-padding” column_padding_tablet=”inherit” column_padding_phone=”inherit” column_padding_position=”all” flex_gap_desktop=”10px” column_element_direction_desktop=”default” column_element_spacing=”default” desktop_text_alignment=”default” tablet_text_alignment=”default” phone_text_alignment=”default” background_color_opacity=”1″ background_hover_color_opacity=”1″ column_backdrop_filter=”none” column_shadow=”none” column_border_radius=”none” column_link_target=”_self” column_position=”default” gradient_direction=”left_to_right” overlay_strength=”0.3″ width=”1\/1″ tablet_width_inherit=”default” animation_type=”default” bg_image_animation=”none” border_type=”simple” column_border_width=”none” column_border_style=”solid”][nectar_responsive_text inherited_font_style=”default” font_size_desktop=”18″ font_line_height=”1.4″ text_direction=”default”]\n
\n
\n

As technology evolves, the way games are developed and played continues to change. These days, language models (LLMs) are not only conversation partners within games but also help players with gameplay. But have you ever wondered:<\/p>\n

\u201cIs this LLM actually good at playing games?\u201d<\/strong><\/p>\n

To answer this question properly, the Research Department of KRAFTON\u2019s Deep Learning Division stepped up. They developed a benchmark to evaluate how well an LLM-based agent can actually play a game\u2014and how it makes decisions in the process. The benchmark is called\u00a0Orak<\/strong>, a name inspired by the Korean word for \u201c\uc624\ub77d,\u201d meaning \u201centertainment\u201d or \u201carcade,\u201d evoking a warm sense of nostalgia among Koreans. The name alone is already quite charming and intriguing, isn\u2019t it?<\/p>\n

Today, we\u2019re sitting down with\u00a0Dongmin Park<\/strong>\u00a0from KRAFTON\u2019s Data-centric Deep Learning Research Team, who led this project, to hear in detail about how\u00a0Orak<\/strong>\u00a0came to life.<\/p>\n<\/div>\n<\/div>\n

\n
\n
<\/div>\n<\/div>\n<\/div>\n[\/nectar_responsive_text][vc_row_inner column_margin=”default” column_direction=”default” column_direction_tablet=”default” column_direction_phone=”default” text_align=”left” row_position=”default” row_position_tablet=”inherit” row_position_phone=”inherit” overflow=”visible” pointer_events=”all”][vc_column_inner column_padding=”no-extra-padding” column_padding_tablet=”inherit” column_padding_phone=”inherit” column_padding_position=”all” flex_gap_desktop=”10px” column_element_direction_desktop=”default” column_element_spacing=”default” desktop_text_alignment=”default” tablet_text_alignment=”default” phone_text_alignment=”default” background_color_opacity=”1″ background_hover_color_opacity=”1″ column_backdrop_filter=”none” column_shadow=”none” column_border_radius=”none” column_link_target=”_self” overflow=”visible” gradient_direction=”left_to_right” overlay_strength=”0.3″ width=”1\/1″ tablet_width_inherit=”default” animation_type=”default” bg_image_animation=”none” border_type=”simple” column_border_width=”none” column_border_style=”solid”][image_with_animation image_url=”6325″ image_size=”full” max_width=”100%” max_width_mobile=”default” animation_type=”entrance” animation=”None” animation_movement_type=”transform_y” hover_animation=”none” alignment=”center” border_radius=”none” box_shadow=”none” image_loading=”default” display_title=”1″ display_caption=”1″ screen_reader_text=”(\uc0ac\uc9c41) Orak \ubca4\uce58\ub9c8\ud06c \ud300”][\/vc_column_inner][\/vc_row_inner][vc_row_inner column_margin=”default” column_direction=”default” column_direction_tablet=”default” column_direction_phone=”default” text_align=”left” row_position=”default” row_position_tablet=”inherit” row_position_phone=”inherit” overflow=”visible” pointer_events=”all”][vc_column_inner column_padding=”no-extra-padding” column_padding_tablet=”inherit” column_padding_phone=”inherit” column_padding_position=”all” flex_gap_desktop=”10px” column_element_direction_desktop=”default” column_element_spacing=”default” desktop_text_alignment=”default” tablet_text_alignment=”default” phone_text_alignment=”default” background_color_opacity=”1″ background_hover_color_opacity=”1″ column_backdrop_filter=”none” column_shadow=”none” column_border_radius=”none” column_link_target=”_self” overflow=”visible” gradient_direction=”left_to_right” overlay_strength=”0.3″ width=”1\/1″ tablet_width_inherit=”default” animation_type=”default” bg_image_animation=”none” border_type=”simple” column_border_width=”none” column_border_style=”solid”][nectar_responsive_text inherited_font_style=”default” font_size_desktop=”18″ font_line_height=”1.4″ text_direction=”default”]Q. Hello! First of all, congratulations on the launch of Orak\u2014and thank you for all your hard work. Let\u2019s start with the basics: what inspired the Orak benchmark project, and what problem were you trying to solve?<\/strong><\/p>\n

Recently, there\u2019s been a surge in efforts to make LLMs play actual games or assist within in-game scenarios. Projects like PUBG Ally and Smart Zoi are prime examples. But the problem is, there\u2019s still no objective standard for determining whether an LLM is actually good at playing games.<\/p>\n

It\u2019s not just about inference skills or conversational ability \u2014 we need to assess how well the model interprets complex game environments and makes decisions based on them. That\u2019s what it takes to be a truly gaming-capable LLM. With that realization, the Orak project was launched internally at KRAFTON. We decided to build an evaluation framework ourselves that would address both the technical needs and practical considerations of such systems.<\/p>\n

 <\/p>\n

Q. By the way, the name is so cute. What\u2019s the story behind \u2018Orak\u2019? I think I might have a guess…<\/strong><\/p>\n

Korean readers probably picked up on it right away \u2014 Orak is derived from the Korean word \u201c\uc624\ub77d\u201d, which means \u201centertainment\u201d or \u201carcade.\u201d While it\u2019s not a word we use often these days, for those who grew up during the arcade era, it might feel even more nostalgic and familiar than the word \u201cgame.\u201d<\/p>\n

We chose this name because it feels natural and easy to pronounce for English-speaking researchers too, while also intuitively capturing the essence of the project.[\/nectar_responsive_text][\/vc_column_inner][\/vc_row_inner][vc_row_inner column_margin=”default” column_direction=”default” column_direction_tablet=”default” column_direction_phone=”default” text_align=”left” row_position=”default” row_position_tablet=”inherit” row_position_phone=”inherit” overflow=”visible” pointer_events=”all”][vc_column_inner column_padding=”no-extra-padding” column_padding_tablet=”inherit” column_padding_phone=”inherit” column_padding_position=”all” flex_gap_desktop=”10px” column_element_direction_desktop=”default” column_element_spacing=”default” desktop_text_alignment=”default” tablet_text_alignment=”default” phone_text_alignment=”default” background_color_opacity=”1″ background_hover_color_opacity=”1″ column_backdrop_filter=”none” column_shadow=”none” column_border_radius=”none” column_link_target=”_self” overflow=”visible” gradient_direction=”left_to_right” overlay_strength=”0.3″ width=”1\/1″ tablet_width_inherit=”default” animation_type=”default” bg_image_animation=”none” border_type=”simple” column_border_width=”none” column_border_style=”solid”][image_with_animation image_url=”6323″ image_size=”full” max_width=”100%” max_width_mobile=”default” animation_type=”entrance” animation=”None” animation_movement_type=”transform_y” hover_animation=”none” alignment=”center” border_radius=”none” box_shadow=”none” image_loading=”default” display_title=”1″ display_caption=”1″ screen_reader_text=”(\uc0ac\uc9c41) Orak \ubca4\uce58\ub9c8\ud06c \ud300”][\/vc_column_inner][\/vc_row_inner][vc_row_inner column_margin=”default” column_direction=”default” column_direction_tablet=”default” column_direction_phone=”default” text_align=”left” row_position=”default” row_position_tablet=”inherit” row_position_phone=”inherit” overflow=”visible” pointer_events=”all”][vc_column_inner column_padding=”no-extra-padding” column_padding_tablet=”inherit” column_padding_phone=”inherit” column_padding_position=”all” flex_gap_desktop=”10px” column_element_direction_desktop=”default” column_element_spacing=”default” desktop_text_alignment=”default” tablet_text_alignment=”default” phone_text_alignment=”default” background_color_opacity=”1″ background_hover_color_opacity=”1″ column_backdrop_filter=”none” column_shadow=”none” column_border_radius=”none” column_link_target=”_self” overflow=”visible” gradient_direction=”left_to_right” overlay_strength=”0.3″ width=”1\/1″ tablet_width_inherit=”default” animation_type=”default” bg_image_animation=”none” border_type=”simple” column_border_width=”none” column_border_style=”solid”][nectar_responsive_text inherited_font_style=”default” font_size_desktop=”18″ font_line_height=”1.4″ text_direction=”default”]Q. Hopefully, the name Orak will go down in history as an iconic milestone! What was the experimental setup like for Orak? And what are the key design elements?<\/strong><\/p>\n

Orak is a benchmark built using 12 different video games. These games were selected not only for their symbolic and meaningful status within the industry, but also to reflect a diversity of genres. The goal wasn\u2019t just to make these games playable by an LLM; each game environment was meticulously designed to assess how effectively the model can perceive a situation and make decisions within it.<\/p>\n

We also designed the interface based on MCP (Model Context Protocol), which allows a wide range of LLMs to participate in the benchmark easily. The framework was built with both accessibility and scalability in mind. Thanks to this structure, researchers can obtain reliable and repeatable results.<\/p>\n


\nQ. It sounds like a project with a tremendous amount of thought behind it. So how do you evaluate an agent’s decision-making? I’m also curious about the technically important aspects.<\/strong><\/p>\n

It\u2019s not just about whether the model \u201cwins\u201d the game \u2014 what really matters is how it plays. For each game environment, we defined a set of evaluation metrics to quantitatively measure how well the agent understands the situation and chooses appropriate actions.<\/p>\n

The MCP structure I mentioned earlier forms the foundation for this kind of detailed evaluation. We also emphasized user-friendly design. We built a reusable interface so researchers could quickly and easily connect and test different models. This setup made it possible to evaluate and compare various models under a unified standard.<\/p>\n


\nQ. Just listening to this already makes it sound like a refreshingly novel piece of research. What makes the Orak benchmark stand out from other evaluation systems? Please brag a little.<\/strong><\/p>\n

The biggest distinction is that the LLM has to actually play the game. It\u2019s not just about testing knowledge \u2014 we evaluate the entire process, from interpreting the situation to making decisions and taking action. This allows for a much deeper assessment of the cognitive capabilities of an AI agent.<\/p>\n

Another strength is that all the games used in the evaluation are well-known commercial titles. Their popularity makes it easier for researchers to interpret the results and adapt them to their own work. Most importantly, Orak evaluates the model\u2019s strategic thinking based on the entire gameplay process and flow. In that sense, it takes a fundamentally different approach compared to traditional benchmarks.<\/p>\n

We also provide fine-tuning datasets for LLMs, which we believe contributes to advancing research in gaming agents even further.[\/nectar_responsive_text][\/vc_column_inner][\/vc_row_inner][vc_row_inner column_margin=”default” column_direction=”default” column_direction_tablet=”default” column_direction_phone=”default” text_align=”left” row_position=”default” row_position_tablet=”inherit” row_position_phone=”inherit” overflow=”visible” pointer_events=”all”][vc_column_inner column_padding=”no-extra-padding” column_padding_tablet=”inherit” column_padding_phone=”inherit” column_padding_position=”all” flex_gap_desktop=”10px” column_element_direction_desktop=”default” column_element_spacing=”default” desktop_text_alignment=”default” tablet_text_alignment=”default” phone_text_alignment=”default” background_color_opacity=”1″ background_hover_color_opacity=”1″ column_backdrop_filter=”none” column_shadow=”none” column_border_radius=”none” column_link_target=”_self” overflow=”visible” gradient_direction=”left_to_right” overlay_strength=”0.3″ width=”1\/1″ tablet_width_inherit=”default” animation_type=”default” bg_image_animation=”none” border_type=”simple” column_border_width=”none” column_border_style=”solid”][image_with_animation image_url=”6324″ image_size=”full” max_width=”100%” max_width_mobile=”default” animation_type=”entrance” animation=”None” animation_movement_type=”transform_y” hover_animation=”none” alignment=”center” border_radius=”none” box_shadow=”none” image_loading=”default” display_title=”1″ display_caption=”1″ screen_reader_text=”(\uc0ac\uc9c41) Orak \ubca4\uce58\ub9c8\ud06c \ud300”][\/vc_column_inner][\/vc_row_inner][vc_row_inner column_margin=”default” column_direction=”default” column_direction_tablet=”default” column_direction_phone=”default” text_align=”left” row_position=”default” row_position_tablet=”inherit” row_position_phone=”inherit” overflow=”visible” pointer_events=”all”][vc_column_inner column_padding=”no-extra-padding” column_padding_tablet=”inherit” column_padding_phone=”inherit” column_padding_position=”all” flex_gap_desktop=”10px” column_element_direction_desktop=”default” column_element_spacing=”default” desktop_text_alignment=”default” tablet_text_alignment=”default” phone_text_alignment=”default” background_color_opacity=”1″ background_hover_color_opacity=”1″ column_backdrop_filter=”none” column_shadow=”none” column_border_radius=”none” column_link_target=”_self” overflow=”visible” gradient_direction=”left_to_right” overlay_strength=”0.3″ width=”1\/1″ tablet_width_inherit=”default” animation_type=”default” bg_image_animation=”none” border_type=”simple” column_border_width=”none” column_border_style=”solid”][nectar_responsive_text inherited_font_style=”default” font_size_desktop=”18″ font_line_height=”1.4″ text_direction=”default”]Q. This must have been a project that was impossible to complete alone. Were there any memorable moments of teamwork during the process?<\/strong><\/p>\n

Because collaboration was so essential to this project, the teamwork really stands out in my memory. Each team member was in charge of one specific game, and we all agreed on the overall MCP structure so that everything was implemented in a consistent way. We held regular weekly meetings to share issues and exchange feedback.<\/p>\n

One especially memorable moment was when we worked on enabling multiple games to be played by the LLM using modding tools. It was repetitive and technically challenging, but everyone pitched in enthusiastically, and we ultimately made it work. It wouldn\u2019t have been possible without the dedication of the team. Most of all, I think the way we respected each member\u2019s expertise and coordinated accordingly really elevated the quality of the final result.<\/p>\n

 <\/p>\n

Q. Of course, anything new tends to come with its share of difficulties. Were there any unexpected problems or trial-and-error moments?
\n<\/strong>
\nToward the end of the project, we ran into a few unforeseen issues. At certain stages, it became difficult to proceed as originally planned, and we had to quickly come up with alternatives. One of those moments came right before we were about to submit our paper to NeurIPS \u2014 we found out we wouldn\u2019t be able to work directly with the fine-tuned weights of the model.<\/p>\n

Fortunately, we were able to quickly assess the situation and take action internally, and in the end, we were still able to secure enough data. Thanks to that, we managed to wrap up the experiments without major delays.<\/p>\n

Q. Lastly, is there anything you\u2019d like to say to the team members who worked with you on this project?<\/strong><\/p>\n

Thank you all so much for your incredible effort. Personally, I believe that what we\u2019ve created with Orak is the most practical and well-rounded gaming LLM benchmark that exists today. I hope this benchmark becomes the starting point for much more research and development to come \u2014 and that we can all feel proud to have been there at the beginning of it. Every step of this journey was meaningful, and I hope this experience becomes a valuable asset for each of your careers moving forward.[\/nectar_responsive_text][\/vc_column_inner][\/vc_row_inner][vc_row_inner column_margin=”default” column_direction=”default” column_direction_tablet=”default” column_direction_phone=”default” text_align=”left” row_position=”default” row_position_tablet=”inherit” row_position_phone=”inherit” overflow=”visible” pointer_events=”all”][vc_column_inner column_padding=”no-extra-padding” column_padding_tablet=”inherit” column_padding_phone=”inherit” column_padding_position=”all” flex_gap_desktop=”10px” column_element_direction_desktop=”default” column_element_spacing=”default” desktop_text_alignment=”default” tablet_text_alignment=”default” phone_text_alignment=”default” background_color_opacity=”1″ background_hover_color_opacity=”1″ column_backdrop_filter=”none” column_shadow=”none” column_border_radius=”none” column_link_target=”_self” overflow=”visible” gradient_direction=”left_to_right” overlay_strength=”0.3″ width=”1\/1″ tablet_width_inherit=”default” animation_type=”default” bg_image_animation=”none” border_type=”simple” column_border_width=”none” column_border_style=”solid”][divider line_type=”Full Width Line” line_thickness=”1″ divider_color=”black” custom_height=”1″][\/vc_column_inner][\/vc_row_inner][vc_row_inner column_margin=”default” column_direction=”default” column_direction_tablet=”default” column_direction_phone=”default” text_align=”left” row_position=”default” row_position_tablet=”inherit” row_position_phone=”inherit” overflow=”visible” pointer_events=”all”][vc_column_inner column_padding=”no-extra-padding” column_padding_tablet=”inherit” column_padding_phone=”inherit” column_padding_position=”all” flex_gap_desktop=”10px” column_element_direction_desktop=”default” column_element_spacing=”default” desktop_text_alignment=”default” tablet_text_alignment=”default” phone_text_alignment=”default” background_color_opacity=”1″ background_hover_color_opacity=”1″ column_backdrop_filter=”none” column_shadow=”none” column_border_radius=”none” column_link_target=”_self” overflow=”visible” gradient_direction=”left_to_right” overlay_strength=”0.3″ width=”1\/1″ tablet_width_inherit=”default” animation_type=”default” bg_image_animation=”none” border_type=”simple” column_border_width=”none” column_border_style=”solid”][nectar_responsive_text inherited_font_style=”default” font_size_desktop=”18″ font_line_height=”1.4″ text_direction=”default”]\n

Through this interview, we were able to gain a deeper appreciation for how the Orak project goes beyond a simple technical experiment \u2014 offering a meaningful standard for evaluating the actual decision-making and behavioral capabilities of language model-based agents. The fact that it\u2019s designed to comprehensively assess an LLM\u2019s situational awareness and reasoning skills across diverse game environments is particularly refreshing.<\/p>\n

The results of the Orak project are now available in a published paper. If you\u2019re interested in LLM research in the context of gaming, be sure to check out the links below for more details! \ud83d\ude0a<\/p>\n

\ud83d\udcd6\u00a0Read the full Orak paper<\/a>
\n<\/strong>\ud83d\ude0e\u00a0Orak Leaderboard<\/a><\/strong>
\ud83d\udc68\u200d\ud83d\udcbb\u00a0Orak GitHub<\/a><\/strong>
\u2705\u00a0Full list of KRAFTON AI research papers<\/a><\/strong>[\/nectar_responsive_text][\/vc_column_inner][\/vc_row_inner][\/vc_column][\/vc_row]\n","protected":false},"excerpt":{"rendered":"

[vc_row type=”full_width_background” full_screen_row_position=”middle” column_margin=”default” column_direction=”default” column_direction_tablet=”default” column_direction_phone=”default” bg_color=”#FFFFFF” scene_position=”center” text_color=”dark” text_align=”left” row_border_radius=”none” row_border_radius_applies=”bg” row_position_desktop=”default” row_position_tablet=”inherit” row_position_phone=”inherit” overflow=”visible” overlay_strength=”0.3″ gradient_direction=”left_to_right” shape_divider_position=”bottom” bg_image_animation=”none” gradient_type=”default” shape_type=””][vc_column column_padding=”no-extra-padding” column_padding_tablet=”inherit” column_padding_phone=”inherit” column_padding_position=”all” flex_gap_desktop=”10px” column_element_direction_desktop=”default” column_element_spacing=”default”…<\/p>\n","protected":false},"author":1,"featured_media":6948,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[63],"tags":[],"class_list":{"0":"post-6949","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-behind-story"},"yoast_head":"\nFinding an LLM That\u2019s Truly Good at Gaming! The Birth of the \u2018Orak\u2019 Benchmark - Krafton AI<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/new.krafton.ai\/en\/finding-an-llm-thats-truly-good-at-gaming-the-birth-of-the-orak-benchmark\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Finding an LLM That\u2019s Truly Good at Gaming! The Birth of the \u2018Orak\u2019 Benchmark - Krafton AI\" \/>\n<meta property=\"og:description\" content=\"[vc_row type=”full_width_background” full_screen_row_position=”middle” column_margin=”default” column_direction=”default” column_direction_tablet=”default” column_direction_phone=”default” bg_color=”#FFFFFF” scene_position=”center” text_color=”dark” text_align=”left” row_border_radius=”none” row_border_radius_applies=”bg” row_position_desktop=”default” row_position_tablet=”inherit” row_position_phone=”inherit” overflow=”visible” overlay_strength=”0.3″ gradient_direction=”left_to_right” shape_divider_position=”bottom” bg_image_animation=”none” gradient_type=”default” shape_type=””][vc_column column_padding=”no-extra-padding” column_padding_tablet=”inherit” column_padding_phone=”inherit” column_padding_position=”all” flex_gap_desktop=”10px” column_element_direction_desktop=”default” column_element_spacing=”default”...\" \/>\n<meta property=\"og:url\" content=\"https:\/\/new.krafton.ai\/en\/finding-an-llm-thats-truly-good-at-gaming-the-birth-of-the-orak-benchmark\/\" \/>\n<meta property=\"og:site_name\" content=\"Krafton AI\" \/>\n<meta property=\"article:published_time\" content=\"2026-02-01T02:36:16+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2026-02-19T23:47:50+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/new.krafton.ai\/wp-content\/uploads\/2026\/02\/IMG_9543-2048x1365-1.webp\" \/>\n\t<meta property=\"og:image:width\" content=\"2048\" \/>\n\t<meta property=\"og:image:height\" content=\"1365\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/webp\" \/>\n<meta name=\"author\" content=\"Manager\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Manager\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"14 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/new.krafton.ai\\\/en\\\/finding-an-llm-thats-truly-good-at-gaming-the-birth-of-the-orak-benchmark\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/new.krafton.ai\\\/en\\\/finding-an-llm-thats-truly-good-at-gaming-the-birth-of-the-orak-benchmark\\\/\"},\"author\":{\"name\":\"Manager\",\"@id\":\"http:\\\/\\\/172.31.17.166\\\/#\\\/schema\\\/person\\\/bd4b2c1522ef1280992667d8db878dd3\"},\"headline\":\"Finding an LLM That\u2019s Truly Good at Gaming! The Birth of the \u2018Orak\u2019 Benchmark\",\"datePublished\":\"2026-02-01T02:36:16+00:00\",\"dateModified\":\"2026-02-19T23:47:50+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/new.krafton.ai\\\/en\\\/finding-an-llm-thats-truly-good-at-gaming-the-birth-of-the-orak-benchmark\\\/\"},\"wordCount\":2896,\"image\":{\"@id\":\"https:\\\/\\\/new.krafton.ai\\\/en\\\/finding-an-llm-thats-truly-good-at-gaming-the-birth-of-the-orak-benchmark\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/krafton.ai\\\/wp-content\\\/uploads\\\/2026\\\/02\\\/IMG_9543-2048x1365-1.webp\",\"articleSection\":[\"Behind Story\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/new.krafton.ai\\\/en\\\/finding-an-llm-thats-truly-good-at-gaming-the-birth-of-the-orak-benchmark\\\/\",\"url\":\"https:\\\/\\\/new.krafton.ai\\\/en\\\/finding-an-llm-thats-truly-good-at-gaming-the-birth-of-the-orak-benchmark\\\/\",\"name\":\"Finding an LLM That\u2019s Truly Good at Gaming! The Birth of the \u2018Orak\u2019 Benchmark - Krafton AI\",\"isPartOf\":{\"@id\":\"http:\\\/\\\/172.31.17.166\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/new.krafton.ai\\\/en\\\/finding-an-llm-thats-truly-good-at-gaming-the-birth-of-the-orak-benchmark\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/new.krafton.ai\\\/en\\\/finding-an-llm-thats-truly-good-at-gaming-the-birth-of-the-orak-benchmark\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/krafton.ai\\\/wp-content\\\/uploads\\\/2026\\\/02\\\/IMG_9543-2048x1365-1.webp\",\"datePublished\":\"2026-02-01T02:36:16+00:00\",\"dateModified\":\"2026-02-19T23:47:50+00:00\",\"author\":{\"@id\":\"http:\\\/\\\/172.31.17.166\\\/#\\\/schema\\\/person\\\/bd4b2c1522ef1280992667d8db878dd3\"},\"breadcrumb\":{\"@id\":\"https:\\\/\\\/new.krafton.ai\\\/en\\\/finding-an-llm-thats-truly-good-at-gaming-the-birth-of-the-orak-benchmark\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/new.krafton.ai\\\/en\\\/finding-an-llm-thats-truly-good-at-gaming-the-birth-of-the-orak-benchmark\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/new.krafton.ai\\\/en\\\/finding-an-llm-thats-truly-good-at-gaming-the-birth-of-the-orak-benchmark\\\/#primaryimage\",\"url\":\"https:\\\/\\\/krafton.ai\\\/wp-content\\\/uploads\\\/2026\\\/02\\\/IMG_9543-2048x1365-1.webp\",\"contentUrl\":\"https:\\\/\\\/krafton.ai\\\/wp-content\\\/uploads\\\/2026\\\/02\\\/IMG_9543-2048x1365-1.webp\",\"width\":2048,\"height\":1365,\"caption\":\"(\uc0ac\uc9c41) Orak \ubca4\uce58\ub9c8\ud06c \ud300\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/new.krafton.ai\\\/en\\\/finding-an-llm-thats-truly-good-at-gaming-the-birth-of-the-orak-benchmark\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"\ud648\",\"item\":\"https:\\\/\\\/www.krafton.ai\\\/en\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Finding an LLM That\u2019s Truly Good at Gaming! The Birth of the \u2018Orak\u2019 Benchmark\"}]},{\"@type\":\"WebSite\",\"@id\":\"http:\\\/\\\/172.31.17.166\\\/#website\",\"url\":\"http:\\\/\\\/172.31.17.166\\\/\",\"name\":\"Krafton AI\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"http:\\\/\\\/172.31.17.166\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"http:\\\/\\\/172.31.17.166\\\/#\\\/schema\\\/person\\\/bd4b2c1522ef1280992667d8db878dd3\",\"name\":\"Manager\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/608aefb8ff6fee4dd437f2319412d7508273b7d0a367465f2f7ab5a9bb1f8c50?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/608aefb8ff6fee4dd437f2319412d7508273b7d0a367465f2f7ab5a9bb1f8c50?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/608aefb8ff6fee4dd437f2319412d7508273b7d0a367465f2f7ab5a9bb1f8c50?s=96&d=mm&r=g\",\"caption\":\"Manager\"},\"sameAs\":[\"https:\\\/\\\/new.krafton.ai\"],\"url\":\"https:\\\/\\\/krafton.ai\\\/en\\\/author\\\/manager\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Finding an LLM That\u2019s Truly Good at Gaming! The Birth of the \u2018Orak\u2019 Benchmark - Krafton AI","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/new.krafton.ai\/en\/finding-an-llm-thats-truly-good-at-gaming-the-birth-of-the-orak-benchmark\/","og_locale":"en_US","og_type":"article","og_title":"Finding an LLM That\u2019s Truly Good at Gaming! The Birth of the \u2018Orak\u2019 Benchmark - Krafton AI","og_description":"[vc_row type=”full_width_background” full_screen_row_position=”middle” column_margin=”default” column_direction=”default” column_direction_tablet=”default” column_direction_phone=”default” bg_color=”#FFFFFF” scene_position=”center” text_color=”dark” text_align=”left” row_border_radius=”none” row_border_radius_applies=”bg” row_position_desktop=”default” row_position_tablet=”inherit” row_position_phone=”inherit” overflow=”visible” overlay_strength=”0.3″ gradient_direction=”left_to_right” shape_divider_position=”bottom” bg_image_animation=”none” gradient_type=”default” shape_type=””][vc_column column_padding=”no-extra-padding” column_padding_tablet=”inherit” column_padding_phone=”inherit” column_padding_position=”all” flex_gap_desktop=”10px” column_element_direction_desktop=”default” column_element_spacing=”default”...","og_url":"https:\/\/new.krafton.ai\/en\/finding-an-llm-thats-truly-good-at-gaming-the-birth-of-the-orak-benchmark\/","og_site_name":"Krafton AI","article_published_time":"2026-02-01T02:36:16+00:00","article_modified_time":"2026-02-19T23:47:50+00:00","og_image":[{"width":2048,"height":1365,"url":"https:\/\/new.krafton.ai\/wp-content\/uploads\/2026\/02\/IMG_9543-2048x1365-1.webp","type":"image\/webp"}],"author":"Manager","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Manager","Est. reading time":"14 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/new.krafton.ai\/en\/finding-an-llm-thats-truly-good-at-gaming-the-birth-of-the-orak-benchmark\/#article","isPartOf":{"@id":"https:\/\/new.krafton.ai\/en\/finding-an-llm-thats-truly-good-at-gaming-the-birth-of-the-orak-benchmark\/"},"author":{"name":"Manager","@id":"http:\/\/172.31.17.166\/#\/schema\/person\/bd4b2c1522ef1280992667d8db878dd3"},"headline":"Finding an LLM That\u2019s Truly Good at Gaming! The Birth of the \u2018Orak\u2019 Benchmark","datePublished":"2026-02-01T02:36:16+00:00","dateModified":"2026-02-19T23:47:50+00:00","mainEntityOfPage":{"@id":"https:\/\/new.krafton.ai\/en\/finding-an-llm-thats-truly-good-at-gaming-the-birth-of-the-orak-benchmark\/"},"wordCount":2896,"image":{"@id":"https:\/\/new.krafton.ai\/en\/finding-an-llm-thats-truly-good-at-gaming-the-birth-of-the-orak-benchmark\/#primaryimage"},"thumbnailUrl":"https:\/\/krafton.ai\/wp-content\/uploads\/2026\/02\/IMG_9543-2048x1365-1.webp","articleSection":["Behind Story"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/new.krafton.ai\/en\/finding-an-llm-thats-truly-good-at-gaming-the-birth-of-the-orak-benchmark\/","url":"https:\/\/new.krafton.ai\/en\/finding-an-llm-thats-truly-good-at-gaming-the-birth-of-the-orak-benchmark\/","name":"Finding an LLM That\u2019s Truly Good at Gaming! The Birth of the \u2018Orak\u2019 Benchmark - Krafton AI","isPartOf":{"@id":"http:\/\/172.31.17.166\/#website"},"primaryImageOfPage":{"@id":"https:\/\/new.krafton.ai\/en\/finding-an-llm-thats-truly-good-at-gaming-the-birth-of-the-orak-benchmark\/#primaryimage"},"image":{"@id":"https:\/\/new.krafton.ai\/en\/finding-an-llm-thats-truly-good-at-gaming-the-birth-of-the-orak-benchmark\/#primaryimage"},"thumbnailUrl":"https:\/\/krafton.ai\/wp-content\/uploads\/2026\/02\/IMG_9543-2048x1365-1.webp","datePublished":"2026-02-01T02:36:16+00:00","dateModified":"2026-02-19T23:47:50+00:00","author":{"@id":"http:\/\/172.31.17.166\/#\/schema\/person\/bd4b2c1522ef1280992667d8db878dd3"},"breadcrumb":{"@id":"https:\/\/new.krafton.ai\/en\/finding-an-llm-thats-truly-good-at-gaming-the-birth-of-the-orak-benchmark\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/new.krafton.ai\/en\/finding-an-llm-thats-truly-good-at-gaming-the-birth-of-the-orak-benchmark\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/new.krafton.ai\/en\/finding-an-llm-thats-truly-good-at-gaming-the-birth-of-the-orak-benchmark\/#primaryimage","url":"https:\/\/krafton.ai\/wp-content\/uploads\/2026\/02\/IMG_9543-2048x1365-1.webp","contentUrl":"https:\/\/krafton.ai\/wp-content\/uploads\/2026\/02\/IMG_9543-2048x1365-1.webp","width":2048,"height":1365,"caption":"(\uc0ac\uc9c41) Orak \ubca4\uce58\ub9c8\ud06c \ud300"},{"@type":"BreadcrumbList","@id":"https:\/\/new.krafton.ai\/en\/finding-an-llm-thats-truly-good-at-gaming-the-birth-of-the-orak-benchmark\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"\ud648","item":"https:\/\/www.krafton.ai\/en\/"},{"@type":"ListItem","position":2,"name":"Finding an LLM That\u2019s Truly Good at Gaming! The Birth of the \u2018Orak\u2019 Benchmark"}]},{"@type":"WebSite","@id":"http:\/\/172.31.17.166\/#website","url":"http:\/\/172.31.17.166\/","name":"Krafton AI","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"http:\/\/172.31.17.166\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"http:\/\/172.31.17.166\/#\/schema\/person\/bd4b2c1522ef1280992667d8db878dd3","name":"Manager","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/608aefb8ff6fee4dd437f2319412d7508273b7d0a367465f2f7ab5a9bb1f8c50?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/608aefb8ff6fee4dd437f2319412d7508273b7d0a367465f2f7ab5a9bb1f8c50?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/608aefb8ff6fee4dd437f2319412d7508273b7d0a367465f2f7ab5a9bb1f8c50?s=96&d=mm&r=g","caption":"Manager"},"sameAs":["https:\/\/new.krafton.ai"],"url":"https:\/\/krafton.ai\/en\/author\/manager\/"}]}},"_links":{"self":[{"href":"https:\/\/krafton.ai\/en\/wp-json\/wp\/v2\/posts\/6949","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/krafton.ai\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/krafton.ai\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/krafton.ai\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/krafton.ai\/en\/wp-json\/wp\/v2\/comments?post=6949"}],"version-history":[{"count":4,"href":"https:\/\/krafton.ai\/en\/wp-json\/wp\/v2\/posts\/6949\/revisions"}],"predecessor-version":[{"id":7181,"href":"https:\/\/krafton.ai\/en\/wp-json\/wp\/v2\/posts\/6949\/revisions\/7181"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/krafton.ai\/en\/wp-json\/wp\/v2\/media\/6948"}],"wp:attachment":[{"href":"https:\/\/krafton.ai\/en\/wp-json\/wp\/v2\/media?parent=6949"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/krafton.ai\/en\/wp-json\/wp\/v2\/categories?post=6949"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/krafton.ai\/en\/wp-json\/wp\/v2\/tags?post=6949"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}