LLM Benchmarking Workshop Slated for Dec. 9th

On December 9, 2025, the Si2 LLM Benchmarking Coalition (LBC) is holding a hybrid in-person/virtual workshop in Sunnyvale, CA. Leaders from 16 semiconductor design and EDA companies and 8 academic/research institutions who are members of the coalition and invited guests will participate in the technical, interactive workshop administered by Si2 and held on the Synopsys campus. The workshop will be led by Nate Pinckney, Senior Research Scientist at Nvidia (LBC Chair), and Igor Markov, Distinguished Architect at Synopsys and IEEE Fellow (LBC vice-chair). Also present to lead working group breakouts will be Prof. Chinmay Hegde, NYU (Chair of the LBC Leaderboard and Reporting WG) and Ehsan Degan, Research Manager -IBM (Chair of the LBC Interoperability WG).

The goal of the workshop is to make progress in three important areas:

Ideation for expanding benchmarking for semiconductor design
Establishing a trusted and informative leaderboard, and
Providing flexibility through new methods of interoperability

The LBC was formed in 2025, and its membership has been growing steadily. The purpose of the coalition is to expedite the development of high-quality LLMs for semiconductor design by creating relevant and comprehensive evaluation datasets and metrics for semiconductor design problems. For more information on the workshop or joining this coalition please contact Si2.

For a current list of members visit: https://si2.org/llm-benchmarking-coalition/