Search results

Inconsistency between the 'file_content' field and the acutal repository file content (e.g., task 62e60f37d76274f8a4026dfd)

Status: Open.

#19 In CoderEval/CoderEval;

· Espresso-Kp opened on Aug 30, 2025

Mismatch between CoderEval4Python.json and provided repositories (e.g., run_command function)

Status: Open.

#18 In CoderEval/CoderEval;

· YusufEmreGenc opened on Aug 1, 2025

The docker is not available now

Status: Open.

#17 In CoderEval/CoderEval;

· Wwstarry opened on Jul 15, 2025

About dataset properties

Status: Open.

#16 In CoderEval/CoderEval;

· TomasAndersonFang opened on Apr 10, 2025

CoderEval Evaluation

Status: Open.

#15 In CoderEval/CoderEval;

· ZimaBlue307 opened on Jan 22, 2025

The link (Google Drive) of Docker is unseen now.

Status: Open.

#14 In CoderEval/CoderEval;

· nnRoy opened on Dec 25, 2024

How to use CoderEval to evaluate other LLM's? / Enabling CoderEval to Evaluate Various LLMs Beyond Default Models

Status: Open.

#13 In CoderEval/CoderEval;

· jjosorioc opened on Nov 5, 2024

Some problems about test cases and fields

Status: Open.

#12 In CoderEval/CoderEval;

· baday19 opened on Jan 29, 2024

How to get python and java related project code?

Status: Open.

#9 In CoderEval/CoderEval;

· DongchenZhou opened on Dec 6, 2023

Does LLM know about other methods in the same class?

Status: Open.

#8 In CoderEval/CoderEval;

· yeren66 opened on Nov 30, 2023

Where to find the leaderboard?

Status: Open.

#6 In CoderEval/CoderEval;

· zhimin-z opened on Nov 16, 2023

"oracle_context" and "all_context" are meaningless in terms of evaluating

Status: Open.

#1 In CoderEval/CoderEval;

· felixhao28 opened on Feb 13, 2023