Text and agentic tasks: these benchmarks measure how well a model reasons, writes code and acts as an agent. Comet 60B nearly matches the original on GPQA Diamond, a set of graduate-level science questions (88.57 vs 90.40), SWE-bench Pro, which asks the model to resolve real software engineering issues (51.48 vs 52.44) and τ²-Bench, which tests agents that use tools to complete customer service tasks (81.01 vs 81.48). It also scores above the previous-generation NVIDIA Nemotron 3 Super on all eight benchmarks shown.
Text and agentic tasks: these benchmarks measure how well a model reasons, writes code and acts as an agent. Comet 60B nearly matches the original on GPQA Diamond, a set of graduate-level science questions (88.57 vs 90.40), SWE-bench Pro, which asks the model to resolve real software engineering issues (51.48 vs 52.44) and τ²-Bench, which tests agents that use tools to complete customer service tasks (81.01 vs 81.48). It also scores above the previous-generation NVIDIA Nemotron 3 Super on all eight benchmarks shown.