Qiskit HumanEval

Quantum Verifiable Rewards for Post-Training Qiskit Code Assistant

Qiskit is an open-source quantum computing framework that allows users to design, simulate, and run quantum circuits on real quantum hardware. We explore post-training techniques …

nicolas-dupuis
•
New Qiskit HumanEval Release: Qiskit 1.4 Compatibility and Benchmark Improvements featured image

New Qiskit HumanEval Release: Qiskit 1.4 Compatibility and Benchmark Improvements

Released a new version of Qiskit HumanEval compatible with Qiskit 1.4, featuring significant improvements to the benchmark including more robust and rigorous code execution tests …

avatar
Juan Cruz-Benito
•
Presenting Qiskit HumanEval at IEEE Quantum Week 2024 featured image

Presenting Qiskit HumanEval at IEEE Quantum Week 2024

Presenting the Qiskit HumanEval benchmark for LLMs at IEEE Quantum Week 2024 in the SYS-BNCH Benchmarking session. Available afterwards at the IBM Quantum booth to discuss AI and …

avatar
Juan Cruz-Benito
•

Qiskit HumanEval: An Evaluation Benchmark For Quantum Code Generative Models

Quantum programs are typically developed using quantum Software Development Kits (SDKs). The rapid advancement of quantum computing necessitates new tools to streamline this …

sanjay-vishwakarma
•
Qiskit HumanEval: Evaluation Benchmark for Quantum Code Generation Published featured image

Qiskit HumanEval: Evaluation Benchmark for Quantum Code Generation Published

Published research paper introducing Qiskit HumanEval dataset for evaluating Large Language Models capability to generate quantum computing code. The dataset comprises more than …

avatar
Juan Cruz-Benito
•