Skip to main navigation Skip to search Skip to main content

Evaluating an OpenClaw-Based Workflow for Smart Contract Audit Report Generation

  • Nanzhu YIN
  • , Yaxuan ZHANG
  • , Zhiyu XU
  • , Chengzu DONG*
  • *Corresponding author for this work

Research output: Book Chapters | Papers in Conference Proceedings › Conference paper (refereed) › Referred Conference Paper › peer-review

Abstract

Smart contract auditing often requires project-level reasoning over business logic, state updates, oracle assumptions, and economic invariants. This paper evaluates an OpenClaw-based blockchain audit workflow for source-grounded smart contract vulnerability report generation. The technical contribution is a reproducible agentic workflow that converts project-level Solidity analysis into staged and inspectable JSON artifacts rather than a one-shot LLM answer. On 102 Web3Bugs-derived project reports, the workflow produces 96 valid JSON reports, a 94.12% JSON success rate, and 245 extracted findings across 21 normalized categories. We further conduct a conservative project-level code-based alignment against 469 filtered Web3Bugs ground-truth bugs. Strict matching gives 35 TP, 198 FP, 408 FN, and 26 partial matches, with precision, recall, and F1 of 0.150, 0.075, and 0.100. Counting partial matches as half credit increases weighted precision, recall, and F1 to 0.195, 0.102, and 0.134. The results show that the workflow can generate structured blockchain audit artifacts, but its current vulnerability-detection accuracy remains limited under strict Web3Bugs alignment.
Original languageEnglish
Title of host publication2026 6th International Conference on Computer Science and Blockchain (CCSB): Proceedings
PublisherIEEE
Pages1-4
Number of pages4
ISBN (Electronic)9798319506252
DOIs
Publication statusPublished - Aug 2026
Event2026 6th International Conference on Computer Science and Blockchain - Zhuhai, China
Duration: 21 Aug 2026 → 23 Aug 2026

Conference

Conference2026 6th International Conference on Computer Science and Blockchain
Abbreviated titleCCSB 2026
Country/TerritoryChina
CityZhuhai
Period21/08/26 → 23/08/26

Keywords

  • smart contracts
  • blockchain security
  • vulnerability detection
  • large language models

Fingerprint

Dive into the research topics of 'Evaluating an OpenClaw-Based Workflow for Smart Contract Audit Report Generation'. Together they form a unique fingerprint.

Cite this