Live
Black Hat USAAI BusinessBlack Hat AsiaAI BusinessSony Acquires Machine Learning Company Cinemersive Labs - 80 LevelGoogle News: Machine LearningHow Wall Street tries to keep junior hours in check, from weekly guidelines to 'pencils down' periodsBusiness InsiderMcKinsey's new AI leadership playbook: flatten teams and move fasterBusiness InsiderCalifornia cements its role as the national testing ground for AI rules - AxiosGNews AI regulationEconomists Once Dismissed the A.I. Job Threat, but Not Anymore - nytimes.comGoogle News: AINational AI Strategy Committee discusses South Korea-France AI cooperation with Mistral - 디지털투데이Google News - Mistral AI FranceTech billionaires want to put data centers in space. The math could get ugly fast.Business InsiderStudent Parker Jones calls out college professors for being slow on AIBusiness InsiderThe clock is ticking on law's billable hour, says a top Cleary Gottlieb lawyerBusiness InsiderGoogle Introduces Gemma 4 Open-Source AI Model, Enables Building Autonomous Agents - gadgets360.comGNews AI open sourceLocal colleges ready students for a workforce laden with artificial intelligence - WXXI NewsGoogle News: AIScientists question why anyone would put data centers in space—a big bet for tech leaders like Elon Musk - Business InsiderGoogle News - Scale AI dataBlack Hat USAAI BusinessBlack Hat AsiaAI BusinessSony Acquires Machine Learning Company Cinemersive Labs - 80 LevelGoogle News: Machine LearningHow Wall Street tries to keep junior hours in check, from weekly guidelines to 'pencils down' periodsBusiness InsiderMcKinsey's new AI leadership playbook: flatten teams and move fasterBusiness InsiderCalifornia cements its role as the national testing ground for AI rules - AxiosGNews AI regulationEconomists Once Dismissed the A.I. Job Threat, but Not Anymore - nytimes.comGoogle News: AINational AI Strategy Committee discusses South Korea-France AI cooperation with Mistral - 디지털투데이Google News - Mistral AI FranceTech billionaires want to put data centers in space. The math could get ugly fast.Business InsiderStudent Parker Jones calls out college professors for being slow on AIBusiness InsiderThe clock is ticking on law's billable hour, says a top Cleary Gottlieb lawyerBusiness InsiderGoogle Introduces Gemma 4 Open-Source AI Model, Enables Building Autonomous Agents - gadgets360.comGNews AI open sourceLocal colleges ready students for a workforce laden with artificial intelligence - WXXI NewsGoogle News: AIScientists question why anyone would put data centers in space—a big bet for tech leaders like Elon Musk - Business InsiderGoogle News - Scale AI data
AI NEWS HUBbyEIGENVECTOREigenvector

Detecting and Mitigating Flakiness in REST API Fuzzing

arXiv cs.SEby [Submitted on 30 Mar 2026]March 31, 20262 min read1 views
Source Quiz

arXiv:2603.28452v1 Announce Type: new Abstract: Test flakiness is a common problem in industry, which hinders the reliability of automated build and testing workflows. Most existing research on test flakiness has primarily focused on unit and small-scale integration tests. In contrast, flakiness in system-level testing such as REST APIs are comparatively under-explored. A large body of literature has been dedicated to the topic of fuzzing REST APIs, whereas relatively little attention has been paid to detecting and possibly mitigating negative effects of flakiness in this context. To fill this major gap, in this paper, we study the flakiness of tests generated by one of the popularly applied REST API fuzzer in the literature, namely EvoMaster, conduct empirical studies with a corpus of 36

View PDF HTML (experimental)

Abstract:Test flakiness is a common problem in industry, which hinders the reliability of automated build and testing workflows. Most existing research on test flakiness has primarily focused on unit and small-scale integration tests. In contrast, flakiness in system-level testing such as REST APIs are comparatively under-explored. A large body of literature has been dedicated to the topic of fuzzing REST APIs, whereas relatively little attention has been paid to detecting and possibly mitigating negative effects of flakiness in this context. To fill this major gap, in this paper, we study the flakiness of tests generated by one of the popularly applied REST API fuzzer in the literature, namely EvoMaster, conduct empirical studies with a corpus of 36 REST APIs to understand flakiness of REST APIs. Based on the results of the empirical studies, we categorize and analyze flakiness sources by inspecting near 3000 failing tests. Based on the understanding, we propose FlakyCatch to detect and mitigate flakiness in REST APIs and empirically evaluate its performance. Results show that FlakyCatch is effective in detecting and handling flakiness in tests generated by white-box and black-box fuzzers.

Subjects:

Software Engineering (cs.SE)

Cite as: arXiv:2603.28452 [cs.SE]

(or arXiv:2603.28452v1 [cs.SE] for this version)

https://doi.org/10.48550/arXiv.2603.28452

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Man Zhang [view email] [v1] Mon, 30 Mar 2026 13:56:10 UTC (430 KB)

Was this article helpful?

Sign in to highlight and annotate this article

AI
Ask AI about this article
Powered by Eigenvector · full article context loaded
Ready

Conversation starters

Ask anything about this article…

Daily AI Digest

Get the top 5 AI stories delivered to your inbox every morning.

Knowledge Map

Knowledge Map
TopicsEntitiesSource
Detecting a…announceintegrationstudypaperarxivresearcharXiv cs.SE

Connected Articles — Knowledge Graph

This article is connected to other articles through shared AI topics and tags.

Knowledge Graph100 articles · 158 connections
Scroll to zoom · drag to pan · click to open

Discussion

Sign in to join the discussion

No comments yet — be the first to share your thoughts!

More in Research Papers