Toga: A neural method for test oracle generation

E Dinella, G Ryan, T Mytkowicz, SK Lahiri - Proceedings of the 44th …, 2022 - dl.acm.org
Testing is widely recognized as an important stage of the software development lifecycle.
Effective software testing can provide benefits such as bug finding, preventing regressions …

Enchanting program specification synthesis by large language models using static analysis and program verification

C Wen, J Cao, J Su, Z Xu, S Qin, M He, H Li… - … on Computer Aided …, 2024 - Springer
Formal verification provides a rigorous and systematic approach to ensure the correctness
and reliability of software systems. Yet, constructing specifications for the full proof relies on …

Docter: Documentation-guided fuzzing for testing deep learning api functions

D **e, Y Li, M Kim, HV Pham, L Tan, X Zhang… - Proceedings of the 31st …, 2022 - dl.acm.org
Input constraints are useful for many software development tasks. For example, input
constraints of a function enable the generation of valid inputs, ie, inputs that follow these …

Impact of large language models on generating software specifications

D **e, B Yoo, N Jiang, M Kim, L Tan, X Zhang… - arxiv preprint arxiv …, 2023 - arxiv.org
Software specifications are essential for ensuring the reliability of software systems. Existing
specification extraction approaches, however, suffer from limited generalizability and require …

Llm-powered test case generation for detecting tricky bugs

K Liu, Y Liu, Z Chen, JM Zhang, Y Han, Y Ma… - arxiv preprint arxiv …, 2024 - arxiv.org
Conventional automated test generation tools struggle to generate test oracles and tricky
bug-revealing test inputs. Large Language Models (LLMs) can be prompted to produce test …

Towards more realistic evaluation for neural test oracle generation

Z Liu, K Liu, X **a, X Yang - Proceedings of the 32nd ACM SIGSOFT …, 2023 - dl.acm.org
Unit testing has become an essential practice during software development and
maintenance. Effective unit tests can help guard and improve software quality but require a …

Hotgpt: How to make software documentation more useful with a large language model?

Y Su, C Wan, U Sethi, S Lu, M Musuvathi… - Proceedings of the 19th …, 2023 - dl.acm.org
It is well known that valuable information is contained in the natural language components of
software systems, like comments and manual, and such information can be used to improve …

{CarpetFuzz}: Automatic Program Option Constraint Extraction from Documentation for Fuzzing

D Wang, Y Li, Z Zhang, K Chen - 32nd USENIX Security Symposium …, 2023 - usenix.org
The large-scale code in software supports the rich and diverse functionalities, and at the
same time contains potential vulnerabilities. Fuzzing, as one of the most popular …

Automated attack synthesis by extracting finite state machines from protocol specification documents

ML Pacheco, M von Hippel, B Weintraub… - … IEEE Symposium on …, 2022 - ieeexplore.ieee.org
Automated attack discovery techniques, such as attacker synthesis or model-based fuzzing,
provide powerful ways to ensure network protocols operate correctly and securely. Such …

Automated program repair, what is it good for? not absolutely nothing!

H Eladawy, C Le Goues, Y Brun - Proceedings of the IEEE/ACM 46th …, 2024 - dl.acm.org
Industrial deployments of automated program repair (APR), eg, at Facebook and Bloomberg,
signal a new milestone for this exciting and potentially impactful technology. In these …