HackingBuddyGPT 0.3.0

European Summer'24 Heatwave edition

Version 0.3 contains a massive refactoring and rewrite of our code-base (by @Neverbolt and @andreashappe), laying the groundwork for future features. Meanwhile, @DianaStrauss was improving the Web API testing agent.

Also see our latest hacking benchmark results for multiple models.

Notable user-visible changes:

• GitHub Models are now supported as LLM backend
• the hackingBuddyGPT CLI is installed (alias to the wintermute CLI) to provide consistency
• massively improved web api testing agent:
  • new response analyzer to create a report from the testing findings
  • prompt engineering: improved prompt creation, now categorized into task and state planning prompts
  • Streamlined the OpenAPI documentation generation (reconnaissance) process
• restructured introductory usecases and agents
  • moved them into src/hackingbuddygpt/usecases/examples
  • their names (used by the CLI) start with Ex
• bump minimal python version to python 3.10

Notable developer-visible changes:

• allow for streaming responses from LLMs
• The class hierarchy has been refactored. UseCases showcase the different hacking behaviors provided hackingBuddyGPT. They offer developers flexibility how they implement their hacking techniques. To streamline development, we introduce the Agent base-class. Agents perform hacking in steps/rounds. Developers can automatically wrap an Agent within a usecases to integrate new agents with minimal development overhead into hackingBuddyGPT. For more information, see our documentation.
• massively increased test coverage

What's Changed

• Update README.md by @eltociear in https://github.com/ipa-lab/hackingBuddyGPT/pull/66
• some type hint fixes and a first integration test by @andreashappe in https://github.com/ipa-lab/hackingBuddyGPT/pull/67
• Create python-app.yml by @andreashappe in https://github.com/ipa-lab/hackingBuddyGPT/pull/69
• Update python-app.yml by @andreashappe in https://github.com/ipa-lab/hackingBuddyGPT/pull/70
• add more test-cases (also test github integration) by @andreashappe in https://github.com/ipa-lab/hackingBuddyGPT/pull/68
• Improve API and make streaming responses possible by @Neverbolt in https://github.com/ipa-lab/hackingBuddyGPT/pull/71
• Explorative refactoring by @andreashappe in https://github.com/ipa-lab/hackingBuddyGPT/pull/73
• merge diana's changes (and fixes) into development by @andreashappe in https://github.com/ipa-lab/hackingBuddyGPT/pull/74
• Development without spacy by @DianaStrauss in https://github.com/ipa-lab/hackingBuddyGPT/pull/76
• Development without spacy by @DianaStrauss in https://github.com/ipa-lab/hackingBuddyGPT/pull/80
• merge the current development branch into master by @andreashappe in https://github.com/ipa-lab/hackingBuddyGPT/pull/81
• Improved WebAPITesting by @DianaStrauss in https://github.com/ipa-lab/hackingBuddyGPT/pull/82
• add more web-api-testing changes, fix unittest by @andreashappe in https://github.com/ipa-lab/hackingBuddyGPT/pull/83

Full Changelog: https://github.com/ipa-lab/hackingBuddyGPT/compare/v0.2.1...v0.3.0