Version 1.0 - Tasks

[laurentsenta]

(wip)

• Use
  • Use the action in Kubo CI ci: add gateway-conformance tests for kubo-gateway kubo#9780
  • use in boxo ci(gateway): enable subdomain conformance boxo#246
  • use in bifrost-gateway CIs Run new gateway-conformance tests in CI ipfs-inactive/bifrost-gateway#63
  • Implement a "gateway conformance dashboard" in grafana - track conformance testing for every client repo
    • WIP
  • document the actions in the README.md
  • Validate (and improve if needed) the local dev usage - currently we documented large, convoluted, docker run commands - README: document usage #102
• Port all the tests
  • Start With Port gateway-block, gateway-car, and gateway-ipns-record tests to this suite #3
  • port gateway subdomains tests feat: make subdomain testing possible #9
    • Look into DNS resolver (feat: make subdomain testing possible #9)
  • port IPNS tests
    • Look into IPNS record importers Add ipns record support #10
    • Look into DNS Link "importers" Add dnslink support #22
  • port t0116 #93
  • Port all "simple" sharness tests #26
• Implement the entry point as a binary that can take complex arguments (like optional gateway, etc)
  • add an option to enable failing / passing tests (for our CI) - maybe?
  • add an option for optional test subdomains (feat: add entrypoint #14)
• Project Maintenance
  • Decide: Move to unified CI? - feat: improve testing #103 (comment)
  • Move to unified CI - add ipfs/gateway-conformance protocol/.github#535 - ci: update Unified CI configuration #107
• Implement tests
  • Test the checkers and reporters, especially Shell Check.
  • Test the frameworks (unit-tests)
  • Test the test suite with multiple targets (especially subdomains, with https://dweb.link/ for example) Test production gateways #104
• update specs support
  • feat: turn entrypoint into gateway-conformance CLI #15 (comment)

Pre-release

• [-] add a regression test for non-inlined dnslinks on localhost tests
  • See feat: update t0114 #53
  • Add a regression test for non-inlined dnslinks on localhost tests #118
• Update the way we work with ipns records
  • See feat: update t0114 #53 (comment)
  • 150a3df

Follow-Ups

• EPIC: Test the framework #119
• EPIC: Specs Integration and Status Reporting (Step 1) #120

[laurentsenta]

ipfs things: 14th of April, plan to come.

[laurentsenta]

note from Lidel on testing hamt: ipfs/kubo#9681 (review)

[laurentsenta]

ipfs things workshop relates notes (wip): https://github.com/ipfs/gateway-conformance/blob/workshop-ipfsthing23/docs/workshop-ipfsthing23.md

[laurentsenta]

(moved cassette testing to a follow-up task, we'll investigate later, related: #29)

[laurentsenta]

Closing this 🥳

cc @galargh