Testing and Buildbots

• Running and Writing Tests
  • Running
    • Unexpected Skips
  • Writing
  • Benchmarks
• Silence Warnings From the Test Suite
• Increase Test Coverage
  • Common Gotchas
  • Measuring Coverage
    • Using coverage.py
      • Install Coverage
      • Basic Usage
      • Branch Coverage
      • Coverage Results For Modules Imported Early On
    • Using test.regrtest
  • Filing the Issue
  • Measuring coverage of C code with gcov and lcov
• Working with Buildbots
  • In case of trouble
  • Buildbot failures on Pull Requests
  • Checking results of automatic builds
  • Stability
  • Flags-dependent failures
  • Ordering-dependent failures
  • Transient failures
  • Custom builders
• New Buildbot Workers
  • Preparing for buildbot worker setup
  • Setting up the buildbot worker
    • Conventional always-on machines
    • Latent workers
  • Buildbot worker operation
  • Required Ports
  • Required Resources
  • Security Considerations