Quelle  raptor.rst   Sprache: unbekannt

######
Raptor
######

Raptor is a performance-testing framework for running browser pageload and browser benchmark tests. Raptor is cross-browser compatible and is currently running in production on Firefox Desktop, Firefox Android GeckoView, Fenix, Reference Browser, Chromium, Chrome, Chrome for Android, Safari, and Safari Technology Preview.

- Contact: Dave Hunt [:davehunt]
- Source code: https://searchfox.org/mozilla-central/source/testing/raptor
- Good first bugs: https://codetribute.mozilla.org/projects/automation?project%3DRaptor

Raptor currently supports three test types: 1) page-load performance tests, 2) standard benchmark-performance tests, and 3) "scenario"-based tests, such as power, CPU, and memory-usage measurements on Android and Desktop.

Locally, Raptor can be invoked with the following command:

::

    ./mach raptor


.. toctree::
   :titlesonly:

   browsertime
   debugging
   contributing
   raptor-metrics

.. contents::
   :depth: 2
   :local:

Raptor tests
************

The following documents all testing we have for Raptor.

Benchmarks
----------
Standard benchmarks are third-party tests (i.e. Speedometer) that we have integrated into Raptor to run per-commit in our production CI. To update any of these benchmarks, see `Updating Benchmark Tests <browsertime.html#updating-benchmark-tests>`_.


.. dropdown:: ares6
   :class-container: anchor-id-ares6-b

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t ares6

   **Owner**: :jandem and SpiderMonkey Team

   * **alert threshold**: 2.0
   * **apps**: firefox, chrome, safari
   * **expected**: pass
   * **expose browser profiler**: true
   * **gecko profile interval**: 1
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/ares6.toml#16>`__
   * **lower is better**: true
   * **page cycles**: 4
   * **page timeout**: 270000
   * **subtest lower is better**: true
   * **subtest unit**: ms
   * **test url**: `<http://\<host\>:\<port\>/ARES-6/index.html?raptor>`__
   * **type**: benchmark
   * **unit**: ms
   * **Test Task**:

   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-ares6**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-ares6**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-ares6**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-chrome-ares6**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-firefox-ares6**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-ares6**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-ares6**
        - ✅
        - ✅
        - ❌
        - ❌
      * - **browsertime-benchmark-safari-ares6**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-ares6**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-ares6**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-ares6**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-chrome-ares6**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-firefox-ares6**
        - ✅
        - ✅
        - ❌
        - ❌



.. dropdown:: assorted-dom
   :class-container: anchor-id-assorted-dom-b

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t assorted-dom

   **Owner**: PerfTest Team

   * **alert threshold**: 2.0
   * **apps**: firefox, chrome, safari
   * **expected**: pass
   * **expose browser profiler**: true
   * **gecko profile interval**: 1
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/assorted-dom.toml#15>`__
   * **lower is better**: true
   * **page cycles**: 1
   * **page timeout**: 60000
   * **repository**: https://github.com/mozilla/perf-automation
   * **repository path**: benchmarks/assorted-dom
   * **repository revision**: 61332db584026b73e37066d717a162825408c36b
   * **screen capture**: true
   * **test url**: `<http://\<host\>:\<port\>/assorted/driver.html?raptor>`__
   * **type**: benchmark
   * **unit**: ms
   * **Test Task**:

   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-assorted-dom**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-assorted-dom**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-assorted-dom**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-chrome-assorted-dom**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-firefox-assorted-dom**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-assorted-dom**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-assorted-dom**
        - ✅
        - ✅
        - ❌
        - ❌
      * - **browsertime-benchmark-safari-assorted-dom**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-assorted-dom**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-assorted-dom**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-assorted-dom**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-chrome-assorted-dom**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-firefox-assorted-dom**
        - ✅
        - ✅
        - ❌
        - ❌



.. dropdown:: jetstream2
   :class-container: anchor-id-jetstream2-b

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t jetstream2

   **Owner**: :jandem and SpiderMonkey Team

   * **alert threshold**: 2.0
   * **apps**: firefox, chrome, safari, custom-car
   * **expected**: pass
   * **expose browser profiler**: true
   * **gecko profile interval**: 1
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/jetstream2.toml#16>`__
   * **lower is better**: false
   * **page cycles**: 4
   * **page timeout**: 2000000
   * **repository**: https://github.com/mozilla/perf-automation
   * **repository path**: benchmarks/JetStream2
   * **repository revision**: 61332db584026b73e37066d717a162825408c36b
   * **subtest lower is better**: false
   * **subtest unit**: score
   * **test url**: `<http://\<host\>:\<port\>/index.html?raptor>`__
   * **type**: benchmark
   * **unit**: score
   * **Test Task**:

   .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-jetstream2-chrome-m-jetstream2**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-jetstream2-chrome-m-jetstream2-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-jetstream2-cstm-car-m-jetstream2**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-jetstream2-cstm-car-m-jetstream2-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-jetstream2-fenix-jetstream2**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-jetstream2-fenix-jetstream2-nofis**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-jetstream2-geckoview-jetstream2**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-jetstream2-geckoview-jetstream2-nofis**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-android-hw-a55-14-0-aarch64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-jetstream2-fenix-jetstream2**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-jetstream2-fenix-jetstream2-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-jetstream2-geckoview-jetstream2**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-jetstream2-geckoview-jetstream2-nofis**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-jetstream2**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-jetstream2**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-jetstream2**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-chrome-jetstream2**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-firefox-jetstream2**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1400-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-chrome-jetstream2**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-custom-car-jetstream2**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-firefox-jetstream2**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-safari-jetstream2**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-jetstream2**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-jetstream2**
        - ✅
        - ✅
        - ❌
        - ❌
      * - **browsertime-benchmark-safari-jetstream2**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-jetstream2**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-jetstream2**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-jetstream2**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-chrome-jetstream2**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-firefox-jetstream2**
        - ✅
        - ✅
        - ❌
        - ❌


   **Owner**: :jandem and SpiderMonkey Team

   * **alert threshold**: 2.0
   * **apps**: fenix, geckoview, chrome-m, cstm-car-m
   * **expected**: pass
   * **expose browser profiler**: true
   * **gecko profile interval**: 1
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/jetstream2-mobile.toml#16>`__
   * **lower is better**: false
   * **page cycles**: 4
   * **page timeout**: 2000000
   * **repository**: https://github.com/mozilla/perf-automation
   * **repository path**: benchmarks/JetStream2
   * **repository revision**: 61332db584026b73e37066d717a162825408c36b
   * **subtest lower is better**: false
   * **subtest unit**: score
   * **test url**: `<http://\<host\>:\<port\>/index.html?raptor>`__
   * **type**: benchmark
   * **unit**: score
   * **Test Task**:

   .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-jetstream2-chrome-m-jetstream2**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-jetstream2-chrome-m-jetstream2-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-jetstream2-cstm-car-m-jetstream2**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-jetstream2-cstm-car-m-jetstream2-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-jetstream2-fenix-jetstream2**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-jetstream2-fenix-jetstream2-nofis**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-jetstream2-geckoview-jetstream2**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-jetstream2-geckoview-jetstream2-nofis**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-android-hw-a55-14-0-aarch64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-jetstream2-fenix-jetstream2**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-jetstream2-fenix-jetstream2-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-jetstream2-geckoview-jetstream2**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-jetstream2-geckoview-jetstream2-nofis**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-jetstream2**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-jetstream2**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-jetstream2**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-chrome-jetstream2**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-firefox-jetstream2**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1400-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-chrome-jetstream2**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-custom-car-jetstream2**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-firefox-jetstream2**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-safari-jetstream2**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-jetstream2**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-jetstream2**
        - ✅
        - ✅
        - ❌
        - ❌
      * - **browsertime-benchmark-safari-jetstream2**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-jetstream2**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-jetstream2**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-jetstream2**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-chrome-jetstream2**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-firefox-jetstream2**
        - ✅
        - ✅
        - ❌
        - ❌



.. dropdown:: matrix-react-bench
   :class-container: anchor-id-matrix-react-bench-b

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t matrix-react-bench

   **Owner**: :jandem and SpiderMonkey Team

   * **alert threshold**: 2.0
   * **apps**: firefox, chrome
   * **expected**: pass
   * **expose browser profiler**: true
   * **gecko profile interval**: 1
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/matrix-react-bench.toml#16>`__
   * **lower is better**: true
   * **page cycles**: 30
   * **page timeout**: 2000000
   * **repository**: https://github.com/mozilla/perf-automation
   * **repository path**: benchmarks/matrix-react-bench
   * **repository revision**: 61332db584026b73e37066d717a162825408c36b
   * **subtest lower is better**: true
   * **subtest unit**: ms
   * **test url**: `<http://\<host\>:\<port\>/matrix_demo.html>`__
   * **type**: benchmark
   * **unit**: ms
   * **Test Task**:

   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-matrix-react-bench**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-matrix-react-bench**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-matrix-react-bench**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-chrome-matrix-react-bench**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-firefox-matrix-react-bench**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-matrix-react-bench**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-matrix-react-bench**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-matrix-react-bench**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-matrix-react-bench**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-matrix-react-bench**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-chrome-matrix-react-bench**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-firefox-matrix-react-bench**
        - ✅
        - ✅
        - ❌
        - ❌



.. dropdown:: motionmark-1-3
   :class-container: anchor-id-motionmark-1-3-b

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t motionmark-1-3

   **Owner**: Graphics Team

   * **alert threshold**: 2.0
   * **apps**: firefox, chrome, safari, custom-car
   * **browser cycles**: 1
   * **cold**: true
   * **expected**: pass
   * **expose browser profiler**: true
   * **expose chrome trace**: true
   * **gecko profile features**: stackwalk,js,cpu,java,processcpu,memory
   * **gecko profile interval**: 1
   * **gecko profile threads**: GeckoMain,Compositor,Renderer,SwComposite,RenderBackend,SceneBuilder,WrWorker,CanvasWorkers,TextureUpdate
   * **host from parent**: false
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/motionmark-1-3-desktop.toml#13>`__
   * **lower is better**: false
   * **page cycles**: 1
   * **page timeout**: 600000
   * **repository**: https://github.com/webkit/motionmark
   * **repository revision**: be2a5fea89b6ef411b053ebeb95a6302b3dc0ecb
   * **subtest lower is better**: false
   * **subtest unit**: score
   * **suite name**: MotionMark
   * **support class**: motionmark-1-3.py
   * **test script**: motionmark-1-3.js
   * **test url**: `<http://\<host\>:\<port\>/MotionMark/developer.html?warmup-length=2000&warmup-frame-count=30&first-frame-minimum-length=0&test-interval=30&display=minimal&tiles=big&controller=ramp&system-frame-rate=60&frame-rate=60&time-measurement=performance>`__
   * **type**: benchmark
   * **unit**: score
   * **Test Task**:

   .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-motionmark-1-3-chrome-m-motionmark-1-3**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-motionmark-1-3-chrome-m-motionmark-1-3-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-motionmark-1-3-cstm-car-m-motionmark-1-3**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-motionmark-1-3-cstm-car-m-motionmark-1-3-nofis**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-motionmark-1-3-fenix-motionmark-1-3**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-motionmark-1-3-fenix-motionmark-1-3-nofis**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-motionmark-1-3-geckoview-motionmark-1-3**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-motionmark-1-3-geckoview-motionmark-1-3-nofis**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-android-hw-a55-14-0-aarch64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-motionmark-1-3-fenix-motionmark-1-3**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-motionmark-1-3-fenix-motionmark-1-3-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-motionmark-1-3-geckoview-motionmark-1-3**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-motionmark-1-3-geckoview-motionmark-1-3-nofis**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-motionmark-1-3**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-motionmark-1-3**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-motionmark-1-3**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-chrome-motionmark-1-3**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-custom-car-motionmark-1-3**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-firefox-motionmark-1-3**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1400-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-chrome-motionmark-1-3**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-custom-car-motionmark-1-3**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-firefox-motionmark-1-3**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-safari-motionmark-1-3**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-motionmark-1-3**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-motionmark-1-3**
        - ✅
        - ✅
        - ❌
        - ❌
      * - **browsertime-benchmark-safari-motionmark-1-3**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-motionmark-1-3**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-motionmark-1-3**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-motionmark-1-3**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-chrome-motionmark-1-3**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-custom-car-motionmark-1-3**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-firefox-motionmark-1-3**
        - ✅
        - ✅
        - ❌
        - ❌


   **Owner**: Graphics Team

   * **alert threshold**: 2.0
   * **apps**: fenix, geckoview, chrome-m, cstm-car-m
   * **browser cycles**: 1
   * **cold**: true
   * **expected**: pass
   * **expose browser profiler**: true
   * **gecko profile features**: stackwalk,js,cpu,java,processcpu,memory
   * **gecko profile interval**: 1
   * **gecko profile threads**: GeckoMain,Compositor,Renderer,SwComposite,RenderBackend,SceneBuilder,WrWorker,CanvasWorkers,TextureUpdate
   * **host from parent**: false
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/motionmark-1-3-mobile.toml#12>`__
   * **lower is better**: false
   * **page cycles**: 1
   * **page timeout**: 600000
   * **repository**: https://github.com/webkit/motionmark
   * **repository revision**: be2a5fea89b6ef411b053ebeb95a6302b3dc0ecb
   * **subtest lower is better**: false
   * **subtest unit**: score
   * **suite name**: MotionMark
   * **support class**: motionmark-1-3.py
   * **test script**: motionmark-1-3.js
   * **test url**: `<http://\<host\>:\<port\>/MotionMark/developer.html?warmup-length=2000&warmup-frame-count=30&first-frame-minimum-length=0&test-interval=30&display=minimal&tiles=big&controller=ramp&system-frame-rate=60&frame-rate=60&time-measurement=performance>`__
   * **type**: benchmark
   * **unit**: score
   * **Test Task**:

   .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-motionmark-1-3-chrome-m-motionmark-1-3**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-motionmark-1-3-chrome-m-motionmark-1-3-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-motionmark-1-3-cstm-car-m-motionmark-1-3**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-motionmark-1-3-cstm-car-m-motionmark-1-3-nofis**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-motionmark-1-3-fenix-motionmark-1-3**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-motionmark-1-3-fenix-motionmark-1-3-nofis**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-motionmark-1-3-geckoview-motionmark-1-3**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-motionmark-1-3-geckoview-motionmark-1-3-nofis**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-android-hw-a55-14-0-aarch64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-motionmark-1-3-fenix-motionmark-1-3**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-motionmark-1-3-fenix-motionmark-1-3-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-motionmark-1-3-geckoview-motionmark-1-3**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-motionmark-1-3-geckoview-motionmark-1-3-nofis**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-motionmark-1-3**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-motionmark-1-3**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-motionmark-1-3**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-chrome-motionmark-1-3**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-custom-car-motionmark-1-3**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-firefox-motionmark-1-3**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1400-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-chrome-motionmark-1-3**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-custom-car-motionmark-1-3**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-firefox-motionmark-1-3**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-safari-motionmark-1-3**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-motionmark-1-3**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-motionmark-1-3**
        - ✅
        - ✅
        - ❌
        - ❌
      * - **browsertime-benchmark-safari-motionmark-1-3**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-motionmark-1-3**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-motionmark-1-3**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-motionmark-1-3**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-chrome-motionmark-1-3**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-custom-car-motionmark-1-3**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-firefox-motionmark-1-3**
        - ✅
        - ✅
        - ❌
        - ❌



.. dropdown:: motionmark-htmlsuite-1-3
   :class-container: anchor-id-motionmark-htmlsuite-1-3-b

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t motionmark-htmlsuite-1-3

   **Owner**: Graphics Team

   * **alert threshold**: 2.0
   * **apps**: firefox, chrome, safari, custom-car
   * **browser cycles**: 1
   * **cold**: true
   * **expected**: pass
   * **expose browser profiler**: true
   * **expose chrome trace**: true
   * **gecko profile features**: stackwalk,js,cpu,java,processcpu,memory
   * **gecko profile interval**: 1
   * **gecko profile threads**: GeckoMain,Compositor,Renderer,SwComposite,RenderBackend,SceneBuilder,WrWorker,CanvasWorkers,TextureUpdate
   * **host from parent**: false
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/motionmark-1-3-desktop.toml#29>`__
   * **lower is better**: false
   * **page cycles**: 1
   * **page timeout**: 600000
   * **repository**: https://github.com/webkit/motionmark
   * **repository revision**: be2a5fea89b6ef411b053ebeb95a6302b3dc0ecb
   * **subtest lower is better**: false
   * **subtest unit**: score
   * **suite name**: HTML suite
   * **support class**: motionmark-1-3.py
   * **test script**: motionmark-1-3.js
   * **test url**: `<http://\<host\>:\<port\>/MotionMark/developer.html?warmup-length=2000&warmup-frame-count=30&first-frame-minimum-length=0&test-interval=30&display=minimal&tiles=big&controller=ramp&system-frame-rate=60&frame-rate=60&time-measurement=performance>`__
   * **type**: benchmark
   * **unit**: score
   * **Test Task**:

   .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-motionmark-1-3-chrome-m-motionmark-htmlsuite-1-3**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-motionmark-1-3-chrome-m-motionmark-htmlsuite-1-3-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-motionmark-1-3-cstm-car-m-motionmark-htmlsuite-1-3**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-motionmark-1-3-cstm-car-m-motionmark-htmlsuite-1-3-nofis**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-motionmark-1-3-fenix-motionmark-htmlsuite-1-3**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-motionmark-1-3-fenix-motionmark-htmlsuite-1-3-nofis**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-motionmark-1-3-geckoview-motionmark-htmlsuite-1-3**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-motionmark-1-3-geckoview-motionmark-htmlsuite-1-3-nofis**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-android-hw-a55-14-0-aarch64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-motionmark-1-3-fenix-motionmark-htmlsuite-1-3**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-motionmark-1-3-fenix-motionmark-htmlsuite-1-3-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-motionmark-1-3-geckoview-motionmark-htmlsuite-1-3**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-motionmark-1-3-geckoview-motionmark-htmlsuite-1-3-nofis**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-chrome-motionmark-htmlsuite-1-3**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-custom-car-motionmark-htmlsuite-1-3**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1400-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-chrome-motionmark-htmlsuite-1-3**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-custom-car-motionmark-htmlsuite-1-3**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-safari-motionmark-htmlsuite-1-3**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3**
        - ✅
        - ✅
        - ❌
        - ❌
      * - **browsertime-benchmark-safari-motionmark-htmlsuite-1-3**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-chrome-motionmark-htmlsuite-1-3**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-custom-car-motionmark-htmlsuite-1-3**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3**
        - ✅
        - ✅
        - ❌
        - ❌


   **Owner**: Graphics Team

   * **alert threshold**: 2.0
   * **apps**: fenix, geckoview, chrome-m, cstm-car-m
   * **browser cycles**: 1
   * **cold**: true
   * **expected**: pass
   * **expose browser profiler**: true
   * **gecko profile features**: stackwalk,js,cpu,java,processcpu,memory
   * **gecko profile interval**: 1
   * **gecko profile threads**: GeckoMain,Compositor,Renderer,SwComposite,RenderBackend,SceneBuilder,WrWorker,CanvasWorkers,TextureUpdate
   * **host from parent**: false
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/motionmark-1-3-mobile.toml#28>`__
   * **lower is better**: false
   * **page cycles**: 1
   * **page timeout**: 600000
   * **repository**: https://github.com/webkit/motionmark
   * **repository revision**: be2a5fea89b6ef411b053ebeb95a6302b3dc0ecb
   * **subtest lower is better**: false
   * **subtest unit**: score
   * **suite name**: HTML suite
   * **support class**: motionmark-1-3.py
   * **test script**: motionmark-1-3.js
   * **test url**: `<http://\<host\>:\<port\>/MotionMark/developer.html?warmup-length=2000&warmup-frame-count=30&first-frame-minimum-length=0&test-interval=30&display=minimal&tiles=big&controller=ramp&system-frame-rate=60&frame-rate=60&time-measurement=performance>`__
   * **type**: benchmark
   * **unit**: score
   * **Test Task**:

   .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-motionmark-1-3-chrome-m-motionmark-htmlsuite-1-3**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-motionmark-1-3-chrome-m-motionmark-htmlsuite-1-3-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-motionmark-1-3-cstm-car-m-motionmark-htmlsuite-1-3**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-motionmark-1-3-cstm-car-m-motionmark-htmlsuite-1-3-nofis**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-motionmark-1-3-fenix-motionmark-htmlsuite-1-3**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-motionmark-1-3-fenix-motionmark-htmlsuite-1-3-nofis**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-motionmark-1-3-geckoview-motionmark-htmlsuite-1-3**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-motionmark-1-3-geckoview-motionmark-htmlsuite-1-3-nofis**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-android-hw-a55-14-0-aarch64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-motionmark-1-3-fenix-motionmark-htmlsuite-1-3**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-motionmark-1-3-fenix-motionmark-htmlsuite-1-3-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-motionmark-1-3-geckoview-motionmark-htmlsuite-1-3**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-motionmark-1-3-geckoview-motionmark-htmlsuite-1-3-nofis**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-chrome-motionmark-htmlsuite-1-3**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-custom-car-motionmark-htmlsuite-1-3**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1400-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-chrome-motionmark-htmlsuite-1-3**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-custom-car-motionmark-htmlsuite-1-3**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-safari-motionmark-htmlsuite-1-3**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3**
        - ✅
        - ✅
        - ❌
        - ❌
      * - **browsertime-benchmark-safari-motionmark-htmlsuite-1-3**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-chrome-motionmark-htmlsuite-1-3**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-custom-car-motionmark-htmlsuite-1-3**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3**
        - ✅
        - ✅
        - ❌
        - ❌



.. dropdown:: speedometer
   :class-container: anchor-id-speedometer-b

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t speedometer

   **Owner**: SpiderMonkey Team

   * **alert threshold**: 2.0
   * **apps**: firefox, chrome, safari, safari-tp, custom-car
   * **expected**: pass
   * **expose browser profiler**: true
   * **gather cpuTime**: true
   * **gecko profile features**: stackwalk,js,cpu,processcpu,ipcmessages,nomarkerstacks
   * **gecko profile interval**: 1
   * **gecko profile threads**: GeckoMain,Compositor,Renderer,TaskController,StyleThread
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/speedometer-desktop.toml#19>`__
   * **lower is better**: false
   * **page cycles**: 5
   * **page timeout**: 600000
   * **subtest lower is better**: true
   * **subtest unit**: ms
   * **test url**: `<http://\<host\>:\<port\>/Speedometer/index.html?raptor>`__
   * **type**: benchmark
   * **unit**: score
   * **Test Task**:

   .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-speedometer-mobile-chrome-m**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer-mobile-chrome-m-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer-mobile-cstm-car-m**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer-mobile-cstm-car-m-nofis**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer-mobile-fenix**
        - ✅
        - ✅
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer-mobile-fenix-nofis**
        - ✅
        - ✅
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer-mobile-geckoview**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer-mobile-geckoview-nofis**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-android-hw-a55-14-0-aarch64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-speedometer-mobile-fenix**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer-mobile-fenix-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer-mobile-geckoview**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer-mobile-geckoview-nofis**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-android-hw-p6-13-0-aarch64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-speedometer-mobile-chrome-m**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer-mobile-chrome-m-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer-mobile-cstm-car-m**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer-mobile-cstm-car-m-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer-mobile-fenix**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer-mobile-fenix-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer-mobile-geckoview**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer-mobile-geckoview-nofis**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-android-hw-s24-14-0-aarch64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-speedometer-mobile-chrome-m**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer-mobile-chrome-m-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer-mobile-cstm-car-m**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer-mobile-cstm-car-m-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer-mobile-fenix**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer-mobile-fenix-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer-mobile-geckoview**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer-mobile-geckoview-nofis**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-speedometer**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-speedometer**
        - ❌
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-speedometer**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-chrome-speedometer**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-custom-car-speedometer**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-firefox-speedometer**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1400-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-chrome-speedometer**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-custom-car-speedometer**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-firefox-speedometer**
        - ✅
        - ✅
        - ❌
        - ❌
      * - **browsertime-benchmark-safari-speedometer**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-speedometer**
        - ❌
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-speedometer**
        - ✅
        - ✅
        - ❌
        - ❌
      * - **browsertime-benchmark-safari-speedometer**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-speedometer**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-speedometer**
        - ❌
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-speedometer**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-chrome-speedometer**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-custom-car-speedometer**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-firefox-speedometer**
        - ✅
        - ✅
        - ❌
        - ❌


   **Owner**: SpiderMonkey Team

   * **alert threshold**: 2.0
   * **apps**: fenix, geckoview, refbrow, chrome-m, cstm-car-m
   * **expected**: pass
   * **expose browser profiler**: true
   * **gather cpuTime**: true
   * **gecko profile features**: stackwalk,js,cpu,processcpu,ipcmessages,nomarkerstacks
   * **gecko profile interval**: 1
   * **gecko profile threads**: GeckoMain,Compositor,Renderer,TaskController,StyleThread
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/speedometer-mobile.toml#19>`__
   * **lower is better**: false
   * **page cycles**: 5
   * **page timeout**: 420000
   * **subtest lower is better**: true
   * **subtest unit**: ms
   * **test url**: `<http://\<host\>:\<port\>/Speedometer/index.html?raptor>`__
   * **type**: benchmark
   * **unit**: score
   * **Test Task**:

   .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-speedometer-mobile-chrome-m**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer-mobile-chrome-m-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer-mobile-cstm-car-m**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer-mobile-cstm-car-m-nofis**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer-mobile-fenix**
        - ✅
        - ✅
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer-mobile-fenix-nofis**
        - ✅
        - ✅
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer-mobile-geckoview**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer-mobile-geckoview-nofis**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-android-hw-a55-14-0-aarch64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-speedometer-mobile-fenix**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer-mobile-fenix-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer-mobile-geckoview**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer-mobile-geckoview-nofis**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-android-hw-p6-13-0-aarch64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-speedometer-mobile-chrome-m**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer-mobile-chrome-m-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer-mobile-cstm-car-m**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer-mobile-cstm-car-m-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer-mobile-fenix**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer-mobile-fenix-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer-mobile-geckoview**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer-mobile-geckoview-nofis**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-android-hw-s24-14-0-aarch64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-speedometer-mobile-chrome-m**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer-mobile-chrome-m-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer-mobile-cstm-car-m**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer-mobile-cstm-car-m-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer-mobile-fenix**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer-mobile-fenix-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer-mobile-geckoview**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer-mobile-geckoview-nofis**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-speedometer**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-speedometer**
        - ❌
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-speedometer**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-chrome-speedometer**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-custom-car-speedometer**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-firefox-speedometer**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1400-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-chrome-speedometer**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-custom-car-speedometer**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-firefox-speedometer**
        - ✅
        - ✅
        - ❌
        - ❌
      * - **browsertime-benchmark-safari-speedometer**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-speedometer**
        - ❌
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-speedometer**
        - ✅
        - ✅
        - ❌
        - ❌
      * - **browsertime-benchmark-safari-speedometer**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-speedometer**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-speedometer**
        - ❌
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-speedometer**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-chrome-speedometer**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-custom-car-speedometer**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-firefox-speedometer**
        - ✅
        - ✅
        - ❌
        - ❌



.. dropdown:: speedometer3
   :class-container: anchor-id-speedometer3-b

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t speedometer3

   **Owner**: Performance Team

   * **alert threshold**: 2.0
   * **apps**: firefox, chrome, safari, safari-tp, custom-car
   * **browser cycles**: 5
   * **cold**: true
   * **expected**: pass
   * **expose browser profiler**: true
   * **gather cpuTime**: true
   * **gecko profile features**: stackwalk,js,cpu,processcpu,ipcmessages,nomarkerstacks
   * **gecko profile interval**: 1
   * **gecko profile threads**: GeckoMain,Compositor,Renderer,TaskController,StyleThread
   * **host from parent**: false
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/speedometer-desktop.toml#21>`__
   * **lower is better**: false
   * **page cycles**: 5
   * **page timeout**: 600000
   * **subtest lower is better**: true
   * **subtest unit**: ms
   * **support class**: speedometer3.py
   * **test script**: speedometer3.js
   * **test url**: `<http://\<host\>:\<port\>/Speedometer3/index.html?raptor>`__
   * **type**: benchmark
   * **unit**: score
   * **Test Task**:

   .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-speedometer3-mobile-chrome-m**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer3-mobile-chrome-m-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer3-mobile-cstm-car-m**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer3-mobile-cstm-car-m-nofis**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer3-mobile-fenix**
        - ✅
        - ✅
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer3-mobile-fenix-nofis**
        - ✅
        - ✅
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer3-mobile-geckoview**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer3-mobile-geckoview-nofis**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-android-hw-a55-14-0-aarch64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-speedometer3-mobile-fenix**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer3-mobile-fenix-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer3-mobile-geckoview**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer3-mobile-geckoview-nofis**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-android-hw-p6-13-0-aarch64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-speedometer3-mobile-chrome-m**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer3-mobile-chrome-m-nofis**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer3-mobile-cstm-car-m**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer3-mobile-cstm-car-m-nofis**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer3-mobile-fenix**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer3-mobile-fenix-nofis**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer3-mobile-geckoview**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer3-mobile-geckoview-nofis**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-android-hw-s24-14-0-aarch64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-speedometer3-mobile-chrome-m**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer3-mobile-chrome-m-nofis**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer3-mobile-cstm-car-m**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer3-mobile-cstm-car-m-nofis**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer3-mobile-fenix**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer3-mobile-fenix-nofis**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer3-mobile-geckoview**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer3-mobile-geckoview-nofis**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-speedometer3**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-speedometer3**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-speedometer3**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-chrome-speedometer3**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-custom-car-speedometer3**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-firefox-speedometer3**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1400-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-chrome-speedometer3**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-custom-car-speedometer3**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-firefox-speedometer3**
        - ✅
        - ✅
        - ❌
        - ❌
      * - **browsertime-benchmark-safari-speedometer3**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-safari-tp-speedometer3**
        - ✅
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-speedometer3**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-speedometer3**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-speedometer3**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows10-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-chrome-speedometer3**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-custom-car-speedometer3**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-firefox-speedometer3**
        - ✅
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-2009-hw-ref-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-chrome-speedometer3**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-custom-car-speedometer3**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-firefox-speedometer3**
        - ✅
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-2009-hw-ref/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-speedometer3**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-speedometer3**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-speedometer3**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-chrome-speedometer3**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-custom-car-speedometer3**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-firefox-speedometer3**
        - ✅
        - ✅
        - ❌
        - ❌


   **Owner**: Performance Team

   * **alert threshold**: 2.0
   * **apps**: fenix, geckoview, refbrow, chrome-m, cstm-car-m
   * **browser cycles**: 5
   * **cold**: true
   * **expected**: pass
   * **expose browser profiler**: true
   * **gather cpuTime**: true
   * **gecko profile features**: stackwalk,js,cpu,processcpu,ipcmessages,nomarkerstacks
   * **gecko profile interval**: 1
   * **gecko profile threads**: GeckoMain,Compositor,Renderer,TaskController,StyleThread
   * **host from parent**: false
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/speedometer-mobile.toml#21>`__
   * **lower is better**: false
   * **page cycles**: 5
   * **page timeout**: 420000
   * **repository**: https://github.com/WebKit/Speedometer
   * **repository revision**: 8d67f28d0281ac4330f283495b7f48286654ad7d
   * **subtest lower is better**: true
   * **subtest unit**: ms
   * **support class**: speedometer3.py
   * **test script**: speedometer3.js
   * **test url**: `<http://\<host\>:\<port\>/index.html>`__
   * **type**: benchmark
   * **unit**: score
   * **Test Task**:

   .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-speedometer3-mobile-chrome-m**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer3-mobile-chrome-m-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer3-mobile-cstm-car-m**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer3-mobile-cstm-car-m-nofis**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer3-mobile-fenix**
        - ✅
        - ✅
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer3-mobile-fenix-nofis**
        - ✅
        - ✅
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer3-mobile-geckoview**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer3-mobile-geckoview-nofis**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-android-hw-a55-14-0-aarch64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-speedometer3-mobile-fenix**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer3-mobile-fenix-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer3-mobile-geckoview**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer3-mobile-geckoview-nofis**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-android-hw-p6-13-0-aarch64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-speedometer3-mobile-chrome-m**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer3-mobile-chrome-m-nofis**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer3-mobile-cstm-car-m**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer3-mobile-cstm-car-m-nofis**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer3-mobile-fenix**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer3-mobile-fenix-nofis**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer3-mobile-geckoview**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer3-mobile-geckoview-nofis**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-android-hw-s24-14-0-aarch64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-speedometer3-mobile-chrome-m**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer3-mobile-chrome-m-nofis**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer3-mobile-cstm-car-m**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer3-mobile-cstm-car-m-nofis**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer3-mobile-fenix**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer3-mobile-fenix-nofis**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer3-mobile-geckoview**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-speedometer3-mobile-geckoview-nofis**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-speedometer3**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-speedometer3**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-speedometer3**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-chrome-speedometer3**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-custom-car-speedometer3**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-firefox-speedometer3**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1400-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-chrome-speedometer3**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-custom-car-speedometer3**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-firefox-speedometer3**
        - ✅
        - ✅
        - ❌
        - ❌
      * - **browsertime-benchmark-safari-speedometer3**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-safari-tp-speedometer3**
        - ✅
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-speedometer3**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-speedometer3**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-speedometer3**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows10-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-chrome-speedometer3**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-custom-car-speedometer3**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-firefox-speedometer3**
        - ✅
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-2009-hw-ref-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-chrome-speedometer3**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-custom-car-speedometer3**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-firefox-speedometer3**
        - ✅
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-2009-hw-ref/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-speedometer3**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-speedometer3**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-speedometer3**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-chrome-speedometer3**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-custom-car-speedometer3**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-firefox-speedometer3**
        - ✅
        - ✅
        - ❌
        - ❌



.. dropdown:: stylebench
   :class-container: anchor-id-stylebench-b

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t stylebench

   **Owner**: :emelio and Layout Team

   * **alert threshold**: 2.0
   * **apps**: firefox, chrome, safari
   * **expected**: pass
   * **expose browser profiler**: true
   * **gecko profile interval**: 1
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/stylebench.toml#16>`__
   * **lower is better**: false
   * **page cycles**: 5
   * **page timeout**: 140000
   * **subtest lower is better**: true
   * **subtest unit**: ms
   * **test url**: `<http://\<host\>:\<port\>/StyleBench/index.html?raptor>`__
   * **type**: benchmark
   * **unit**: score
   * **Test Task**:

   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-stylebench**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-stylebench**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-stylebench**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-chrome-stylebench**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-firefox-stylebench**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-stylebench**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-stylebench**
        - ✅
        - ✅
        - ❌
        - ❌
      * - **browsertime-benchmark-safari-stylebench**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-stylebench**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-stylebench**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-stylebench**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-chrome-stylebench**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-firefox-stylebench**
        - ✅
        - ✅
        - ❌
        - ❌



.. dropdown:: sunspider
   :class-container: anchor-id-sunspider-b

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t sunspider

   **Owner**: :jandem and SpiderMonkey Team

   * **alert threshold**: 2.0
   * **apps**: firefox, chrome, safari
   * **expected**: pass
   * **expose browser profiler**: true
   * **gecko profile interval**: 1
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/sunspider.toml#10>`__
   * **lower is better**: true
   * **page cycles**: 5
   * **page timeout**: 55000
   * **test url**: `<http://\<host\>:\<port\>/SunSpider/sunspider-1.0.1/sunspider-1.0.1/driver.html?raptor>`__
   * **type**: benchmark
   * **unit**: ms
   * **Test Task**:

   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-sunspider**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-sunspider**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-sunspider**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-chrome-sunspider**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-firefox-sunspider**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-sunspider**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-sunspider**
        - ✅
        - ✅
        - ❌
        - ❌
      * - **browsertime-benchmark-safari-sunspider**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-sunspider**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-sunspider**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-sunspider**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-chrome-sunspider**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-firefox-sunspider**
        - ✅
        - ✅
        - ❌
        - ❌



.. dropdown:: twitch-animation
   :class-container: anchor-id-twitch-animation-b

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t twitch-animation

   **Owner**: :jrmuizel

   * **alert threshold**: 2.0
   * **apps**: firefox
   * **expected**: pass
   * **expose browser profiler**: true
   * **gecko profile interval**: 1
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/twitch-animation.toml#17>`__
   * **lower is better**: true
   * **page cycles**: 1
   * **page timeout**: 2000000
   * **perfstats**: true
   * **repository**: https://github.com/mozilla/perf-automation
   * **repository path**: benchmarks/twitch-animation
   * **repository revision**: 61332db584026b73e37066d717a162825408c36b
   * **subtest lower is better**: true
   * **subtest unit**: ms
   * **test url**: `<http://\<host\>:\<port\>/index.html>`__
   * **type**: benchmark
   * **unit**: ms
   * **Test Task**:

   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-twitch-animation**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-twitch-animation**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-twitch-animation**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-twitch-animation**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-twitch-animation**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-twitch-animation**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-twitch-animation**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-twitch-animation**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-twitch-animation**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-twitch-animation**
        - ✅
        - ✅
        - ❌
        - ❌



.. dropdown:: unity-webgl
   :class-container: anchor-id-unity-webgl-b

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t unity-webgl

   **Owner**: :jgilbert and Graphics(gfx) Team

   * **alert threshold**: 2.0
   * **apps**: firefox, chrome
   * **expected**: pass
   * **expose browser profiler**: true
   * **gecko profile interval**: 1
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/unity-webgl-desktop.toml#14>`__
   * **lower is better**: false
   * **page cycles**: 5
   * **page timeout**: 420000
   * **repository**: https://github.com/mozilla/perf-automation
   * **repository path**: benchmarks/unity-webgl
   * **repository revision**: 61332db584026b73e37066d717a162825408c36b
   * **test url**: `<http://\<host\>:\<port\>/index.html?raptor>`__
   * **type**: benchmark
   * **unit**: score
   * **Test Task**:

   .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-unity-webgl-mobile-chrome-m**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-unity-webgl-mobile-chrome-m-nofis**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-unity-webgl-mobile-fenix**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-unity-webgl-mobile-fenix-nofis**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-unity-webgl-mobile-geckoview**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-unity-webgl-mobile-geckoview-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-unity-webgl-mobile-refbrow**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-android-hw-a55-14-0-aarch64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-unity-webgl-mobile-fenix**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-unity-webgl-mobile-fenix-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-unity-webgl-mobile-geckoview**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-unity-webgl-mobile-geckoview-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-unity-webgl-mobile-refbrow**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-unity-webgl**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-unity-webgl**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-unity-webgl**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-chrome-unity-webgl**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-firefox-unity-webgl**
        - ✅
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-unity-webgl**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-unity-webgl**
        - ✅
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-unity-webgl**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-unity-webgl**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-unity-webgl**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-chrome-unity-webgl**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-firefox-unity-webgl**
        - ✅
        - ❌
        - ❌
        - ❌


   **Owner**: :jgilbert and Graphics(gfx) Team

   * **alert threshold**: 2.0
   * **apps**: geckoview, refbrow, fenix, chrome-m
   * **expected**: pass
   * **expose browser profiler**: true
   * **gecko profile interval**: 1
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/unity-webgl-mobile.toml#14>`__
   * **lower is better**: false
   * **page cycles**: 1
   * **page timeout**: 420000
   * **repository**: https://github.com/mozilla/perf-automation
   * **repository path**: benchmarks/unity-webgl
   * **repository revision**: 61332db584026b73e37066d717a162825408c36b
   * **test url**: `<http://\<host\>:\<port\>/index.html?raptor>`__
   * **type**: benchmark
   * **unit**: score
   * **Test Task**:

   .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-unity-webgl-mobile-chrome-m**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-unity-webgl-mobile-chrome-m-nofis**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-unity-webgl-mobile-fenix**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-unity-webgl-mobile-fenix-nofis**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-unity-webgl-mobile-geckoview**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-unity-webgl-mobile-geckoview-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-unity-webgl-mobile-refbrow**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-android-hw-a55-14-0-aarch64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-unity-webgl-mobile-fenix**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-unity-webgl-mobile-fenix-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-unity-webgl-mobile-geckoview**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-unity-webgl-mobile-geckoview-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-unity-webgl-mobile-refbrow**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-unity-webgl**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-unity-webgl**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-unity-webgl**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-chrome-unity-webgl**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-firefox-unity-webgl**
        - ✅
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-unity-webgl**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-unity-webgl**
        - ✅
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-unity-webgl**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-unity-webgl**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-unity-webgl**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-chrome-unity-webgl**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-firefox-unity-webgl**
        - ✅
        - ❌
        - ❌
        - ❌



.. dropdown:: wasm-godot
   :class-container: anchor-id-wasm-godot-b

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t wasm-godot

   **Owner**: :lth and SpiderMonkey Team

   * **alert threshold**: 2.0
   * **apps**: firefox, chrome, safari
   * **expected**: pass
   * **expose browser profiler**: true
   * **gecko profile interval**: 1
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/wasm-godot.toml#11>`__
   * **lower is better**: true
   * **newtab per cycle**: true
   * **page cycles**: 5
   * **page timeout**: 120000
   * **test url**: `<http://localhost:\<port\>/wasm-godot/index.html>`__
   * **type**: benchmark
   * **unit**: ms
   * **Test Task**:

   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-wasm-firefox-wasm-godot**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-wasm-firefox-wasm-godot**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-wasm-firefox-wasm-godot**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-wasm-chrome-wasm-godot**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-wasm-firefox-wasm-godot**
        - ✅
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-wasm-firefox-wasm-godot**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-wasm-firefox-wasm-godot**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-wasm-safari-wasm-godot**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-wasm-firefox-wasm-godot**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-wasm-firefox-wasm-godot**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-wasm-firefox-wasm-godot**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-wasm-chrome-wasm-godot**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-wasm-firefox-wasm-godot**
        - ✅
        - ❌
        - ❌
        - ❌



.. dropdown:: wasm-godot-baseline
   :class-container: anchor-id-wasm-godot-baseline-b

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t wasm-godot-baseline

   **Owner**: :lth and SpiderMonkey Team

   * **alert threshold**: 2.0
   * **apps**: firefox
   * **expected**: pass
   * **expose browser profiler**: true
   * **gecko profile interval**: 1
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/wasm-godot-baseline.toml#14>`__
   * **lower is better**: true
   * **newtab per cycle**: true
   * **page cycles**: 5
   * **page timeout**: 120000
   * **preferences**: javascript.options.wasm_baselinejit=true javascript.options.wasm_optimizingjit=false
   * **test url**: `<http://localhost:\<port\>/wasm-godot/index.html>`__
   * **type**: benchmark
   * **unit**: ms
   * **Test Task**:

   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-wasm-firefox-wasm-godot-baseline**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-wasm-firefox-wasm-godot-baseline**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-wasm-firefox-wasm-godot-baseline**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-wasm-firefox-wasm-godot-baseline**
        - ✅
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-wasm-firefox-wasm-godot-baseline**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-wasm-firefox-wasm-godot-baseline**
        - ✅
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-wasm-firefox-wasm-godot-baseline**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-wasm-firefox-wasm-godot-baseline**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-wasm-firefox-wasm-godot-baseline**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-wasm-firefox-wasm-godot-baseline**
        - ✅
        - ❌
        - ❌
        - ❌



.. dropdown:: wasm-godot-optimizing
   :class-container: anchor-id-wasm-godot-optimizing-b

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t wasm-godot-optimizing

   **Owner**: :lth and SpiderMonkey Team

   * **alert threshold**: 2.0
   * **apps**: firefox
   * **expected**: pass
   * **expose browser profiler**: true
   * **gecko profile interval**: 1
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/wasm-godot-optimizing.toml#14>`__
   * **lower is better**: true
   * **newtab per cycle**: true
   * **page cycles**: 5
   * **page timeout**: 120000
   * **preferences**: javascript.options.wasm_baselinejit=false javascript.options.wasm_optimizingjit=true
   * **test url**: `<http://localhost:\<port\>/wasm-godot/index.html>`__
   * **type**: benchmark
   * **unit**: ms
   * **Test Task**:

   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-wasm-firefox-wasm-godot-optimizing**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-wasm-firefox-wasm-godot-optimizing**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-wasm-firefox-wasm-godot-optimizing**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-wasm-firefox-wasm-godot-optimizing**
        - ✅
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-wasm-firefox-wasm-godot-optimizing**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-wasm-firefox-wasm-godot-optimizing**
        - ✅
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-wasm-firefox-wasm-godot-optimizing**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-wasm-firefox-wasm-godot-optimizing**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-wasm-firefox-wasm-godot-optimizing**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-wasm-firefox-wasm-godot-optimizing**
        - ✅
        - ❌
        - ❌
        - ❌



.. dropdown:: wasm-misc
   :class-container: anchor-id-wasm-misc-b

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t wasm-misc

   **Owner**: :lth and SpiderMonkey Team

   * **alert threshold**: 2.0
   * **apps**: firefox, chrome
   * **expected**: pass
   * **expose browser profiler**: true
   * **gecko profile interval**: 1
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/wasm-misc.toml#14>`__
   * **lower is better**: true
   * **page cycles**: 5
   * **page timeout**: 1200000
   * **repository**: https://github.com/mozilla/perf-automation
   * **repository path**: benchmarks/wasm-misc
   * **repository revision**: 61332db584026b73e37066d717a162825408c36b
   * **test url**: `<http://\<host\>:\<port\>/index.html?raptor>`__
   * **type**: benchmark
   * **unit**: ms
   * **Test Task**:

   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-wasm-firefox-wasm-misc**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-wasm-firefox-wasm-misc**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-wasm-firefox-wasm-misc**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-wasm-chrome-wasm-misc**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-wasm-firefox-wasm-misc**
        - ✅
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-wasm-firefox-wasm-misc**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-wasm-firefox-wasm-misc**
        - ✅
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-wasm-firefox-wasm-misc**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-wasm-firefox-wasm-misc**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-wasm-firefox-wasm-misc**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-wasm-chrome-wasm-misc**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-wasm-firefox-wasm-misc**
        - ✅
        - ❌
        - ❌
        - ❌



.. dropdown:: wasm-misc-baseline
   :class-container: anchor-id-wasm-misc-baseline-b

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t wasm-misc-baseline

   **Owner**: :lth and SpiderMonkey Team

   * **alert threshold**: 2.0
   * **apps**: firefox
   * **expected**: pass
   * **expose browser profiler**: true
   * **gecko profile interval**: 1
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/wasm-misc-baseline.toml#13>`__
   * **lower is better**: true
   * **page cycles**: 5
   * **page timeout**: 1200000
   * **preferences**: javascript.options.wasm_baselinejit=true javascript.options.wasm_optimizingjit=false
   * **repository**: https://github.com/mozilla/perf-automation
   * **repository path**: benchmarks/wasm-misc
   * **repository revision**: 61332db584026b73e37066d717a162825408c36b
   * **test url**: `<http://\<host\>:\<port\>/index.html?raptor>`__
   * **type**: benchmark
   * **unit**: ms
   * **Test Task**:

   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-wasm-firefox-wasm-misc-baseline**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-wasm-firefox-wasm-misc-baseline**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-wasm-firefox-wasm-misc-baseline**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-wasm-firefox-wasm-misc-baseline**
        - ✅
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-wasm-firefox-wasm-misc-baseline**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-wasm-firefox-wasm-misc-baseline**
        - ✅
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-wasm-firefox-wasm-misc-baseline**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-wasm-firefox-wasm-misc-baseline**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-wasm-firefox-wasm-misc-baseline**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-wasm-firefox-wasm-misc-baseline**
        - ✅
        - ❌
        - ❌
        - ❌



.. dropdown:: wasm-misc-optimizing
   :class-container: anchor-id-wasm-misc-optimizing-b

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t wasm-misc-optimizing

   **Owner**: :lth and SpiderMonkey Team

   * **alert threshold**: 2.0
   * **apps**: firefox
   * **expected**: pass
   * **expose browser profiler**: true
   * **gecko profile interval**: 1
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/wasm-misc-optimizing.toml#13>`__
   * **lower is better**: true
   * **page cycles**: 5
   * **page timeout**: 1200000
   * **preferences**: javascript.options.wasm_baselinejit=false javascript.options.wasm_optimizingjit=true
   * **repository**: https://github.com/mozilla/perf-automation
   * **repository path**: benchmarks/wasm-misc
   * **repository revision**: 61332db584026b73e37066d717a162825408c36b
   * **test url**: `<http://\<host\>:\<port\>/index.html?raptor>`__
   * **type**: benchmark
   * **unit**: ms
   * **Test Task**:

   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-wasm-firefox-wasm-misc-optimizing**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-wasm-firefox-wasm-misc-optimizing**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-wasm-firefox-wasm-misc-optimizing**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-wasm-firefox-wasm-misc-optimizing**
        - ✅
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-wasm-firefox-wasm-misc-optimizing**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-wasm-firefox-wasm-misc-optimizing**
        - ✅
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-wasm-firefox-wasm-misc-optimizing**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-wasm-firefox-wasm-misc-optimizing**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-wasm-firefox-wasm-misc-optimizing**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-wasm-firefox-wasm-misc-optimizing**
        - ✅
        - ❌
        - ❌
        - ❌



.. dropdown:: webaudio
   :class-container: anchor-id-webaudio-b

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t webaudio

   **Owner**: :padenot and Media Team

   * **alert threshold**: 2.0
   * **apps**: firefox, chrome, safari
   * **expected**: pass
   * **expose browser profiler**: true
   * **gecko profile interval**: 1
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/webaudio.toml#10>`__
   * **lower is better**: true
   * **page cycles**: 5
   * **page timeout**: 360000
   * **preferences**: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false
   * **test url**: `<http://\<host\>:\<port\>/webaudio/index.html?raptor>`__
   * **type**: benchmark
   * **unit**: score
   * **Test Task**:

   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-webaudio**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-webaudio**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-webaudio**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-chrome-webaudio**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-firefox-webaudio**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-webaudio**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-webaudio**
        - ✅
        - ✅
        - ❌
        - ❌
      * - **browsertime-benchmark-safari-webaudio**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-webaudio**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-webaudio**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-firefox-webaudio**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-benchmark-chrome-webaudio**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-benchmark-firefox-webaudio**
        - ✅
        - ✅
        - ❌
        - ❌



.. dropdown:: youtube-playback-av1-sfr
   :class-container: anchor-id-youtube-playback-av1-sfr-b

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t youtube-playback-av1-sfr

   **Owner**: PerfTest Team

   * **alert threshold**: 2.0
   * **apps**: firefox, geckoview, fenix, refbrow, chrome
   * **expected**: pass
   * **expose browser profiler**: true
   * **gecko profile interval**: 1000
   * **gecko profile threads**: MediaPlayback
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#24>`__
   * **lower is better**: true
   * **page cycles**: 1
   * **page timeout**: 2700000
   * **preferences**: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false
   * **subtest lower is better**: true
   * **subtest unit**: score
   * **test url**: `<https://prod.youtube-test.prod.webservices.mozgcp.net/main.html?test_type=playbackperf-sfr-av1-test&raptor=true&exclude=1,2&muted=true&command=run>`__
   * **type**: benchmark
   * **unit**: score
   * **use live sites**: true
   * **Test Task**:

   .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-mobile-fenix-youtube-playback-av1-sfr**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-mobile-fenix-youtube-playback-av1-sfr-nofis**
        - ✅
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-android-hw-a55-14-0-aarch64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-mobile-fenix-youtube-playback-av1-sfr**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-mobile-fenix-youtube-playback-av1-sfr-nofis**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-firefox-youtube-playback-av1-sfr**
        - ✅
        - ❌
        - ❌
        - ❌



.. dropdown:: youtube-playback-h264-1080p30
   :class-container: anchor-id-youtube-playback-h264-1080p30-b

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t youtube-playback-h264-1080p30

   **Owner**: PerfTest Team

   * **alert threshold**: 2.0
   * **apps**: firefox
   * **expected**: pass
   * **expose browser profiler**: true
   * **gather cpuTime**: true
   * **gecko profile interval**: 1000
   * **gecko profile threads**: MediaPlayback
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#28>`__
   * **lower is better**: true
   * **page cycles**: 20
   * **page timeout**: 2700000
   * **preferences**: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false
   * **subtest lower is better**: true
   * **subtest unit**: score
   * **test url**: `<https://prod.youtube-test.prod.webservices.mozgcp.net/main.html?test_type=playbackperf-sfr-h264-test&tests=18&raptor=true&muted=true&command=run&exclude=1,2>`__
   * **type**: benchmark
   * **unit**: score
   * **use live sites**: true
   * **Test Task**:

   .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-power-firefox-youtube-playback-h264-1080p30**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-power-firefox-youtube-playback-h264-1080p30**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-power-firefox-youtube-playback-h264-1080p30**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-power-firefox-youtube-playback-h264-1080p30**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-power-firefox-youtube-playback-h264-1080p30**
        - ✅
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-power-firefox-youtube-playback-h264-1080p30**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-power-firefox-youtube-playback-h264-1080p30**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-power-firefox-youtube-playback-h264-1080p30**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-power-firefox-youtube-playback-h264-1080p30**
        - ❌
        - ❌
        - ❌
        - ❌



.. dropdown:: youtube-playback-h264-1080p60
   :class-container: anchor-id-youtube-playback-h264-1080p60-b

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t youtube-playback-h264-1080p60

   **Owner**: PerfTest Team

   * **alert threshold**: 2.0
   * **apps**: firefox
   * **expected**: pass
   * **expose browser profiler**: true
   * **gather cpuTime**: true
   * **gecko profile interval**: 1000
   * **gecko profile threads**: MediaPlayback
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#34>`__
   * **lower is better**: true
   * **page cycles**: 20
   * **page timeout**: 2700000
   * **preferences**: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false
   * **subtest lower is better**: true
   * **subtest unit**: score
   * **test url**: `<https://prod.youtube-test.prod.webservices.mozgcp.net/main.html?test_type=playbackperf-hfr-test&raptor=true&tests=46&muted=true&command=run&exclude=1,2>`__
   * **type**: benchmark
   * **unit**: score
   * **use live sites**: true
   * **Test Task**:

   .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-power-firefox-youtube-playback-h264-1080p60**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-power-firefox-youtube-playback-h264-1080p60**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-power-firefox-youtube-playback-h264-1080p60**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-power-firefox-youtube-playback-h264-1080p60**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-power-firefox-youtube-playback-h264-1080p60**
        - ✅
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-power-firefox-youtube-playback-h264-1080p60**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-power-firefox-youtube-playback-h264-1080p60**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-power-firefox-youtube-playback-h264-1080p60**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-power-firefox-youtube-playback-h264-1080p60**
        - ❌
        - ❌
        - ❌
        - ❌



.. dropdown:: youtube-playback-h264-720p60
   :class-container: anchor-id-youtube-playback-h264-720p60-b

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t youtube-playback-h264-720p60

   **Owner**: PerfTest Team

   * **alert threshold**: 2.0
   * **apps**: firefox, chrome, geckoview, fenix, refbrow, chrome-m
   * **browsertime args**: --pageCompleteWaitTime=10 --pageCompleteCheckPollTimeout=10 --browsertime.benchmark_wait_time=500
   * **expected**: pass
   * **expose browser profiler**: true
   * **gecko profile interval**: 1000
   * **gecko profile threads**: MediaPlayback
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#82>`__
   * **lower is better**: true
   * **page cycles**: 20
   * **page timeout**: 2700000
   * **preferences**: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false
   * **subtest lower is better**: true
   * **subtest unit**: score
   * **support class**: browsertime_benchmark.py
   * **test url**: `<https://prod.youtube-test.prod.webservices.mozgcp.net/main.html?test_type=playbackperf-hfr-test&tests=38&raptor=true&exclude=1,2&muted=true&command=run>`__
   * **type**: benchmark
   * **unit**: score
   * **use live sites**: true
   * **Test Task**:

   .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-power-mobile-chrome-m-youtube-playback-h264-720p60**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-power-mobile-chrome-m-youtube-playback-h264-720p60-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-power-mobile-fenix-youtube-playback-h264-720p60**
        - ✅
        - ✅
        - ❌
        - ❌
      * - **browsertime-power-mobile-fenix-youtube-playback-h264-720p60-nofis**
        - ✅
        - ✅
        - ❌
        - ❌
      * - **browsertime-power-mobile-geckoview-youtube-playback-h264-720p60**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-power-mobile-geckoview-youtube-playback-h264-720p60-nofis**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-android-hw-a55-14-0-aarch64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-power-mobile-fenix-youtube-playback-h264-720p60**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-power-mobile-fenix-youtube-playback-h264-720p60-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-power-mobile-geckoview-youtube-playback-h264-720p60**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-power-mobile-geckoview-youtube-playback-h264-720p60-nofis**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-android-hw-p6-13-0-aarch64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-power-mobile-chrome-m-youtube-playback-h264-720p60**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-power-mobile-chrome-m-youtube-playback-h264-720p60-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-power-mobile-fenix-youtube-playback-h264-720p60**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-power-mobile-fenix-youtube-playback-h264-720p60-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-power-mobile-geckoview-youtube-playback-h264-720p60**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-power-mobile-geckoview-youtube-playback-h264-720p60-nofis**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-android-hw-s24-14-0-aarch64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-power-mobile-chrome-m-youtube-playback-h264-720p60**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-power-mobile-chrome-m-youtube-playback-h264-720p60-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-power-mobile-fenix-youtube-playback-h264-720p60**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-power-mobile-fenix-youtube-playback-h264-720p60-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-power-mobile-geckoview-youtube-playback-h264-720p60**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-power-mobile-geckoview-youtube-playback-h264-720p60-nofis**
        - ❌
        - ❌
        - ❌
        - ❌



.. dropdown:: youtube-playback-h264-full-1080p30
   :class-container: anchor-id-youtube-playback-h264-full-1080p30-b

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t youtube-playback-h264-full-1080p30

   **Owner**: PerfTest Team

   * **alert threshold**: 2.0
   * **apps**: firefox
   * **expected**: pass
   * **expose browser profiler**: true
   * **gather cpuTime**: true
   * **gecko profile interval**: 1000
   * **gecko profile threads**: MediaPlayback
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#40>`__
   * **lower is better**: true
   * **page cycles**: 20
   * **page timeout**: 2700000
   * **preferences**: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false full-screen-api.allow-trusted-requests-only=false full-screen-api.warning.timeout=0
   * **subtest lower is better**: true
   * **subtest unit**: score
   * **test url**: `<https://prod.youtube-test.prod.webservices.mozgcp.net/main.html?test_type=playbackperf-sfr-h264-test&tests=18&raptor=true&muted=true&command=run&fullscreen=true&exclude=1,2>`__
   * **type**: benchmark
   * **unit**: score
   * **use live sites**: true
   * **Test Task**:

   .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-power-firefox-youtube-playback-h264-full-1080p30**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-power-firefox-youtube-playback-h264-full-1080p30**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-power-firefox-youtube-playback-h264-full-1080p30**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-power-firefox-youtube-playback-h264-full-1080p30**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-power-firefox-youtube-playback-h264-full-1080p30**
        - ✅
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-power-firefox-youtube-playback-h264-full-1080p30**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-power-firefox-youtube-playback-h264-full-1080p30**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-power-firefox-youtube-playback-h264-full-1080p30**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-power-firefox-youtube-playback-h264-full-1080p30**
        - ❌
        - ❌
        - ❌
        - ❌



.. dropdown:: youtube-playback-h264-full-1080p60
   :class-container: anchor-id-youtube-playback-h264-full-1080p60-b

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t youtube-playback-h264-full-1080p60

   **Owner**: PerfTest Team

   * **alert threshold**: 2.0
   * **apps**: firefox
   * **expected**: pass
   * **expose browser profiler**: true
   * **gather cpuTime**: true
   * **gecko profile interval**: 1000
   * **gecko profile threads**: MediaPlayback
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#55>`__
   * **lower is better**: true
   * **page cycles**: 20
   * **page timeout**: 2700000
   * **preferences**: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false full-screen-api.allow-trusted-requests-only=false full-screen-api.warning.timeout=0
   * **subtest lower is better**: true
   * **subtest unit**: score
   * **test url**: `<https://prod.youtube-test.prod.webservices.mozgcp.net/main.html?test_type=playbackperf-hfr-test&raptor=true&tests=46&muted=true&command=run&fullscreen=true&exclude=1,2>`__
   * **type**: benchmark
   * **unit**: score
   * **use live sites**: true
   * **Test Task**:

   .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-power-firefox-youtube-playback-h264-full-1080p60**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-power-firefox-youtube-playback-h264-full-1080p60**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-power-firefox-youtube-playback-h264-full-1080p60**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-power-firefox-youtube-playback-h264-full-1080p60**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-power-firefox-youtube-playback-h264-full-1080p60**
        - ✅
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-power-firefox-youtube-playback-h264-full-1080p60**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-power-firefox-youtube-playback-h264-full-1080p60**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-power-firefox-youtube-playback-h264-full-1080p60**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-power-firefox-youtube-playback-h264-full-1080p60**
        - ❌
        - ❌
        - ❌
        - ❌



.. dropdown:: youtube-playback-h264-sfr
   :class-container: anchor-id-youtube-playback-h264-sfr-b

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t youtube-playback-h264-sfr

   **Owner**: PerfTest Team

   * **alert threshold**: 2.0
   * **apps**: firefox, geckoview, fenix, refbrow, chrome
   * **expected**: pass
   * **expose browser profiler**: true
   * **gecko profile interval**: 1000
   * **gecko profile threads**: MediaPlayback
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#70>`__
   * **lower is better**: true
   * **page cycles**: 1
   * **page timeout**: 2700000
   * **preferences**: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false
   * **subtest lower is better**: true
   * **subtest unit**: score
   * **test url**: `<https://prod.youtube-test.prod.webservices.mozgcp.net/main.html?test_type=playbackperf-sfr-h264-test&raptor=true&exclude=1,2&muted=true&command=run>`__
   * **type**: benchmark
   * **unit**: score
   * **use live sites**: true
   * **Test Task**:

   .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-mobile-geckoview-youtube-playback-h264-sfr**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-mobile-geckoview-youtube-playback-h264-sfr-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-mobile-refbrow-youtube-playback-h264-sfr**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-android-hw-a55-14-0-aarch64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-mobile-geckoview-youtube-playback-h264-sfr**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-mobile-geckoview-youtube-playback-h264-sfr-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-mobile-refbrow-youtube-playback-h264-sfr**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-firefox-youtube-playback-h264-sfr**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-firefox-youtube-playback-h264-sfr**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-firefox-youtube-playback-h264-sfr**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-firefox-youtube-playback-h264-sfr**
        - ✅
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-firefox-youtube-playback-h264-sfr**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-firefox-youtube-playback-h264-sfr**
        - ✅
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-firefox-youtube-playback-h264-sfr**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-firefox-youtube-playback-h264-sfr**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-firefox-youtube-playback-h264-sfr**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-firefox-youtube-playback-h264-sfr**
        - ✅
        - ❌
        - ❌
        - ❌



.. dropdown:: youtube-playback-hfr
   :class-container: anchor-id-youtube-playback-hfr-b

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t youtube-playback-hfr

   **Owner**: PerfTest Team

   * **alert on**: `H2641080p60fps@1X_dropped_frames <raptor-metrics.html#youtube-playback-metrics>`__, `H264720p60fps@1X_dropped_frames <raptor-metrics.html#youtube-playback-metrics>`__
   * **alert threshold**: 2.0
   * **apps**: firefox, geckoview, fenix, refbrow, chrome
   * **expected**: pass
   * **expose browser profiler**: true
   * **gecko profile interval**: 1000
   * **gecko profile threads**: MediaPlayback
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#74>`__
   * **lower is better**: true
   * **page cycles**: 1
   * **page timeout**: 2700000
   * **preferences**: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false
   * **subtest lower is better**: true
   * **subtest unit**: score
   * **test url**: `<https://prod.youtube-test.prod.webservices.mozgcp.net/main.html?test_type=playbackperf-hfr-test&raptor=true&exclude=1,2&muted=true&command=run>`__
   * **type**: benchmark
   * **unit**: score
   * **use live sites**: true
   * **Test Task**:

   .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-mobile-fenix-youtube-playback-hfr**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-mobile-fenix-youtube-playback-hfr-nofis**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-mobile-geckoview-youtube-playback-hfr**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-mobile-geckoview-youtube-playback-hfr-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-mobile-refbrow-youtube-playback-hfr**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-android-hw-a55-14-0-aarch64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-mobile-fenix-youtube-playback-hfr**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-mobile-fenix-youtube-playback-hfr-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-mobile-geckoview-youtube-playback-hfr**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-mobile-geckoview-youtube-playback-hfr-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-mobile-refbrow-youtube-playback-hfr**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-firefox-youtube-playback-hfr**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-firefox-youtube-playback-hfr**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-firefox-youtube-playback-hfr**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-firefox-youtube-playback-hfr**
        - ✅
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-firefox-youtube-playback-hfr**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-firefox-youtube-playback-hfr**
        - ✅
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-firefox-youtube-playback-hfr**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-firefox-youtube-playback-hfr**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-firefox-youtube-playback-hfr**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-firefox-youtube-playback-hfr**
        - ✅
        - ❌
        - ❌
        - ❌



.. dropdown:: youtube-playback-v9-1080p30
   :class-container: anchor-id-youtube-playback-v9-1080p30-b

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t youtube-playback-v9-1080p30

   **Owner**: PerfTest Team

   * **alert threshold**: 2.0
   * **apps**: firefox
   * **expected**: pass
   * **expose browser profiler**: true
   * **gather cpuTime**: true
   * **gecko profile interval**: 1000
   * **gecko profile threads**: MediaPlayback
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#96>`__
   * **lower is better**: true
   * **page cycles**: 20
   * **page timeout**: 2700000
   * **preferences**: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false
   * **subtest lower is better**: true
   * **subtest unit**: score
   * **test url**: `<https://prod.youtube-test.prod.webservices.mozgcp.net/main.html?test_type=playbackperf-sfr-vp9-test&raptor=true&tests=18&muted=true&command=run&exclude=1,2>`__
   * **type**: benchmark
   * **unit**: score
   * **use live sites**: true
   * **Test Task**:

   .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-power-firefox-youtube-playback-v9-1080p30**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-power-firefox-youtube-playback-v9-1080p30**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-power-firefox-youtube-playback-v9-1080p30**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-power-firefox-youtube-playback-v9-1080p30**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-power-firefox-youtube-playback-v9-1080p30**
        - ✅
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-power-firefox-youtube-playback-v9-1080p30**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-power-firefox-youtube-playback-v9-1080p30**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-power-firefox-youtube-playback-v9-1080p30**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-power-firefox-youtube-playback-v9-1080p30**
        - ❌
        - ❌
        - ❌
        - ❌



.. dropdown:: youtube-playback-v9-1080p60
   :class-container: anchor-id-youtube-playback-v9-1080p60-b

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t youtube-playback-v9-1080p60

   **Owner**: PerfTest Team

   * **alert threshold**: 2.0
   * **apps**: firefox
   * **expected**: pass
   * **expose browser profiler**: true
   * **gather cpuTime**: true
   * **gecko profile interval**: 1000
   * **gecko profile threads**: MediaPlayback
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#102>`__
   * **lower is better**: true
   * **page cycles**: 20
   * **page timeout**: 2700000
   * **preferences**: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false
   * **subtest lower is better**: true
   * **subtest unit**: score
   * **test url**: `<https://prod.youtube-test.prod.webservices.mozgcp.net/main.html?test_type=playbackperf-hfr-test&raptor=true&tests=14&muted=true&command=run&exclude=1,2>`__
   * **type**: benchmark
   * **unit**: score
   * **use live sites**: true
   * **Test Task**:

   .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-power-firefox-youtube-playback-v9-1080p60**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-power-firefox-youtube-playback-v9-1080p60**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-power-firefox-youtube-playback-v9-1080p60**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-power-firefox-youtube-playback-v9-1080p60**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-power-firefox-youtube-playback-v9-1080p60**
        - ✅
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-power-firefox-youtube-playback-v9-1080p60**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-power-firefox-youtube-playback-v9-1080p60**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-power-firefox-youtube-playback-v9-1080p60**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-power-firefox-youtube-playback-v9-1080p60**
        - ❌
        - ❌
        - ❌
        - ❌



.. dropdown:: youtube-playback-v9-full-1080p30
   :class-container: anchor-id-youtube-playback-v9-full-1080p30-b

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t youtube-playback-v9-full-1080p30

   **Owner**: PerfTest Team

   * **alert threshold**: 2.0
   * **apps**: firefox
   * **expected**: pass
   * **expose browser profiler**: true
   * **gather cpuTime**: true
   * **gecko profile interval**: 1000
   * **gecko profile threads**: MediaPlayback
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#108>`__
   * **lower is better**: true
   * **page cycles**: 20
   * **page timeout**: 2700000
   * **preferences**: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false full-screen-api.allow-trusted-requests-only=false full-screen-api.warning.timeout=0
   * **subtest lower is better**: true
   * **subtest unit**: score
   * **test url**: `<https://prod.youtube-test.prod.webservices.mozgcp.net/main.html?test_type=playbackperf-sfr-vp9-test&raptor=true&tests=18&muted=true&command=run&fullscreen=true&exclude=1,2>`__
   * **type**: benchmark
   * **unit**: score
   * **use live sites**: true
   * **Test Task**:

   .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-power-firefox-youtube-playback-v9-full-1080p30**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-power-firefox-youtube-playback-v9-full-1080p30**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-power-firefox-youtube-playback-v9-full-1080p30**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-power-firefox-youtube-playback-v9-full-1080p30**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-power-firefox-youtube-playback-v9-full-1080p30**
        - ✅
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-power-firefox-youtube-playback-v9-full-1080p30**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-power-firefox-youtube-playback-v9-full-1080p30**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-power-firefox-youtube-playback-v9-full-1080p30**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-power-firefox-youtube-playback-v9-full-1080p30**
        - ❌
        - ❌
        - ❌
        - ❌



.. dropdown:: youtube-playback-v9-full-1080p60
   :class-container: anchor-id-youtube-playback-v9-full-1080p60-b

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t youtube-playback-v9-full-1080p60

   **Owner**: PerfTest Team

   * **alert threshold**: 2.0
   * **apps**: firefox
   * **expected**: pass
   * **expose browser profiler**: true
   * **gather cpuTime**: true
   * **gecko profile interval**: 1000
   * **gecko profile threads**: MediaPlayback
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#123>`__
   * **lower is better**: true
   * **page cycles**: 20
   * **page timeout**: 2700000
   * **preferences**: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false full-screen-api.allow-trusted-requests-only=false full-screen-api.warning.timeout=0
   * **subtest lower is better**: true
   * **subtest unit**: score
   * **test url**: `<https://prod.youtube-test.prod.webservices.mozgcp.net/main.html?test_type=playbackperf-hfr-test&raptor=true&tests=14&muted=true&command=run&fullscreen=true&exclude=1,2>`__
   * **type**: benchmark
   * **unit**: score
   * **use live sites**: true
   * **Test Task**:

   .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-power-firefox-youtube-playback-v9-full-1080p60**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-power-firefox-youtube-playback-v9-full-1080p60**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-power-firefox-youtube-playback-v9-full-1080p60**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-power-firefox-youtube-playback-v9-full-1080p60**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-power-firefox-youtube-playback-v9-full-1080p60**
        - ✅
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-power-firefox-youtube-playback-v9-full-1080p60**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-power-firefox-youtube-playback-v9-full-1080p60**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-power-firefox-youtube-playback-v9-full-1080p60**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-power-firefox-youtube-playback-v9-full-1080p60**
        - ❌
        - ❌
        - ❌
        - ❌



.. dropdown:: youtube-playback-vp9-720p60
   :class-container: anchor-id-youtube-playback-vp9-720p60-b

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t youtube-playback-vp9-720p60

   **Owner**: PerfTest Team

   * **alert threshold**: 2.0
   * **apps**: firefox, chrome, geckoview, fenix, refbrow, chrome-m
   * **browsertime args**: --pageCompleteWaitTime=10 --pageCompleteCheckPollTimeout=10 --browsertime.benchmark_wait_time=500
   * **expected**: pass
   * **expose browser profiler**: true
   * **gecko profile interval**: 1000
   * **gecko profile threads**: MediaPlayback
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#89>`__
   * **lower is better**: true
   * **page cycles**: 20
   * **page timeout**: 2700000
   * **preferences**: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false
   * **subtest lower is better**: true
   * **subtest unit**: score
   * **support class**: browsertime_benchmark.py
   * **test url**: `<https://prod.youtube-test.prod.webservices.mozgcp.net/main.html?test_type=playbackperf-hfr-test&tests=6&raptor=true&exclude=1,2&muted=true&command=run>`__
   * **type**: benchmark
   * **unit**: score
   * **use live sites**: true
   * **Test Task**:

   .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-power-mobile-chrome-m-youtube-playback-vp9-720p60**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-power-mobile-chrome-m-youtube-playback-vp9-720p60-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-power-mobile-fenix-youtube-playback-vp9-720p60**
        - ✅
        - ✅
        - ❌
        - ❌
      * - **browsertime-power-mobile-fenix-youtube-playback-vp9-720p60-nofis**
        - ✅
        - ✅
        - ❌
        - ❌
      * - **browsertime-power-mobile-geckoview-youtube-playback-vp9-720p60**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-power-mobile-geckoview-youtube-playback-vp9-720p60-nofis**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-android-hw-a55-14-0-aarch64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-power-mobile-fenix-youtube-playback-vp9-720p60**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-power-mobile-fenix-youtube-playback-vp9-720p60-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-power-mobile-geckoview-youtube-playback-vp9-720p60**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-power-mobile-geckoview-youtube-playback-vp9-720p60-nofis**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-android-hw-p6-13-0-aarch64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-power-mobile-chrome-m-youtube-playback-vp9-720p60**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-power-mobile-chrome-m-youtube-playback-vp9-720p60-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-power-mobile-fenix-youtube-playback-vp9-720p60**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-power-mobile-fenix-youtube-playback-vp9-720p60-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-power-mobile-geckoview-youtube-playback-vp9-720p60**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-power-mobile-geckoview-youtube-playback-vp9-720p60-nofis**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-android-hw-s24-14-0-aarch64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-power-mobile-chrome-m-youtube-playback-vp9-720p60**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-power-mobile-chrome-m-youtube-playback-vp9-720p60-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-power-mobile-fenix-youtube-playback-vp9-720p60**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-power-mobile-fenix-youtube-playback-vp9-720p60-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-power-mobile-geckoview-youtube-playback-vp9-720p60**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-power-mobile-geckoview-youtube-playback-vp9-720p60-nofis**
        - ❌
        - ❌
        - ❌
        - ❌



.. dropdown:: youtube-playback-vp9-sfr
   :class-container: anchor-id-youtube-playback-vp9-sfr-b

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t youtube-playback-vp9-sfr

   **Owner**: PerfTest Team

   * **alert threshold**: 2.0
   * **apps**: firefox, geckoview, fenix, refbrow, chrome
   * **expected**: pass
   * **expose browser profiler**: true
   * **gecko profile interval**: 1000
   * **gecko profile threads**: MediaPlayback
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#138>`__
   * **lower is better**: true
   * **page cycles**: 1
   * **page timeout**: 2700000
   * **preferences**: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false
   * **subtest lower is better**: true
   * **subtest unit**: score
   * **test url**: `<https://prod.youtube-test.prod.webservices.mozgcp.net/main.html?test_type=playbackperf-sfr-vp9-test&raptor=true&exclude=1,2&muted=true&command=run>`__
   * **type**: benchmark
   * **unit**: score
   * **use live sites**: true
   * **Test Task**:

   .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-mobile-fenix-youtube-playback-vp9-sfr**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-mobile-fenix-youtube-playback-vp9-sfr-nofis**
        - ✅
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-android-hw-a55-14-0-aarch64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-mobile-fenix-youtube-playback-vp9-sfr**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-mobile-fenix-youtube-playback-vp9-sfr-nofis**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-firefox-youtube-playback-vp9-sfr**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-firefox-youtube-playback-vp9-sfr**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-firefox-youtube-playback-vp9-sfr**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-firefox-youtube-playback-vp9-sfr**
        - ✅
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-firefox-youtube-playback-vp9-sfr**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-firefox-youtube-playback-vp9-sfr**
        - ✅
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-firefox-youtube-playback-vp9-sfr**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-firefox-youtube-playback-vp9-sfr**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-firefox-youtube-playback-vp9-sfr**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-firefox-youtube-playback-vp9-sfr**
        - ✅
        - ❌
        - ❌
        - ❌



.. dropdown:: youtube-playback-widevine-h264-sfr
   :class-container: anchor-id-youtube-playback-widevine-h264-sfr-b

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t youtube-playback-widevine-h264-sfr

   **Owner**: PerfTest Team

   * **alert threshold**: 2.0
   * **apps**: firefox, geckoview, fenix, refbrow, chrome
   * **expected**: pass
   * **expose browser profiler**: true
   * **gecko profile interval**: 1000
   * **gecko profile threads**: MediaPlayback
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#142>`__
   * **lower is better**: true
   * **page cycles**: 1
   * **page timeout**: 2700000
   * **preferences**: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false media.eme.enabled=true media.gmp-manager.updateEnabled=true media.eme.require-app-approval=false
   * **subtest lower is better**: true
   * **subtest unit**: score
   * **test url**: `<https://prod.youtube-test.prod.webservices.mozgcp.net/main.html?test_type=playbackperf-widevine-sfr-h264-test&raptor=true&exclude=1,2&muted=true&command=run>`__
   * **type**: benchmark
   * **unit**: score
   * **use live sites**: true
   * **Test Task**:

   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-firefox-youtube-playback-widevine-h264-sfr**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-firefox-youtube-playback-widevine-h264-sfr**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-firefox-youtube-playback-widevine-h264-sfr**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-firefox-youtube-playback-widevine-h264-sfr**
        - ✅
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-firefox-youtube-playback-widevine-h264-sfr**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-firefox-youtube-playback-widevine-h264-sfr**
        - ✅
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-firefox-youtube-playback-widevine-h264-sfr**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-firefox-youtube-playback-widevine-h264-sfr**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-firefox-youtube-playback-widevine-h264-sfr**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-firefox-youtube-playback-widevine-h264-sfr**
        - ✅
        - ❌
        - ❌
        - ❌



.. dropdown:: youtube-playback-widevine-hfr
   :class-container: anchor-id-youtube-playback-widevine-hfr-b

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t youtube-playback-widevine-hfr

   **Owner**: PerfTest Team

   * **alert threshold**: 2.0
   * **apps**: firefox, geckoview, fenix, refbrow, chrome
   * **expected**: pass
   * **expose browser profiler**: true
   * **gecko profile interval**: 1000
   * **gecko profile threads**: MediaPlayback
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#156>`__
   * **lower is better**: true
   * **page cycles**: 1
   * **page timeout**: 2700000
   * **preferences**: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false media.eme.enabled=true media.gmp-manager.updateEnabled=true media.eme.require-app-approval=false
   * **subtest lower is better**: true
   * **subtest unit**: score
   * **test url**: `<https://prod.youtube-test.prod.webservices.mozgcp.net/main.html?test_type=playbackperf-widevine-hfr-test&raptor=true&exclude=1,2&muted=true&command=run>`__
   * **type**: benchmark
   * **unit**: score
   * **use live sites**: true
   * **Test Task**:

   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-firefox-youtube-playback-widevine-hfr**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-firefox-youtube-playback-widevine-hfr**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-firefox-youtube-playback-widevine-hfr**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-firefox-youtube-playback-widevine-hfr**
        - ✅
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-firefox-youtube-playback-widevine-hfr**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-firefox-youtube-playback-widevine-hfr**
        - ✅
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-firefox-youtube-playback-widevine-hfr**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-firefox-youtube-playback-widevine-hfr**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-firefox-youtube-playback-widevine-hfr**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-firefox-youtube-playback-widevine-hfr**
        - ✅
        - ❌
        - ❌
        - ❌



.. dropdown:: youtube-playback-widevine-vp9-sfr
   :class-container: anchor-id-youtube-playback-widevine-vp9-sfr-b

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t youtube-playback-widevine-vp9-sfr

   **Owner**: PerfTest Team

   * **alert threshold**: 2.0
   * **apps**: firefox, geckoview, fenix, refbrow, chrome
   * **expected**: pass
   * **expose browser profiler**: true
   * **gecko profile interval**: 1000
   * **gecko profile threads**: MediaPlayback
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#170>`__
   * **lower is better**: true
   * **page cycles**: 1
   * **page timeout**: 2700000
   * **preferences**: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false media.eme.enabled=true media.gmp-manager.updateEnabled=true media.eme.require-app-approval=false
   * **subtest lower is better**: true
   * **subtest unit**: score
   * **test url**: `<https://prod.youtube-test.prod.webservices.mozgcp.net/main.html?test_type=playbackperf-widevine-sfr-vp9-test&raptor=true&exclude=1,2&muted=true&command=run>`__
   * **type**: benchmark
   * **unit**: score
   * **use live sites**: true
   * **Test Task**:

   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-firefox-youtube-playback-widevine-vp9-sfr**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-firefox-youtube-playback-widevine-vp9-sfr**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-firefox-youtube-playback-widevine-vp9-sfr**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-firefox-youtube-playback-widevine-vp9-sfr**
        - ✅
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-firefox-youtube-playback-widevine-vp9-sfr**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-firefox-youtube-playback-widevine-vp9-sfr**
        - ✅
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-firefox-youtube-playback-widevine-vp9-sfr**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-firefox-youtube-playback-widevine-vp9-sfr**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-firefox-youtube-playback-widevine-vp9-sfr**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-firefox-youtube-playback-widevine-vp9-sfr**
        - ✅
        - ❌
        - ❌
        - ❌




Custom
------
Browsertime tests that use a custom pageload test script. These use the pageload type, but may have other intentions.

.. dropdown:: addMab1
   :class-container: anchor-id-addMab1-c

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t addMab1

   **Owner**: DOM Lifecycle, Workers and Storage Team

   **Description**: Use add API to send many small ArrayBuffers to IndexedDB in one transaction

   * **alert threshold**: 2.0
   * **apps**: firefox, chrome, safari
   * **browser cycles**: 1
   * **browsertime args**: --browsertime.iterations=16384 --browsertime.chunk_size=1024 --browsertime.buffer_type=ArrayBuffer --browsertime.atomic=1
   * **custom data**: true
   * **expected**: pass
   * **gecko profile entries**: 131072000
   * **gecko profile features**: js,stackwalk,cpu,memory
   * **gecko profile threads**: GeckoMain,DOM Worker,IndexedDB
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-indexeddb.toml#30>`__
   * **lower is better**: true
   * **measure**: cpuTime
   * **output timeout**: 2000000
   * **page cycles**: 1
   * **page timeout**: 1800000
   * **playback**: mitmproxy
   * **playback pageset manifest**: mitm8-linux-firefox-example.manifest
   * **subtest unit**: ms
   * **test script**: indexeddb_write.js
   * **test summary**: flatten
   * **test url**: `<https://www.example.com>`__
   * **type**: pageload
   * **unit**: ms
   * **use live sites**: false
   * **Test Task**:

   .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addMab1**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addMab1**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addMab1**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addMab1**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addMab1**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addMab1**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addMab1**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addMab1**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addMab1**
        - ✅
        - ✅
        - ❌
        - ❌



.. dropdown:: addMabN
   :class-container: anchor-id-addMabN-c

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t addMabN

   **Owner**: DOM Lifecycle, Workers and Storage Team

   **Description**: Use add API to send many small ArrayBuffers to IndexedDB independently

   * **alert threshold**: 2.0
   * **apps**: firefox, chrome, safari
   * **browser cycles**: 1
   * **browsertime args**: --browsertime.iterations=16384 --browsertime.chunk_size=1024 --browsertime.buffer_type=ArrayBuffer --browsertime.atomic=0
   * **custom data**: true
   * **expected**: pass
   * **gecko profile entries**: 131072000
   * **gecko profile features**: js,stackwalk,cpu,memory
   * **gecko profile threads**: GeckoMain,DOM Worker,IndexedDB
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-indexeddb.toml#34>`__
   * **lower is better**: true
   * **measure**: cpuTime
   * **output timeout**: 2000000
   * **page cycles**: 1
   * **page timeout**: 1800000
   * **playback**: mitmproxy
   * **playback pageset manifest**: mitm8-linux-firefox-example.manifest
   * **subtest unit**: ms
   * **test script**: indexeddb_write.js
   * **test summary**: flatten
   * **test url**: `<https://www.example.com>`__
   * **type**: pageload
   * **unit**: ms
   * **use live sites**: false
   * **Test Task**:

   .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addMabN**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addMabN**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addMabN**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addMabN**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addMabN**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addMabN**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addMabN**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addMabN**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addMabN**
        - ✅
        - ✅
        - ❌
        - ❌



.. dropdown:: addMar1
   :class-container: anchor-id-addMar1-c

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t addMar1

   **Owner**: DOM Lifecycle, Workers and Storage Team

   **Description**: Use add API to send many small Arrays to IndexedDB in one transaction

   * **alert threshold**: 2.0
   * **apps**: firefox, chrome, safari
   * **browser cycles**: 1
   * **browsertime args**: --browsertime.iterations=16384 --browsertime.chunk_size=1024 --browsertime.buffer_type=Array --browsertime.atomic=1
   * **custom data**: true
   * **expected**: pass
   * **gecko profile entries**: 131072000
   * **gecko profile features**: js,stackwalk,cpu,memory
   * **gecko profile threads**: GeckoMain,DOM Worker,IndexedDB
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-indexeddb.toml#38>`__
   * **lower is better**: true
   * **measure**: cpuTime
   * **output timeout**: 2000000
   * **page cycles**: 1
   * **page timeout**: 1800000
   * **playback**: mitmproxy
   * **playback pageset manifest**: mitm8-linux-firefox-example.manifest
   * **subtest unit**: ms
   * **test script**: indexeddb_write.js
   * **test summary**: flatten
   * **test url**: `<https://www.example.com>`__
   * **type**: pageload
   * **unit**: ms
   * **use live sites**: false
   * **Test Task**:

   .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addMar1**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addMar1**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addMar1**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addMar1**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addMar1**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addMar1**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addMar1**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addMar1**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addMar1**
        - ✅
        - ✅
        - ❌
        - ❌



.. dropdown:: addMarN
   :class-container: anchor-id-addMarN-c

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t addMarN

   **Owner**: DOM Lifecycle, Workers and Storage Team

   **Description**: Use add API to send many small Arrays to IndexedDB independently

   * **alert threshold**: 2.0
   * **apps**: firefox, chrome, safari
   * **browser cycles**: 1
   * **browsertime args**: --browsertime.iterations=16384 --browsertime.chunk_size=1024 --browsertime.buffer_type=Array --browsertime.atomic=0
   * **custom data**: true
   * **expected**: pass
   * **gecko profile entries**: 131072000
   * **gecko profile features**: js,stackwalk,cpu,memory
   * **gecko profile threads**: GeckoMain,DOM Worker,IndexedDB
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-indexeddb.toml#42>`__
   * **lower is better**: true
   * **measure**: cpuTime
   * **output timeout**: 2000000
   * **page cycles**: 1
   * **page timeout**: 1800000
   * **playback**: mitmproxy
   * **playback pageset manifest**: mitm8-linux-firefox-example.manifest
   * **subtest unit**: ms
   * **test script**: indexeddb_write.js
   * **test summary**: flatten
   * **test url**: `<https://www.example.com>`__
   * **type**: pageload
   * **unit**: ms
   * **use live sites**: false
   * **Test Task**:

   .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addMarN**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addMarN**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addMarN**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addMarN**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addMarN**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addMarN**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addMarN**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addMarN**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addMarN**
        - ✅
        - ✅
        - ❌
        - ❌



.. dropdown:: addMbl1
   :class-container: anchor-id-addMbl1-c

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t addMbl1

   **Owner**: DOM Lifecycle, Workers and Storage Team

   **Description**: Use add API to send many small Blobs to IndexedDB in one transaction

   * **alert threshold**: 2.0
   * **apps**: firefox, chrome, safari
   * **browser cycles**: 1
   * **browsertime args**: --browsertime.iterations=16384 --browsertime.chunk_size=1024 --browsertime.buffer_type=Blob --browsertime.atomic=1
   * **custom data**: true
   * **expected**: pass
   * **gecko profile entries**: 131072000
   * **gecko profile features**: js,stackwalk,cpu,memory
   * **gecko profile threads**: GeckoMain,DOM Worker,IndexedDB
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-indexeddb.toml#46>`__
   * **lower is better**: true
   * **measure**: cpuTime
   * **output timeout**: 2000000
   * **page cycles**: 1
   * **page timeout**: 1800000
   * **playback**: mitmproxy
   * **playback pageset manifest**: mitm8-linux-firefox-example.manifest
   * **subtest unit**: ms
   * **test script**: indexeddb_write.js
   * **test summary**: flatten
   * **test url**: `<https://www.example.com>`__
   * **type**: pageload
   * **unit**: ms
   * **use live sites**: false
   * **Test Task**:

   .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addMbl1**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addMbl1**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addMbl1**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addMbl1**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addMbl1**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addMbl1**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addMbl1**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addMbl1**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addMbl1**
        - ✅
        - ✅
        - ❌
        - ❌



.. dropdown:: addMblN
   :class-container: anchor-id-addMblN-c

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t addMblN

   **Owner**: DOM Lifecycle, Workers and Storage Team

   **Description**: Use add API to send many small Blobs to IndexedDB independently

   * **alert threshold**: 2.0
   * **apps**: firefox, chrome, safari
   * **browser cycles**: 1
   * **browsertime args**: --browsertime.iterations=16384 --browsertime.chunk_size=1024 --browsertime.buffer_type=Blob --browsertime.atomic=0
   * **custom data**: true
   * **expected**: pass
   * **gecko profile entries**: 131072000
   * **gecko profile features**: js,stackwalk,cpu,memory
   * **gecko profile threads**: GeckoMain,DOM Worker,IndexedDB
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-indexeddb.toml#50>`__
   * **lower is better**: true
   * **measure**: cpuTime
   * **output timeout**: 2000000
   * **page cycles**: 1
   * **page timeout**: 1800000
   * **playback**: mitmproxy
   * **playback pageset manifest**: mitm8-linux-firefox-example.manifest
   * **subtest unit**: ms
   * **test script**: indexeddb_write.js
   * **test summary**: flatten
   * **test url**: `<https://www.example.com>`__
   * **type**: pageload
   * **unit**: ms
   * **use live sites**: false
   * **Test Task**:

   .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addMblN**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addMblN**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addMblN**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addMblN**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addMblN**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addMblN**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addMblN**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addMblN**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addMblN**
        - ✅
        - ✅
        - ❌
        - ❌



.. dropdown:: addkAB1
   :class-container: anchor-id-addkAB1-c

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t addkAB1

   **Owner**: DOM Lifecycle, Workers and Storage Team

   **Description**: Use add API to send a couple of large ArrayBuffers to IndexedDB in one transaction

   * **alert threshold**: 2.0
   * **apps**: firefox, chrome, safari
   * **browser cycles**: 1
   * **browsertime args**: --browsertime.iterations=128 --browsertime.chunk_size=1048576 --browsertime.buffer_type=ArrayBuffer --browsertime.atomic=1
   * **custom data**: true
   * **expected**: pass
   * **gecko profile entries**: 131072000
   * **gecko profile features**: js,stackwalk,cpu,memory
   * **gecko profile threads**: GeckoMain,DOM Worker,IndexedDB
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-indexeddb.toml#54>`__
   * **lower is better**: true
   * **measure**: cpuTime
   * **output timeout**: 2000000
   * **page cycles**: 1
   * **page timeout**: 1800000
   * **playback**: mitmproxy
   * **playback pageset manifest**: mitm8-linux-firefox-example.manifest
   * **subtest unit**: ms
   * **test script**: indexeddb_write.js
   * **test summary**: flatten
   * **test url**: `<https://www.example.com>`__
   * **type**: pageload
   * **unit**: ms
   * **use live sites**: false
   * **Test Task**:

   .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addkAB1**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addkAB1**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addkAB1**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addkAB1**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addkAB1**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addkAB1**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addkAB1**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addkAB1**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addkAB1**
        - ✅
        - ✅
        - ❌
        - ❌



.. dropdown:: addkABN
   :class-container: anchor-id-addkABN-c

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t addkABN

   **Owner**: DOM Lifecycle, Workers and Storage Team

   **Description**: Use add API to send a couple of large ArrayBuffers to IndexedDB independently

   * **alert threshold**: 2.0
   * **apps**: firefox, chrome, safari
   * **browser cycles**: 1
   * **browsertime args**: --browsertime.iterations=128 --browsertime.chunk_size=1048576 --browsertime.buffer_type=ArrayBuffer --browsertime.atomic=0
   * **custom data**: true
   * **expected**: pass
   * **gecko profile entries**: 131072000
   * **gecko profile features**: js,stackwalk,cpu,memory
   * **gecko profile threads**: GeckoMain,DOM Worker,IndexedDB
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-indexeddb.toml#58>`__
   * **lower is better**: true
   * **measure**: cpuTime
   * **output timeout**: 2000000
   * **page cycles**: 1
   * **page timeout**: 1800000
   * **playback**: mitmproxy
   * **playback pageset manifest**: mitm8-linux-firefox-example.manifest
   * **subtest unit**: ms
   * **test script**: indexeddb_write.js
   * **test summary**: flatten
   * **test url**: `<https://www.example.com>`__
   * **type**: pageload
   * **unit**: ms
   * **use live sites**: false
   * **Test Task**:

   .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addkABN**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addkABN**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addkABN**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addkABN**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addkABN**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addkABN**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addkABN**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addkABN**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addkABN**
        - ✅
        - ✅
        - ❌
        - ❌



.. dropdown:: addkAR1
   :class-container: anchor-id-addkAR1-c

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t addkAR1

   **Owner**: DOM Lifecycle, Workers and Storage Team

   **Description**: Use add API to send a couple of large JS Arrays to IndexedDB in one transaction

   * **alert threshold**: 2.0
   * **apps**: firefox, chrome, safari
   * **browser cycles**: 1
   * **browsertime args**: --browsertime.iterations=128 --browsertime.chunk_size=1048576 --browsertime.buffer_type=Array --browsertime.atomic=1
   * **custom data**: true
   * **expected**: pass
   * **gecko profile entries**: 131072000
   * **gecko profile features**: js,stackwalk,cpu,memory
   * **gecko profile threads**: GeckoMain,DOM Worker,IndexedDB
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-indexeddb.toml#62>`__
   * **lower is better**: true
   * **measure**: cpuTime
   * **output timeout**: 2000000
   * **page cycles**: 1
   * **page timeout**: 1800000
   * **playback**: mitmproxy
   * **playback pageset manifest**: mitm8-linux-firefox-example.manifest
   * **subtest unit**: ms
   * **test script**: indexeddb_write.js
   * **test summary**: flatten
   * **test url**: `<https://www.example.com>`__
   * **type**: pageload
   * **unit**: ms
   * **use live sites**: false
   * **Test Task**:

   .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addkAR1**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addkAR1**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addkAR1**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addkAR1**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addkAR1**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addkAR1**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addkAR1**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addkAR1**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addkAR1**
        - ✅
        - ✅
        - ❌
        - ❌



.. dropdown:: addkARN
   :class-container: anchor-id-addkARN-c

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t addkARN

   **Owner**: DOM Lifecycle, Workers and Storage Team

   **Description**: Use add API to send a couple of large JS Arrays to IndexedDB independently

   * **alert threshold**: 2.0
   * **apps**: firefox, chrome, safari
   * **browser cycles**: 1
   * **browsertime args**: --browsertime.iterations=128 --browsertime.chunk_size=1048576 --browsertime.buffer_type=Array --browsertime.atomic=0
   * **custom data**: true
   * **expected**: pass
   * **gecko profile entries**: 131072000
   * **gecko profile features**: js,stackwalk,cpu,memory
   * **gecko profile threads**: GeckoMain,DOM Worker,IndexedDB
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-indexeddb.toml#66>`__
   * **lower is better**: true
   * **measure**: cpuTime
   * **output timeout**: 2000000
   * **page cycles**: 1
   * **page timeout**: 1800000
   * **playback**: mitmproxy
   * **playback pageset manifest**: mitm8-linux-firefox-example.manifest
   * **subtest unit**: ms
   * **test script**: indexeddb_write.js
   * **test summary**: flatten
   * **test url**: `<https://www.example.com>`__
   * **type**: pageload
   * **unit**: ms
   * **use live sites**: false
   * **Test Task**:

   .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addkARN**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addkARN**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addkARN**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addkARN**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addkARN**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addkARN**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addkARN**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addkARN**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addkARN**
        - ✅
        - ✅
        - ❌
        - ❌



.. dropdown:: addkBL1
   :class-container: anchor-id-addkBL1-c

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t addkBL1

   **Owner**: DOM Lifecycle, Workers and Storage Team

   **Description**: Use add API to send a couple of large Blobs to IndexedDB in one transaction

   * **alert threshold**: 2.0
   * **apps**: firefox, chrome, safari
   * **browser cycles**: 1
   * **browsertime args**: --browsertime.iterations=128 --browsertime.chunk_size=1048576 --browsertime.buffer_type=Blob --browsertime.atomic=1
   * **custom data**: true
   * **expected**: pass
   * **gecko profile entries**: 131072000
   * **gecko profile features**: js,stackwalk,cpu,memory
   * **gecko profile threads**: GeckoMain,DOM Worker,IndexedDB
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-indexeddb.toml#70>`__
   * **lower is better**: true
   * **measure**: cpuTime
   * **output timeout**: 2000000
   * **page cycles**: 1
   * **page timeout**: 1800000
   * **playback**: mitmproxy
   * **playback pageset manifest**: mitm8-linux-firefox-example.manifest
   * **subtest unit**: ms
   * **test script**: indexeddb_write.js
   * **test summary**: flatten
   * **test url**: `<https://www.example.com>`__
   * **type**: pageload
   * **unit**: ms
   * **use live sites**: false
   * **Test Task**:

   .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addkBL1**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addkBL1**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addkBL1**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addkBL1**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addkBL1**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addkBL1**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addkBL1**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addkBL1**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addkBL1**
        - ✅
        - ✅
        - ❌
        - ❌



.. dropdown:: addkBLN
   :class-container: anchor-id-addkBLN-c

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t addkBLN

   **Owner**: DOM Lifecycle, Workers and Storage Team

   **Description**: Use add API to send a couple of large Blobs to IndexedDB independently

   * **alert threshold**: 2.0
   * **apps**: firefox, chrome, safari
   * **browser cycles**: 1
   * **browsertime args**: --browsertime.iterations=128 --browsertime.chunk_size=1048576 --browsertime.buffer_type=Blob --browsertime.atomic=0
   * **custom data**: true
   * **expected**: pass
   * **gecko profile entries**: 131072000
   * **gecko profile features**: js,stackwalk,cpu,memory
   * **gecko profile threads**: GeckoMain,DOM Worker,IndexedDB
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-indexeddb.toml#74>`__
   * **lower is better**: true
   * **measure**: cpuTime
   * **output timeout**: 2000000
   * **page cycles**: 1
   * **page timeout**: 1800000
   * **playback**: mitmproxy
   * **playback pageset manifest**: mitm8-linux-firefox-example.manifest
   * **subtest unit**: ms
   * **test script**: indexeddb_write.js
   * **test summary**: flatten
   * **test url**: `<https://www.example.com>`__
   * **type**: pageload
   * **unit**: ms
   * **use live sites**: false
   * **Test Task**:

   .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addkBLN**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addkBLN**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addkBLN**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addkBLN**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addkBLN**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addkBLN**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addkBLN**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addkBLN**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-addkBLN**
        - ✅
        - ✅
        - ❌
        - ❌



.. dropdown:: browsertime
   :class-container: anchor-id-browsertime-c

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t browsertime

   **Owner**: PerfTest Team

   **Description**: Used to run vanilla browsertime tests through raptor. For example: `./mach raptor -t browsertime --browsertime-arg url=https://www.sitespeed.io --browsertime-arg iterations=3`

   * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__
   * **alert threshold**: 2.0
   * **apps**: firefox
   * **browser cycles**: 1
   * **expected**: pass
   * **gecko profile interval**: 1
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-custom.toml#17>`__
   * **lower is better**: true
   * **measure**: fnbpaint, fcp, dcf, loadtime
   * **page cycles**: 1
   * **page timeout**: 60000
   * **playback**: mitmproxy
   * **playback pageset manifest**: null.manifest
   * **playback version**: 11.0.0
   * **support class**: browsertime_pageload.py
   * **test script**: None
   * **test url**: `<None>`__
   * **type**: pageload
   * **unit**: ms
   * **use live sites**: true

.. dropdown:: connect
   :class-container: anchor-id-connect-c

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t connect

   **Owner**: Network Team

   **Description**: Verifies that connection time on a pageload is zero when a speculative connection has first been made

   * **alert change type**: absolute
   * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__
   * **alert threshold**: 10.0
   * **apps**: firefox
   * **browser cycles**: 3
   * **cold**: true
   * **custom data**: true
   * **expected**: pass
   * **gecko profile interval**: 1
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-speculative.toml#18>`__
   * **lower is better**: true
   * **page cycles**: 1
   * **page timeout**: 60000
   * **test script**: speculative-connect.js
   * **test url**: `<None>`__
   * **type**: pageload
   * **unit**: ms
   * **use live sites**: true
   * **Test Task**:

   .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-speculative-firefox-connect**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-speculative-firefox-connect**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-speculative-firefox-connect**
        - ❌
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-speculative-firefox-connect**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-speculative-firefox-connect**
        - ❌
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-speculative-firefox-connect**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-speculative-firefox-connect**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-speculative-firefox-connect**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-speculative-firefox-connect**
        - ❌
        - ✅
        - ❌
        - ❌



.. dropdown:: constant-regression
   :class-container: anchor-id-constant-regression-c

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t constant-regression

   **Owner**: PerfTest Team

   **Description**: Generates a constant value that can be changed to induce a regression.

   * **alert threshold**: 2.0
   * **apps**: firefox, chrome, safari, geckoview, fenix
   * **browser cycles**: 1
   * **browsertime args**: --browsertime.constant_value=1500
   * **custom data**: true
   * **expected**: pass
   * **fore window**: 1
   * **gecko profile interval**: 1
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-regression-test.toml#23>`__
   * **lower is better**: true
   * **max back window**: 3
   * **min back window**: 2
   * **output timeout**: 2000000
   * **page cycles**: 1
   * **page timeout**: 1800000
   * **subtest unit**: ms
   * **test script**: constant_regression_test.js
   * **test summary**: flatten
   * **test url**: `<None>`__
   * **type**: pageload
   * **unit**: score
   * **use live sites**: true
   * **Test Task**:

   .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-regression-tests-firefox-constant-regression**
        - ❌
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-regression-tests-firefox-constant-regression**
        - ❌
        - ✅
        - ❌
        - ❌



.. dropdown:: getkeyrng
   :class-container: anchor-id-getkeyrng-c

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t getkeyrng

   **Owner**: DOM Lifecycle, Workers and Storage Team

   **Description**: Measures the speed of key-range based reads of IndexedDB

   * **alert threshold**: 2.0
   * **apps**: firefox, chrome, safari
   * **browser cycles**: 1
   * **custom data**: true
   * **expected**: pass
   * **gecko profile entries**: 131072000
   * **gecko profile features**: js,stackwalk,cpu,memory
   * **gecko profile threads**: GeckoMain,DOM Worker,IndexedDB
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-indexeddb.toml#78>`__
   * **lower is better**: true
   * **measure**: cpuTime
   * **output timeout**: 2000000
   * **page cycles**: 1
   * **page timeout**: 1800000
   * **playback**: mitmproxy
   * **playback pageset manifest**: mitm8-linux-firefox-example.manifest
   * **subtest unit**: ms
   * **support class**: browsertime_pageload.py
   * **test script**: indexeddb_getkeyrange.js
   * **test summary**: flatten
   * **test url**: `<https://www.example.com>`__
   * **type**: pageload
   * **unit**: ms
   * **use live sites**: false
   * **Test Task**:

   .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-getkeyrng**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-getkeyrng**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-getkeyrng**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-getkeyrng**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-getkeyrng**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-getkeyrng**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-getkeyrng**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-getkeyrng**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-indexeddb-firefox-getkeyrng**
        - ✅
        - ✅
        - ❌
        - ❌



.. dropdown:: h3-download
   :class-container: anchor-id-h3-download-c

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t h3-download

   **Owner**: Network Team

   **Description**: Measures HTTP/3 download throughput with a local server

   * **alert threshold**: 2.0
   * **apps**: firefox, chrome, custom-car
   * **browser cycles**: 1
   * **browsertime args**: --browsertime.test_type=h3_download --browsertime.iterations=10 --firefox.preference=network.http.http3.enable:true
   * **custom data**: true
   * **expected**: pass
   * **gecko profile interval**: 1
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-network-bench.toml#28>`__
   * **lower is better**: false
   * **output timeout**: 2000000
   * **page cycles**: 1
   * **page timeout**: 1800000
   * **subtest lower is better**: false
   * **subtest name filters**: tests/,iterations/
   * **subtest unit**: mbps
   * **support class**: network_bench.py
   * **test script**: network_bench.js
   * **test url**: `<None>`__
   * **type**: pageload
   * **unit**: mbps
   * **Test Task**:

   .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-network-bench-firefox-h3-download**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-download-100M_40ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-download-10M_40ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-download-1M_400ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-download-300M_40ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-download-300M_80ms-0**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-network-bench-firefox-h3-download**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-download-100M_40ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-download-10M_40ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-download-1M_400ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-download-300M_40ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-download-300M_80ms-0**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-network-bench-chrome-h3-download**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-chrome-h3-download-100M_40ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-chrome-h3-download-10M_40ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-chrome-h3-download-1M_400ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-chrome-h3-download-300M_40ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-chrome-h3-download-300M_80ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-custom-car-h3-download**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-custom-car-h3-download-100M_40ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-custom-car-h3-download-10M_40ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-custom-car-h3-download-1M_400ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-custom-car-h3-download-300M_40ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-custom-car-h3-download-300M_80ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-download**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-download-100M_40ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-download-10M_40ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-download-1M_400ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-download-300M_40ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-download-300M_80ms-0**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-network-bench-firefox-h3-download**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-download-100M_40ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-download-10M_40ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-download-1M_400ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-download-300M_40ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-download-300M_80ms-0**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-network-bench-firefox-h3-download**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-download-100M_40ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-download-10M_40ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-download-1M_400ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-download-300M_40ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-download-300M_80ms-0**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-network-bench-firefox-h3-download**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-download-100M_40ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-download-10M_40ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-download-1M_400ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-download-300M_40ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-download-300M_80ms-0**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-network-bench-firefox-h3-download**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-download-100M_40ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-download-10M_40ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-download-1M_400ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-download-300M_40ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-download-300M_80ms-0**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-network-bench-firefox-h3-download**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-download-100M_40ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-download-10M_40ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-download-1M_400ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-download-300M_40ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-download-300M_80ms-0**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-network-bench-chrome-h3-download**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-chrome-h3-download-100M_40ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-chrome-h3-download-10M_40ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-chrome-h3-download-1M_400ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-chrome-h3-download-300M_40ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-chrome-h3-download-300M_80ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-custom-car-h3-download**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-custom-car-h3-download-100M_40ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-custom-car-h3-download-10M_40ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-custom-car-h3-download-1M_400ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-custom-car-h3-download-300M_40ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-custom-car-h3-download-300M_80ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-download**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-download-100M_40ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-download-10M_40ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-download-1M_400ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-download-300M_40ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-download-300M_80ms-0**
        - ❌
        - ❌
        - ❌
        - ❌



.. dropdown:: h3-upload
   :class-container: anchor-id-h3-upload-c

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t h3-upload

   **Owner**: Network Team

   **Description**: Measures HTTP/3 file upload throughput with a local server

   * **alert threshold**: 2.0
   * **apps**: firefox, chrome, custom-car
   * **browser cycles**: 1
   * **browsertime args**: --browsertime.test_type=h3_upload --browsertime.iterations=10 --firefox.preference=network.http.http3.enable:true
   * **custom data**: true
   * **expected**: pass
   * **gecko profile interval**: 1
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-network-bench.toml#24>`__
   * **lower is better**: false
   * **output timeout**: 2000000
   * **page cycles**: 1
   * **page timeout**: 1800000
   * **subtest lower is better**: false
   * **subtest name filters**: tests/,iterations/
   * **subtest unit**: mbps
   * **support class**: network_bench.py
   * **test script**: network_bench.js
   * **test url**: `<None>`__
   * **type**: pageload
   * **unit**: mbps
   * **Test Task**:

   .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-network-bench-firefox-h3-upload**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-100M_40ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-100M_40ms-0.01**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-100M_40ms-0.1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-100M_40ms-0.5**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-100M_40ms-1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-10M_40ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-10M_40ms-0.01**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-10M_40ms-0.1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-10M_40ms-0.5**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-10M_40ms-1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-1M_400ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-1M_400ms-0.01**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-1M_400ms-0.1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-1M_400ms-0.5**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-1M_400ms-1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_40ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_40ms-0.01**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_40ms-0.1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_40ms-0.5**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_40ms-1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_80ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_80ms-0.01**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_80ms-0.1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_80ms-0.5**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_80ms-1**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-network-bench-firefox-h3-upload**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-100M_40ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-100M_40ms-0.01**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-100M_40ms-0.1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-100M_40ms-0.5**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-100M_40ms-1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-10M_40ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-10M_40ms-0.01**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-10M_40ms-0.1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-10M_40ms-0.5**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-10M_40ms-1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-1M_400ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-1M_400ms-0.01**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-1M_400ms-0.1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-1M_400ms-0.5**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-1M_400ms-1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_40ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_40ms-0.01**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_40ms-0.1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_40ms-0.5**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_40ms-1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_80ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_80ms-0.01**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_80ms-0.1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_80ms-0.5**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_80ms-1**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-network-bench-chrome-h3-upload**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-chrome-h3-upload-100M_40ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-chrome-h3-upload-100M_40ms-0.01**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-chrome-h3-upload-100M_40ms-0.1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-chrome-h3-upload-100M_40ms-0.5**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-chrome-h3-upload-100M_40ms-1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-chrome-h3-upload-10M_40ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-chrome-h3-upload-10M_40ms-0.01**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-chrome-h3-upload-10M_40ms-0.1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-chrome-h3-upload-10M_40ms-0.5**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-chrome-h3-upload-10M_40ms-1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-chrome-h3-upload-1M_400ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-chrome-h3-upload-1M_400ms-0.01**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-chrome-h3-upload-1M_400ms-0.1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-chrome-h3-upload-1M_400ms-0.5**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-chrome-h3-upload-1M_400ms-1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-chrome-h3-upload-300M_40ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-chrome-h3-upload-300M_40ms-0.01**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-chrome-h3-upload-300M_40ms-0.1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-chrome-h3-upload-300M_40ms-0.5**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-chrome-h3-upload-300M_40ms-1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-chrome-h3-upload-300M_80ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-chrome-h3-upload-300M_80ms-0.01**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-chrome-h3-upload-300M_80ms-0.1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-chrome-h3-upload-300M_80ms-0.5**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-chrome-h3-upload-300M_80ms-1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-custom-car-h3-upload**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-custom-car-h3-upload-100M_40ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-custom-car-h3-upload-100M_40ms-0.01**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-custom-car-h3-upload-100M_40ms-0.1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-custom-car-h3-upload-100M_40ms-0.5**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-custom-car-h3-upload-100M_40ms-1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-custom-car-h3-upload-10M_40ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-custom-car-h3-upload-10M_40ms-0.01**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-custom-car-h3-upload-10M_40ms-0.1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-custom-car-h3-upload-10M_40ms-0.5**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-custom-car-h3-upload-10M_40ms-1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-custom-car-h3-upload-1M_400ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-custom-car-h3-upload-1M_400ms-0.01**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-custom-car-h3-upload-1M_400ms-0.1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-custom-car-h3-upload-1M_400ms-0.5**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-custom-car-h3-upload-1M_400ms-1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-custom-car-h3-upload-300M_40ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-custom-car-h3-upload-300M_40ms-0.01**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-custom-car-h3-upload-300M_40ms-0.1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-custom-car-h3-upload-300M_40ms-0.5**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-custom-car-h3-upload-300M_40ms-1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-custom-car-h3-upload-300M_80ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-custom-car-h3-upload-300M_80ms-0.01**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-custom-car-h3-upload-300M_80ms-0.1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-custom-car-h3-upload-300M_80ms-0.5**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-custom-car-h3-upload-300M_80ms-1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-100M_40ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-100M_40ms-0.01**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-100M_40ms-0.1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-100M_40ms-0.5**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-100M_40ms-1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-10M_40ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-10M_40ms-0.01**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-10M_40ms-0.1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-10M_40ms-0.5**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-10M_40ms-1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-1M_400ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-1M_400ms-0.01**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-1M_400ms-0.1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-1M_400ms-0.5**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-1M_400ms-1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_40ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_40ms-0.01**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_40ms-0.1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_40ms-0.5**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_40ms-1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_80ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_80ms-0.01**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_80ms-0.1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_80ms-0.5**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_80ms-1**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-network-bench-firefox-h3-upload**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-100M_40ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-100M_40ms-0.01**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-100M_40ms-0.1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-100M_40ms-0.5**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-100M_40ms-1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-10M_40ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-10M_40ms-0.01**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-10M_40ms-0.1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-10M_40ms-0.5**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-10M_40ms-1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-1M_400ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-1M_400ms-0.01**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-1M_400ms-0.1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-1M_400ms-0.5**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-1M_400ms-1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_40ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_40ms-0.01**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_40ms-0.1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_40ms-0.5**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_40ms-1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_80ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_80ms-0.01**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_80ms-0.1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_80ms-0.5**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_80ms-1**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-network-bench-firefox-h3-upload**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-100M_40ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-100M_40ms-0.01**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-100M_40ms-0.1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-100M_40ms-0.5**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-100M_40ms-1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-10M_40ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-10M_40ms-0.01**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-10M_40ms-0.1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-10M_40ms-0.5**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-10M_40ms-1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-1M_400ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-1M_400ms-0.01**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-1M_400ms-0.1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-1M_400ms-0.5**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-1M_400ms-1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_40ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_40ms-0.01**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_40ms-0.1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_40ms-0.5**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_40ms-1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_80ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_80ms-0.01**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_80ms-0.1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_80ms-0.5**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_80ms-1**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-network-bench-firefox-h3-upload**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-100M_40ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-100M_40ms-0.01**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-100M_40ms-0.1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-100M_40ms-0.5**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-100M_40ms-1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-10M_40ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-10M_40ms-0.01**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-10M_40ms-0.1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-10M_40ms-0.5**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-10M_40ms-1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-1M_400ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-1M_400ms-0.01**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-1M_400ms-0.1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-1M_400ms-0.5**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-1M_400ms-1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_40ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_40ms-0.01**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_40ms-0.1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_40ms-0.5**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_40ms-1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_80ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_80ms-0.01**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_80ms-0.1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_80ms-0.5**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_80ms-1**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-network-bench-firefox-h3-upload**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-100M_40ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-100M_40ms-0.01**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-100M_40ms-0.1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-100M_40ms-0.5**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-100M_40ms-1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-10M_40ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-10M_40ms-0.01**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-10M_40ms-0.1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-10M_40ms-0.5**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-10M_40ms-1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-1M_400ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-1M_400ms-0.01**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-1M_400ms-0.1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-1M_400ms-0.5**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-1M_400ms-1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_40ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_40ms-0.01**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_40ms-0.1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_40ms-0.5**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_40ms-1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_80ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_80ms-0.01**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_80ms-0.1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_80ms-0.5**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_80ms-1**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-network-bench-firefox-h3-upload**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-100M_40ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-100M_40ms-0.01**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-100M_40ms-0.1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-100M_40ms-0.5**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-100M_40ms-1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-10M_40ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-10M_40ms-0.01**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-10M_40ms-0.1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-10M_40ms-0.5**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-10M_40ms-1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-1M_400ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-1M_400ms-0.01**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-1M_400ms-0.1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-1M_400ms-0.5**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-1M_400ms-1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_40ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_40ms-0.01**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_40ms-0.1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_40ms-0.5**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_40ms-1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_80ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_80ms-0.01**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_80ms-0.1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_80ms-0.5**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_80ms-1**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-network-bench-chrome-h3-upload**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-chrome-h3-upload-100M_40ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-chrome-h3-upload-100M_40ms-0.01**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-chrome-h3-upload-100M_40ms-0.1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-chrome-h3-upload-100M_40ms-0.5**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-chrome-h3-upload-100M_40ms-1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-chrome-h3-upload-10M_40ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-chrome-h3-upload-10M_40ms-0.01**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-chrome-h3-upload-10M_40ms-0.1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-chrome-h3-upload-10M_40ms-0.5**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-chrome-h3-upload-10M_40ms-1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-chrome-h3-upload-1M_400ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-chrome-h3-upload-1M_400ms-0.01**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-chrome-h3-upload-1M_400ms-0.1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-chrome-h3-upload-1M_400ms-0.5**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-chrome-h3-upload-1M_400ms-1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-chrome-h3-upload-300M_40ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-chrome-h3-upload-300M_40ms-0.01**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-chrome-h3-upload-300M_40ms-0.1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-chrome-h3-upload-300M_40ms-0.5**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-chrome-h3-upload-300M_40ms-1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-chrome-h3-upload-300M_80ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-chrome-h3-upload-300M_80ms-0.01**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-chrome-h3-upload-300M_80ms-0.1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-chrome-h3-upload-300M_80ms-0.5**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-chrome-h3-upload-300M_80ms-1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-custom-car-h3-upload**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-custom-car-h3-upload-100M_40ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-custom-car-h3-upload-100M_40ms-0.01**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-custom-car-h3-upload-100M_40ms-0.1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-custom-car-h3-upload-100M_40ms-0.5**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-custom-car-h3-upload-100M_40ms-1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-custom-car-h3-upload-10M_40ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-custom-car-h3-upload-10M_40ms-0.01**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-custom-car-h3-upload-10M_40ms-0.1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-custom-car-h3-upload-10M_40ms-0.5**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-custom-car-h3-upload-10M_40ms-1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-custom-car-h3-upload-1M_400ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-custom-car-h3-upload-1M_400ms-0.01**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-custom-car-h3-upload-1M_400ms-0.1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-custom-car-h3-upload-1M_400ms-0.5**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-custom-car-h3-upload-1M_400ms-1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-custom-car-h3-upload-300M_40ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-custom-car-h3-upload-300M_40ms-0.01**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-custom-car-h3-upload-300M_40ms-0.1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-custom-car-h3-upload-300M_40ms-0.5**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-custom-car-h3-upload-300M_40ms-1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-custom-car-h3-upload-300M_80ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-custom-car-h3-upload-300M_80ms-0.01**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-custom-car-h3-upload-300M_80ms-0.1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-custom-car-h3-upload-300M_80ms-0.5**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-custom-car-h3-upload-300M_80ms-1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-100M_40ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-100M_40ms-0.01**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-100M_40ms-0.1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-100M_40ms-0.5**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-100M_40ms-1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-10M_40ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-10M_40ms-0.01**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-10M_40ms-0.1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-10M_40ms-0.5**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-10M_40ms-1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-1M_400ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-1M_400ms-0.01**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-1M_400ms-0.1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-1M_400ms-0.5**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-1M_400ms-1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_40ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_40ms-0.01**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_40ms-0.1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_40ms-0.5**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_40ms-1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_80ms-0**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_80ms-0.01**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_80ms-0.1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_80ms-0.5**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-network-bench-firefox-h3-upload-300M_80ms-1**
        - ❌
        - ❌
        - ❌
        - ❌



.. dropdown:: process-switch
   :class-container: anchor-id-process-switch-c

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t process-switch

   **Owner**: PerfTest Team

   **Description**: Measures process switch time

   * **accept zero vismet**: true
   * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__
   * **alert threshold**: 2.0
   * **apps**: firefox, chrome
   * **browser cycles**: 25
   * **browsertime args**: --pageCompleteWaitTime=1000 --pageCompleteCheckInactivity=true
   * **expected**: pass
   * **gecko profile interval**: 1
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-process-switch.toml#20>`__
   * **lower is better**: true
   * **measure**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
   * **page cycles**: 25
   * **page timeout**: 60000
   * **playback**: mitmproxy
   * **playback pageset manifest**: mitm5-linux-firefox-proc-switch.manifest
   * **playback version**: 5.1.1
   * **support class**: browsertime_pageload.py
   * **test script**: process_switch.js
   * **test url**: `<https://mozilla.seanfeng.dev/files/red.html,https://mozilla.pettay.fi/moztests/blue.html>`__
   * **type**: pageload
   * **unit**: ms
   * **use live sites**: false
   * **Test Task**:

   .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-custom-firefox-process-switch**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-custom-firefox-process-switch**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-custom-firefox-process-switch**
        - ✅
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-custom-firefox-process-switch**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-custom-firefox-process-switch**
        - ✅
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-custom-firefox-process-switch**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-custom-firefox-process-switch**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-custom-firefox-process-switch**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-custom-firefox-process-switch**
        - ✅
        - ❌
        - ❌
        - ❌



.. dropdown:: sample-python-support
   :class-container: anchor-id-sample-python-support-c

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t sample-python-support

   **Owner**: PerfTest Team

   **Description**: A sample test that uses a python support file to modify the test command.

   * **alert threshold**: 2.0
   * **apps**: firefox
   * **browser cycles**: 1
   * **browsertime args**: --browsertime.constant_value={replace-with-constant-value}
   * **custom data**: true
   * **expected**: pass
   * **fore window**: 1
   * **gecko profile interval**: 1
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-sample-python-support.toml#22>`__
   * **lower is better**: true
   * **max back window**: 3
   * **min back window**: 2
   * **output timeout**: 2000000
   * **page cycles**: 1
   * **page timeout**: 1800000
   * **subtest unit**: ms
   * **support class**: sample_python_support.py
   * **test script**: constant_regression_test.js
   * **test summary**: flatten
   * **test url**: `<None>`__
   * **type**: pageload
   * **unit**: score
   * **use live sites**: true

.. dropdown:: throttled
   :class-container: anchor-id-throttled-c

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t throttled

   **Owner**: Network Team

   **Description**: Pageload test using a throttled network environment

   * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__
   * **alert threshold**: 2.0
   * **apps**: firefox
   * **browser cycles**: 3
   * **cold**: true
   * **custom data**: true
   * **expected**: pass
   * **gecko profile interval**: 1
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-throttled-pageload.toml#17>`__
   * **lower is better**: true
   * **page cycles**: 1
   * **page timeout**: 60000
   * **test script**: throttled_pageload.js
   * **test url**: `<None>`__
   * **type**: pageload
   * **unit**: ms
   * **use live sites**: true
   * **Test Task**:

   .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-throttled-firefox-throttled**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-throttled-firefox-throttled**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-throttled-firefox-throttled**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-throttled-firefox-throttled**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-throttled-firefox-throttled**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-throttled-firefox-throttled**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-throttled-firefox-throttled**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-throttled-firefox-throttled**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-throttled-firefox-throttled**
        - ❌
        - ❌
        - ❌
        - ❌



.. dropdown:: tp6-bench
   :class-container: anchor-id-tp6-bench-c

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t tp6-bench

   **Owner**: PerfTest Team

   **Description**: A pageload benchmark test that quickly runs through a selection of the pages available to produce a single overall metric for fcp, lcp, and loadtime. The metrics from all pages get summarized with the geomean, and mean.


   * **alert threshold**: 2.0
   * **apps**: firefox, chrome, chromium, safari
   * **browser cycles**: 1
   * **cold**: true
   * **custom data**: true
   * **expected**: pass
   * **gecko profile interval**: 1
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-tp6-bench.toml#19>`__
   * **lower is better**: true
   * **output timeout**: 2000000
   * **page cycles**: 1
   * **page timeout**: 1800000
   * **playback**: mitmproxy
   * **playback pageset manifest**: None
   * **playback version**: 8.1.1
   * **subtest unit**: ms
   * **support class**: browsertime_tp6_bench.py
   * **test script**: browsertime_tp6_bench.js
   * **test summary**: flatten
   * **test url**: `<None>`__
   * **type**: pageload
   * **unit**: ms
   * **Test Task**:

   .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-pageload-benchmark-firefox-tp6-bench**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-pageload-benchmark-firefox-tp6-bench**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-pageload-benchmark-firefox-tp6-bench**
        - ❌
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-pageload-benchmark-firefox-tp6-bench**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-pageload-benchmark-firefox-tp6-bench**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-pageload-benchmark-firefox-tp6-bench**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-pageload-benchmark-firefox-tp6-bench**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-pageload-benchmark-firefox-tp6-bench**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-pageload-benchmark-firefox-tp6-bench**
        - ❌
        - ✅
        - ❌
        - ❌



.. dropdown:: upload
   :class-container: anchor-id-upload-c

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t upload

   **Owner**: Network Team

   **Description**: Measures HTTP/2 file upload throughput with a remote server

   * **alert threshold**: 2.0
   * **apps**: firefox, chrome, safari
   * **browser cycles**: 1
   * **browsertime args**: --browsertime.test_type=h2_upload --browsertime.iterations=10 --browsertime.server_url=https://uploadtest-381620.uc.r.appspot.com --firefox.preference=network.http.http3.enable:false --chrome.args disable-quic
   * **custom data**: true
   * **expected**: pass
   * **gecko profile interval**: 1
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-upload.toml#16>`__
   * **lower is better**: false
   * **output timeout**: 2000000
   * **page cycles**: 1
   * **page timeout**: 1800000
   * **subtest lower is better**: false
   * **subtest name filters**: tests/,iterations/
   * **subtest unit**: mbps
   * **test script**: network_bench.js
   * **test url**: `<None>`__
   * **type**: pageload
   * **unit**: mbps
   * **use live sites**: true
   * **Test Task**:

   .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-upload-firefox-upload**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-upload-firefox-upload**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-upload-chrome-upload**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-upload-firefox-upload**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-upload-firefox-upload**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-upload-firefox-upload**
        - ✅
        - ✅
        - ❌
        - ❌
      * - **browsertime-upload-safari-upload**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-upload-firefox-upload**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-upload-firefox-upload**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-upload-firefox-upload**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-upload-chrome-upload**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-upload-firefox-upload**
        - ✅
        - ✅
        - ❌
        - ❌



.. dropdown:: upload-h3
   :class-container: anchor-id-upload-h3-c

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t upload-h3

   **Owner**: Network Team

   **Description**: Measures HTTP/3 file upload throughput with a remote server

   * **alert threshold**: 2.0
   * **apps**: firefox, chrome, safari
   * **browser cycles**: 1
   * **browsertime args**: --browsertime.test_type=h3_upload --browsertime.iterations=10 --browsertime.server_url=https://uploadtest-381620.uc.r.appspot.com --firefox.preference=network.http.http3.enable:true
   * **custom data**: true
   * **expected**: pass
   * **gecko profile interval**: 1
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-upload.toml#31>`__
   * **lower is better**: false
   * **output timeout**: 2000000
   * **page cycles**: 1
   * **page timeout**: 1800000
   * **subtest lower is better**: false
   * **subtest name filters**: tests/,iterations/
   * **subtest unit**: mbps
   * **test script**: network_bench.js
   * **test url**: `<None>`__
   * **type**: pageload
   * **unit**: mbps
   * **use live sites**: true
   * **Test Task**:

   .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-upload-firefox-upload-h3**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-upload-firefox-upload-h3**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-upload-chrome-upload-h3**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-upload-firefox-upload-h3**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-upload-firefox-upload-h3**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-upload-firefox-upload-h3**
        - ✅
        - ✅
        - ❌
        - ❌
      * - **browsertime-upload-safari-upload-h3**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-upload-firefox-upload-h3**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-upload-firefox-upload-h3**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-upload-firefox-upload-h3**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-upload-chrome-upload-h3**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-upload-firefox-upload-h3**
        - ✅
        - ✅
        - ❌
        - ❌



.. dropdown:: ve-av1-q
   :class-container: anchor-id-ve-av1-q-c

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t ve-av1-q

   **Owner**: :chunmin and Media Team

   **Description**: Measures AV1 encoding performance for 1080p video in quality mode.

   * **alert threshold**: 2.0
   * **apps**: firefox, chrome, safari, custom-car
   * **expected**: pass
   * **expose browser profiler**: true
   * **gecko profile interval**: 1
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-webcodecs.toml#21>`__
   * **lower is better**: true
   * **page cycles**: 3
   * **page timeout**: 360000
   * **repository**: https://github.com/mozilla/perf-automation
   * **repository path**: benchmarks/webcodecs
   * **repository revision**: d34775ba6b6cef6068005c05b570d6c79eb0f7d8
   * **support class**: browsertime_benchmark.py
   * **test url**: `<http://\<host\>:\<port\>/index.html?raptor&codecs=av01.0.04M.08&latencyModes=quality&width=1920&height=1080&framerate=30>`__
   * **type**: benchmark
   * **unit**: score
   * **Test Task**:

   .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-webcodecs-firefox-ve-av1-q**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-webcodecs-firefox-ve-av1-q**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-webcodecs-chrome-ve-av1-q**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-webcodecs-custom-car-ve-av1-q**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-webcodecs-firefox-ve-av1-q**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-webcodecs-firefox-ve-av1-q**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-webcodecs-firefox-ve-av1-q**
        - ✅
        - ✅
        - ❌
        - ❌
      * - **browsertime-webcodecs-safari-ve-av1-q**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-webcodecs-firefox-ve-av1-q**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-webcodecs-firefox-ve-av1-q**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-webcodecs-firefox-ve-av1-q**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-webcodecs-chrome-ve-av1-q**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-webcodecs-custom-car-ve-av1-q**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-webcodecs-firefox-ve-av1-q**
        - ✅
        - ✅
        - ❌
        - ❌



.. dropdown:: ve-av1-rt
   :class-container: anchor-id-ve-av1-rt-c

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t ve-av1-rt

   **Owner**: :chunmin and Media Team

   **Description**: Measures AV1 encoding performance for 1080p video in real-time mode.

   * **alert threshold**: 2.0
   * **apps**: firefox, chrome, safari, custom-car
   * **expected**: pass
   * **expose browser profiler**: true
   * **gecko profile interval**: 1
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-webcodecs.toml#18>`__
   * **lower is better**: true
   * **page cycles**: 3
   * **page timeout**: 360000
   * **repository**: https://github.com/mozilla/perf-automation
   * **repository path**: benchmarks/webcodecs
   * **repository revision**: d34775ba6b6cef6068005c05b570d6c79eb0f7d8
   * **support class**: browsertime_benchmark.py
   * **test url**: `<http://\<host\>:\<port\>/index.html?raptor&codecs=av01.0.04M.08&latencyModes=realtime&width=1920&height=1080&framerate=30>`__
   * **type**: benchmark
   * **unit**: score
   * **Test Task**:

   .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-webcodecs-firefox-ve-av1-rt**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-webcodecs-firefox-ve-av1-rt**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-webcodecs-chrome-ve-av1-rt**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-webcodecs-custom-car-ve-av1-rt**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-webcodecs-firefox-ve-av1-rt**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-webcodecs-firefox-ve-av1-rt**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-webcodecs-firefox-ve-av1-rt**
        - ✅
        - ✅
        - ❌
        - ❌
      * - **browsertime-webcodecs-safari-ve-av1-rt**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-webcodecs-firefox-ve-av1-rt**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-webcodecs-firefox-ve-av1-rt**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-webcodecs-firefox-ve-av1-rt**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-webcodecs-chrome-ve-av1-rt**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-webcodecs-custom-car-ve-av1-rt**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-webcodecs-firefox-ve-av1-rt**
        - ✅
        - ✅
        - ❌
        - ❌



.. dropdown:: ve-h264-q
   :class-container: anchor-id-ve-h264-q-c

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t ve-h264-q

   **Owner**: :chunmin and Media Team

   **Description**: Measures H264-baseline encoding performance for 1080p video in quality mode using AVC format.

   * **alert threshold**: 2.0
   * **apps**: firefox, chrome, safari, custom-car
   * **expected**: pass
   * **expose browser profiler**: true
   * **gecko profile interval**: 1
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-webcodecs.toml#27>`__
   * **lower is better**: true
   * **page cycles**: 3
   * **page timeout**: 360000
   * **repository**: https://github.com/mozilla/perf-automation
   * **repository path**: benchmarks/webcodecs
   * **repository revision**: d34775ba6b6cef6068005c05b570d6c79eb0f7d8
   * **support class**: browsertime_benchmark.py
   * **test url**: `<http://\<host\>:\<port\>/index.html?raptor&codecs=avc1.42001E:avc&latencyModes=quality&width=1920&height=1080&framerate=30>`__
   * **type**: benchmark
   * **unit**: score
   * **Test Task**:

   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-webcodecs-firefox-ve-h264-q**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-webcodecs-firefox-ve-h264-q**
        - ✅
        - ✅
        - ❌
        - ❌
      * - **browsertime-webcodecs-safari-ve-h264-q**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-webcodecs-firefox-ve-h264-q**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-webcodecs-firefox-ve-h264-q**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-webcodecs-firefox-ve-h264-q**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-webcodecs-firefox-ve-h264-q**
        - ✅
        - ✅
        - ❌
        - ❌



.. dropdown:: ve-h264-q-sd
   :class-container: anchor-id-ve-h264-q-sd-c

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t ve-h264-q-sd

   **Owner**: :chunmin and Media Team

   **Description**: Measures H264-baseline encoding performance for 480p video in quality mode using AVC format.

   * **alert threshold**: 2.0
   * **apps**: firefox, chrome, safari, custom-car
   * **expected**: pass
   * **expose browser profiler**: true
   * **gecko profile interval**: 1
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-webcodecs.toml#33>`__
   * **lower is better**: true
   * **page cycles**: 3
   * **page timeout**: 360000
   * **repository**: https://github.com/mozilla/perf-automation
   * **repository path**: benchmarks/webcodecs
   * **repository revision**: d34775ba6b6cef6068005c05b570d6c79eb0f7d8
   * **support class**: browsertime_benchmark.py
   * **test url**: `<http://\<host\>:\<port\>/index.html?raptor&codecs=avc1.42001E:avc&latencyModes=quality&width=640&height=480&framerate=30>`__
   * **type**: benchmark
   * **unit**: score
   * **Test Task**:

   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-webcodecs-firefox-ve-h264-q-sd**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-webcodecs-firefox-ve-h264-q-sd**
        - ✅
        - ✅
        - ❌
        - ❌
      * - **browsertime-webcodecs-safari-ve-h264-q-sd**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-webcodecs-firefox-ve-h264-q-sd**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-webcodecs-firefox-ve-h264-q-sd**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-webcodecs-firefox-ve-h264-q-sd**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-webcodecs-chrome-ve-h264-q-sd**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-webcodecs-custom-car-ve-h264-q-sd**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-webcodecs-firefox-ve-h264-q-sd**
        - ✅
        - ✅
        - ❌
        - ❌



.. dropdown:: ve-h264-rt
   :class-container: anchor-id-ve-h264-rt-c

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t ve-h264-rt

   **Owner**: :chunmin and Media Team

   **Description**: Measures H264-baseline encoding performance for 1080p video in real-time mode using Annex B format.

   * **alert threshold**: 2.0
   * **apps**: firefox, chrome, safari, custom-car
   * **expected**: pass
   * **expose browser profiler**: true
   * **gecko profile interval**: 1
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-webcodecs.toml#24>`__
   * **lower is better**: true
   * **page cycles**: 3
   * **page timeout**: 360000
   * **repository**: https://github.com/mozilla/perf-automation
   * **repository path**: benchmarks/webcodecs
   * **repository revision**: d34775ba6b6cef6068005c05b570d6c79eb0f7d8
   * **support class**: browsertime_benchmark.py
   * **test url**: `<http://\<host\>:\<port\>/index.html?raptor&codecs=avc1.42001E:annexb&latencyModes=realtime&width=1920&height=1080&framerate=30>`__
   * **type**: benchmark
   * **unit**: score
   * **Test Task**:

   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-webcodecs-firefox-ve-h264-rt**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-webcodecs-firefox-ve-h264-rt**
        - ✅
        - ✅
        - ❌
        - ❌
      * - **browsertime-webcodecs-safari-ve-h264-rt**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-webcodecs-firefox-ve-h264-rt**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-webcodecs-firefox-ve-h264-rt**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-webcodecs-firefox-ve-h264-rt**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-webcodecs-firefox-ve-h264-rt**
        - ✅
        - ✅
        - ❌
        - ❌



.. dropdown:: ve-h264-rt-sd
   :class-container: anchor-id-ve-h264-rt-sd-c

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t ve-h264-rt-sd

   **Owner**: :chunmin and Media Team

   **Description**: Measures H264-baseline encoding performance for 480p video in real-time mode using Annex B format.

   * **alert threshold**: 2.0
   * **apps**: firefox, chrome, safari, custom-car
   * **expected**: pass
   * **expose browser profiler**: true
   * **gecko profile interval**: 1
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-webcodecs.toml#30>`__
   * **lower is better**: true
   * **page cycles**: 3
   * **page timeout**: 360000
   * **repository**: https://github.com/mozilla/perf-automation
   * **repository path**: benchmarks/webcodecs
   * **repository revision**: d34775ba6b6cef6068005c05b570d6c79eb0f7d8
   * **support class**: browsertime_benchmark.py
   * **test url**: `<http://\<host\>:\<port\>/index.html?raptor&codecs=avc1.42001E:annexb&latencyModes=realtime&width=640&height=480&framerate=30>`__
   * **type**: benchmark
   * **unit**: score
   * **Test Task**:

   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-webcodecs-firefox-ve-h264-rt-sd**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-webcodecs-firefox-ve-h264-rt-sd**
        - ✅
        - ✅
        - ❌
        - ❌
      * - **browsertime-webcodecs-safari-ve-h264-rt-sd**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-webcodecs-firefox-ve-h264-rt-sd**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-webcodecs-firefox-ve-h264-rt-sd**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-webcodecs-firefox-ve-h264-rt-sd**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-webcodecs-chrome-ve-h264-rt-sd**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-webcodecs-custom-car-ve-h264-rt-sd**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-webcodecs-firefox-ve-h264-rt-sd**
        - ✅
        - ✅
        - ❌
        - ❌



.. dropdown:: ve-vp8-q
   :class-container: anchor-id-ve-vp8-q-c

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t ve-vp8-q

   **Owner**: :chunmin and Media Team

   **Description**: Measures VP8 encoding performance for 1080p video in quality mode.

   * **alert threshold**: 2.0
   * **apps**: firefox, chrome, safari, custom-car
   * **expected**: pass
   * **expose browser profiler**: true
   * **gecko profile interval**: 1
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-webcodecs.toml#39>`__
   * **lower is better**: true
   * **page cycles**: 3
   * **page timeout**: 360000
   * **repository**: https://github.com/mozilla/perf-automation
   * **repository path**: benchmarks/webcodecs
   * **repository revision**: d34775ba6b6cef6068005c05b570d6c79eb0f7d8
   * **support class**: browsertime_benchmark.py
   * **test url**: `<http://\<host\>:\<port\>/index.html?raptor&codecs=vp8&latencyModes=quality&width=1920&height=1080&framerate=30>`__
   * **type**: benchmark
   * **unit**: score
   * **Test Task**:

   .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-webcodecs-firefox-ve-vp8-q**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-webcodecs-firefox-ve-vp8-q**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-webcodecs-chrome-ve-vp8-q**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-webcodecs-custom-car-ve-vp8-q**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-webcodecs-firefox-ve-vp8-q**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-webcodecs-firefox-ve-vp8-q**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-webcodecs-firefox-ve-vp8-q**
        - ✅
        - ✅
        - ❌
        - ❌
      * - **browsertime-webcodecs-safari-ve-vp8-q**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-webcodecs-firefox-ve-vp8-q**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-webcodecs-firefox-ve-vp8-q**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-webcodecs-firefox-ve-vp8-q**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-webcodecs-chrome-ve-vp8-q**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-webcodecs-custom-car-ve-vp8-q**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-webcodecs-firefox-ve-vp8-q**
        - ✅
        - ✅
        - ❌
        - ❌



.. dropdown:: ve-vp8-rt
   :class-container: anchor-id-ve-vp8-rt-c

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t ve-vp8-rt

   **Owner**: :chunmin and Media Team

   **Description**: Measures VP8 encoding performance for 1080p video in real-time mode.

   * **alert threshold**: 2.0
   * **apps**: firefox, chrome, safari, custom-car
   * **expected**: pass
   * **expose browser profiler**: true
   * **gecko profile interval**: 1
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-webcodecs.toml#36>`__
   * **lower is better**: true
   * **page cycles**: 3
   * **page timeout**: 360000
   * **repository**: https://github.com/mozilla/perf-automation
   * **repository path**: benchmarks/webcodecs
   * **repository revision**: d34775ba6b6cef6068005c05b570d6c79eb0f7d8
   * **support class**: browsertime_benchmark.py
   * **test url**: `<http://\<host\>:\<port\>/index.html?raptor&codecs=vp8&latencyModes=realtime&width=1920&height=1080&framerate=30>`__
   * **type**: benchmark
   * **unit**: score
   * **Test Task**:

   .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-webcodecs-firefox-ve-vp8-rt**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-webcodecs-firefox-ve-vp8-rt**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-webcodecs-chrome-ve-vp8-rt**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-webcodecs-custom-car-ve-vp8-rt**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-webcodecs-firefox-ve-vp8-rt**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-webcodecs-firefox-ve-vp8-rt**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-webcodecs-firefox-ve-vp8-rt**
        - ✅
        - ✅
        - ❌
        - ❌
      * - **browsertime-webcodecs-safari-ve-vp8-rt**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-webcodecs-firefox-ve-vp8-rt**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-webcodecs-firefox-ve-vp8-rt**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-webcodecs-firefox-ve-vp8-rt**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-webcodecs-chrome-ve-vp8-rt**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-webcodecs-custom-car-ve-vp8-rt**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-webcodecs-firefox-ve-vp8-rt**
        - ✅
        - ✅
        - ❌
        - ❌



.. dropdown:: ve-vp9-q
   :class-container: anchor-id-ve-vp9-q-c

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t ve-vp9-q

   **Owner**: :chunmin and Media Team

   **Description**: Measures VP9 encoding performance for 1080p video in quality mode.

   * **alert threshold**: 2.0
   * **apps**: firefox, chrome, safari, custom-car
   * **expected**: pass
   * **expose browser profiler**: true
   * **gecko profile interval**: 1
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-webcodecs.toml#45>`__
   * **lower is better**: true
   * **page cycles**: 3
   * **page timeout**: 360000
   * **repository**: https://github.com/mozilla/perf-automation
   * **repository path**: benchmarks/webcodecs
   * **repository revision**: d34775ba6b6cef6068005c05b570d6c79eb0f7d8
   * **support class**: browsertime_benchmark.py
   * **test url**: `<http://\<host\>:\<port\>/index.html?raptor&codecs=vp09.00.10.08&latencyModes=quality&width=1920&height=1080&framerate=30>`__
   * **type**: benchmark
   * **unit**: score
   * **Test Task**:

   .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-webcodecs-firefox-ve-vp9-q**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-webcodecs-firefox-ve-vp9-q**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-webcodecs-chrome-ve-vp9-q**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-webcodecs-custom-car-ve-vp9-q**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-webcodecs-firefox-ve-vp9-q**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-webcodecs-firefox-ve-vp9-q**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-webcodecs-firefox-ve-vp9-q**
        - ✅
        - ✅
        - ❌
        - ❌
      * - **browsertime-webcodecs-safari-ve-vp9-q**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-webcodecs-firefox-ve-vp9-q**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-webcodecs-firefox-ve-vp9-q**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-webcodecs-firefox-ve-vp9-q**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-webcodecs-chrome-ve-vp9-q**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-webcodecs-custom-car-ve-vp9-q**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-webcodecs-firefox-ve-vp9-q**
        - ✅
        - ✅
        - ❌
        - ❌



.. dropdown:: ve-vp9-rt
   :class-container: anchor-id-ve-vp9-rt-c

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t ve-vp9-rt

   **Owner**: :chunmin and Media Team

   **Description**: Measures VP9 encoding performance for 1080p video in real-time mode.

   * **alert threshold**: 2.0
   * **apps**: firefox, chrome, safari, custom-car
   * **expected**: pass
   * **expose browser profiler**: true
   * **gecko profile interval**: 1
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-webcodecs.toml#42>`__
   * **lower is better**: true
   * **page cycles**: 3
   * **page timeout**: 360000
   * **repository**: https://github.com/mozilla/perf-automation
   * **repository path**: benchmarks/webcodecs
   * **repository revision**: d34775ba6b6cef6068005c05b570d6c79eb0f7d8
   * **support class**: browsertime_benchmark.py
   * **test url**: `<http://\<host\>:\<port\>/index.html?raptor&codecs=vp09.00.10.08&latencyModes=realtime&width=1920&height=1080&framerate=30>`__
   * **type**: benchmark
   * **unit**: score
   * **Test Task**:

   .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-webcodecs-firefox-ve-vp9-rt**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-webcodecs-firefox-ve-vp9-rt**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-webcodecs-chrome-ve-vp9-rt**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-webcodecs-custom-car-ve-vp9-rt**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-webcodecs-firefox-ve-vp9-rt**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-webcodecs-firefox-ve-vp9-rt**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-webcodecs-firefox-ve-vp9-rt**
        - ✅
        - ✅
        - ❌
        - ❌
      * - **browsertime-webcodecs-safari-ve-vp9-rt**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-webcodecs-firefox-ve-vp9-rt**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-webcodecs-firefox-ve-vp9-rt**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-webcodecs-firefox-ve-vp9-rt**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-webcodecs-chrome-ve-vp9-rt**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-webcodecs-custom-car-ve-vp9-rt**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-webcodecs-firefox-ve-vp9-rt**
        - ✅
        - ✅
        - ❌
        - ❌



.. dropdown:: vpl-av1
   :class-container: anchor-id-vpl-av1-c

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t vpl-av1

   **Owner**: :aosmond and the Media Team

   **Description**: Measures AV1 1080p video playback latency.

   * **alert on**: `estimatedFirstFrameLatency <raptor-metrics.html#estimated-frame-latency-(first)>`__, `estimatedAnyFrameLatency <raptor-metrics.html#estimated-frame-latency-(any)>`__
   * **alert threshold**: 2.0
   * **apps**: chrome, chrome-m, geckoview, fenix, firefox, safari
   * **benchmark webserver**: true
   * **browser cycles**: 20
   * **expected**: pass
   * **gecko profile features**: stackwalk,js,cpu,java,processcpu,screenshots,memory
   * **gecko profile interval**: 1
   * **gecko profile threads**: BackgroundThreadPool,Compositor,decoder,GeckoMain,gmp,graph,grph,InotifyEventThread,IPDL Background,media,ModuleProcessThread,PacerThread,RemVidChild,RenderBackend,Renderer,SwComposite,TextureUpdate,ImageBridgeChld
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-video-playback-latency.toml#36>`__
   * **lower is better**: true
   * **measure**: firstFrame, secondFrame, lastFrame, estimatedFirstFrameLatency, estimatedAnyFrameLatency
   * **newtab per cycle**: true
   * **page cycles**: 20
   * **page timeout**: 20000
   * **preferences**: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false
   * **repository**: https://github.com/mozilla/perf-automation
   * **repository path**: benchmarks/video-playback-latency
   * **repository revision**: e3d0295c15cfdd6f32e6d4270de0ed5d6c1632cd
   * **support class**: video_playback_latency.py
   * **test url**: `<http://\<host\>:\<port\>/av1_1080p.html>`__
   * **type**: pageload
   * **unit**: ms
   * **Test Task**:

   .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-video-playback-latency-mobile-chrome-m-vpl-av1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-video-playback-latency-mobile-chrome-m-vpl-av1-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-video-playback-latency-mobile-fenix-vpl-av1**
        - ✅
        - ✅
        - ❌
        - ❌
      * - **browsertime-video-playback-latency-mobile-fenix-vpl-av1-nofis**
        - ✅
        - ✅
        - ❌
        - ❌
      * - **browsertime-video-playback-latency-mobile-geckoview-vpl-av1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-video-playback-latency-mobile-geckoview-vpl-av1-nofis**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-android-hw-a55-14-0-aarch64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-video-playback-latency-mobile-fenix-vpl-av1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-video-playback-latency-mobile-fenix-vpl-av1-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-video-playback-latency-mobile-geckoview-vpl-av1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-video-playback-latency-mobile-geckoview-vpl-av1-nofis**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-video-playback-latency-firefox-vpl-av1**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-video-playback-latency-firefox-vpl-av1**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-video-playback-latency-chrome-vpl-av1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-video-playback-latency-firefox-vpl-av1**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-video-playback-latency-firefox-vpl-av1**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-video-playback-latency-firefox-vpl-av1**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-video-playback-latency-firefox-vpl-av1**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-2009-hw-ref-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-video-playback-latency-chrome-vpl-av1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-video-playback-latency-firefox-vpl-av1**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-2009-hw-ref/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-video-playback-latency-firefox-vpl-av1**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-video-playback-latency-firefox-vpl-av1**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-video-playback-latency-firefox-vpl-av1**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-video-playback-latency-chrome-vpl-av1**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-video-playback-latency-firefox-vpl-av1**
        - ❌
        - ❌
        - ❌
        - ❌



.. dropdown:: vpl-h264
   :class-container: anchor-id-vpl-h264-c

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t vpl-h264

   **Owner**: :aosmond and the Media Team

   **Description**: Measures H264 1080p video playback latency.

   * **alert on**: `estimatedFirstFrameLatency <raptor-metrics.html#estimated-frame-latency-(first)>`__, `estimatedAnyFrameLatency <raptor-metrics.html#estimated-frame-latency-(any)>`__
   * **alert threshold**: 2.0
   * **apps**: chrome, chrome-m, geckoview, fenix, firefox, safari
   * **benchmark webserver**: true
   * **browser cycles**: 20
   * **expected**: pass
   * **gecko profile features**: stackwalk,js,cpu,java,processcpu,screenshots,memory
   * **gecko profile interval**: 1
   * **gecko profile threads**: BackgroundThreadPool,Compositor,decoder,GeckoMain,gmp,graph,grph,InotifyEventThread,IPDL Background,media,ModuleProcessThread,PacerThread,RemVidChild,RenderBackend,Renderer,SwComposite,TextureUpdate,ImageBridgeChld
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-video-playback-latency.toml#30>`__
   * **lower is better**: true
   * **measure**: firstFrame, secondFrame, lastFrame, estimatedFirstFrameLatency, estimatedAnyFrameLatency
   * **newtab per cycle**: true
   * **page cycles**: 20
   * **page timeout**: 20000
   * **preferences**: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false
   * **repository**: https://github.com/mozilla/perf-automation
   * **repository path**: benchmarks/video-playback-latency
   * **repository revision**: e3d0295c15cfdd6f32e6d4270de0ed5d6c1632cd
   * **support class**: video_playback_latency.py
   * **test url**: `<http://\<host\>:\<port\>/h264_1080p.html>`__
   * **type**: pageload
   * **unit**: ms
   * **Test Task**:

   .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-video-playback-latency-mobile-chrome-m-vpl-h264**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-video-playback-latency-mobile-chrome-m-vpl-h264-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-video-playback-latency-mobile-fenix-vpl-h264**
        - ✅
        - ✅
        - ❌
        - ❌
      * - **browsertime-video-playback-latency-mobile-fenix-vpl-h264-nofis**
        - ✅
        - ✅
        - ❌
        - ❌
      * - **browsertime-video-playback-latency-mobile-geckoview-vpl-h264**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-video-playback-latency-mobile-geckoview-vpl-h264-nofis**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-android-hw-a55-14-0-aarch64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-video-playback-latency-mobile-fenix-vpl-h264**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-video-playback-latency-mobile-fenix-vpl-h264-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-video-playback-latency-mobile-geckoview-vpl-h264**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-video-playback-latency-mobile-geckoview-vpl-h264-nofis**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-video-playback-latency-firefox-vpl-h264**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-video-playback-latency-firefox-vpl-h264**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-video-playback-latency-chrome-vpl-h264**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-video-playback-latency-firefox-vpl-h264**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-video-playback-latency-firefox-vpl-h264**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-video-playback-latency-firefox-vpl-h264**
        - ✅
        - ✅
        - ❌
        - ❌
      * - **browsertime-video-playback-latency-safari-vpl-h264**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-video-playback-latency-firefox-vpl-h264**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-2009-hw-ref-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-video-playback-latency-chrome-vpl-h264**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-video-playback-latency-firefox-vpl-h264**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-2009-hw-ref/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-video-playback-latency-firefox-vpl-h264**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-video-playback-latency-firefox-vpl-h264**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-video-playback-latency-firefox-vpl-h264**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-video-playback-latency-chrome-vpl-h264**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-video-playback-latency-firefox-vpl-h264**
        - ❌
        - ❌
        - ❌
        - ❌



.. dropdown:: vpl-vp9
   :class-container: anchor-id-vpl-vp9-c

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t vpl-vp9

   **Owner**: :aosmond and the Media Team

   **Description**: Measures VP9 1080p video playback latency.

   * **alert on**: `estimatedFirstFrameLatency <raptor-metrics.html#estimated-frame-latency-(first)>`__, `estimatedAnyFrameLatency <raptor-metrics.html#estimated-frame-latency-(any)>`__
   * **alert threshold**: 2.0
   * **apps**: chrome, chrome-m, geckoview, fenix, firefox, safari
   * **benchmark webserver**: true
   * **browser cycles**: 20
   * **expected**: pass
   * **gecko profile features**: stackwalk,js,cpu,java,processcpu,screenshots,memory
   * **gecko profile interval**: 1
   * **gecko profile threads**: BackgroundThreadPool,Compositor,decoder,GeckoMain,gmp,graph,grph,InotifyEventThread,IPDL Background,media,ModuleProcessThread,PacerThread,RemVidChild,RenderBackend,Renderer,SwComposite,TextureUpdate,ImageBridgeChld
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-video-playback-latency.toml#33>`__
   * **lower is better**: true
   * **measure**: firstFrame, secondFrame, lastFrame, estimatedFirstFrameLatency, estimatedAnyFrameLatency
   * **newtab per cycle**: true
   * **page cycles**: 20
   * **page timeout**: 20000
   * **preferences**: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false
   * **repository**: https://github.com/mozilla/perf-automation
   * **repository path**: benchmarks/video-playback-latency
   * **repository revision**: e3d0295c15cfdd6f32e6d4270de0ed5d6c1632cd
   * **support class**: video_playback_latency.py
   * **test url**: `<http://\<host\>:\<port\>/vp9_1080p.html>`__
   * **type**: pageload
   * **unit**: ms
   * **Test Task**:

   .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-video-playback-latency-mobile-chrome-m-vpl-vp9**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-video-playback-latency-mobile-chrome-m-vpl-vp9-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-video-playback-latency-mobile-fenix-vpl-vp9**
        - ✅
        - ✅
        - ❌
        - ❌
      * - **browsertime-video-playback-latency-mobile-fenix-vpl-vp9-nofis**
        - ✅
        - ✅
        - ❌
        - ❌
      * - **browsertime-video-playback-latency-mobile-geckoview-vpl-vp9**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-video-playback-latency-mobile-geckoview-vpl-vp9-nofis**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-android-hw-a55-14-0-aarch64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-video-playback-latency-mobile-fenix-vpl-vp9**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-video-playback-latency-mobile-fenix-vpl-vp9-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-video-playback-latency-mobile-geckoview-vpl-vp9**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-video-playback-latency-mobile-geckoview-vpl-vp9-nofis**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-video-playback-latency-firefox-vpl-vp9**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-video-playback-latency-firefox-vpl-vp9**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-video-playback-latency-chrome-vpl-vp9**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-video-playback-latency-firefox-vpl-vp9**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-video-playback-latency-firefox-vpl-vp9**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-video-playback-latency-firefox-vpl-vp9**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-video-playback-latency-firefox-vpl-vp9**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-2009-hw-ref-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-video-playback-latency-chrome-vpl-vp9**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-video-playback-latency-firefox-vpl-vp9**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-2009-hw-ref/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-video-playback-latency-firefox-vpl-vp9**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-video-playback-latency-firefox-vpl-vp9**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-video-playback-latency-firefox-vpl-vp9**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-video-playback-latency-chrome-vpl-vp9**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-video-playback-latency-firefox-vpl-vp9**
        - ❌
        - ❌
        - ❌
        - ❌



.. dropdown:: welcome
   :class-container: anchor-id-welcome-c

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t welcome

   **Owner**: PerfTest Team

   **Description**: Measures pageload metrics for the first-install about:welcome page

   * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__
   * **alert threshold**: 2.0
   * **apps**: firefox
   * **browser cycles**: 25
   * **expected**: pass
   * **gecko profile interval**: 1
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-welcome.toml#18>`__
   * **lower is better**: true
   * **measure**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
   * **page cycles**: 25
   * **page timeout**: 60000
   * **playback**: mitmproxy
   * **playback pageset manifest**: mitm5-linux-firefox-welcome.manifest
   * **playback version**: 11.0.0
   * **support class**: browsertime_pageload.py
   * **test script**: welcome.js
   * **test url**: `<about:welcome>`__
   * **type**: pageload
   * **unit**: ms
   * **use live sites**: false
   * **Test Task**:

   .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-first-install-firefox-welcome**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-first-install-firefox-welcome**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-first-install-firefox-welcome**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-first-install-firefox-welcome**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-first-install-firefox-welcome**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-first-install-firefox-welcome**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-first-install-firefox-welcome**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-first-install-firefox-welcome**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-first-install-firefox-welcome**
        - ✅
        - ✅
        - ❌
        - ❌




Desktop
-------
Tests for page-load performance. The links direct to the actual websites that are being tested.

.. dropdown:: amazon
   :class-container: anchor-id-amazon-d

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t amazon

   **Owner**: PerfTest Team

   * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__, `largestContentfulPaint <raptor-metrics.html#largest-contentful-paint>`__
   * **alert threshold**: 2.0
   * **apps**: firefox, chrome, safari, custom-car
   * **benchmark page**: false
   * **browser cycles**: 25
   * **expected**: pass
   * **gecko profile interval**: 1
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#22>`__
   * **lower is better**: true
   * **page cycles**: 25
   * **page timeout**: 60000
   * **playback**: mitmproxy
   * **playback pageset manifest**: mitm8-linux-firefox-amazon.manifest
   * **playback version**: 11.0.0
   * **secondary url**: `<https://www.amazon.com/Acer-A515-46-R14K-Quad-Core-Processor-Backlit/dp/B08VKNVDDR/ref=sr_1_3?dchild=1&keywords=laptop&qid=1627047187&sr=8-3>`__
   * **support class**: browsertime_pageload.py
   * **test url**: `<https://www.amazon.com/s?k=laptop&ref=nb_sb_noss_1>`__
   * **type**: pageload
   * **unit**: ms
   * **use live sites**: false
   * **Test Task**:

   .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6m-chrome-m-amazon**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6m-chrome-m-amazon-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6m-cstm-car-m-amazon**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6m-cstm-car-m-amazon-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6m-fenix-amazon**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6m-fenix-amazon-nofis**
        - ✅
        - ✅
        - ❌
        - ❌
      * - **browsertime-tp6m-geckoview-amazon**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6m-geckoview-amazon-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6m-live-chrome-m-amazon**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6m-live-chrome-m-amazon-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6m-live-fenix-amazon**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6m-live-fenix-amazon-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6m-live-geckoview-amazon**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6m-live-geckoview-amazon-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6m-refbrow-amazon**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-android-hw-a55-14-0-aarch64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6m-fenix-amazon**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6m-fenix-amazon-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6m-geckoview-amazon**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6m-geckoview-amazon-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6m-live-fenix-amazon**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6m-live-fenix-amazon-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6m-live-geckoview-amazon**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6m-live-geckoview-amazon-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6m-refbrow-amazon**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-bytecode-firefox-amazon**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-essential-firefox-amazon**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-live-firefox-amazon**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-webextensions-firefox-amazon**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-bytecode-firefox-amazon**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-essential-firefox-amazon**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-live-firefox-amazon**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-webextensions-firefox-amazon**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-bytecode-firefox-amazon**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-essential-firefox-amazon**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-live-firefox-amazon**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-webextensions-firefox-amazon**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-bytecode-firefox-amazon**
        - ✅
        - ✅
        - ❌
        - ❌
      * - **browsertime-tp6-essential-chrome-amazon**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-essential-custom-car-amazon**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-essential-firefox-amazon**
        - ✅
        - ✅
        - ❌
        - ❌
      * - **browsertime-tp6-live-chrome-amazon**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-live-firefox-amazon**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-profiling-firefox-amazon**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-webextensions-firefox-amazon**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-bytecode-firefox-amazon**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-essential-firefox-amazon**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-live-firefox-amazon**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-webextensions-firefox-amazon**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-bytecode-firefox-amazon**
        - ✅
        - ✅
        - ❌
        - ❌
      * - **browsertime-tp6-essential-firefox-amazon**
        - ✅
        - ✅
        - ❌
        - ❌
      * - **browsertime-tp6-live-firefox-amazon**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-live-safari-amazon**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-profiling-firefox-amazon**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-webextensions-firefox-amazon**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-bytecode-firefox-amazon**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-essential-firefox-amazon**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-live-firefox-amazon**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-webextensions-firefox-amazon**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-bytecode-firefox-amazon**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-essential-firefox-amazon**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-live-firefox-amazon**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-webextensions-firefox-amazon**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-bytecode-firefox-amazon**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-essential-firefox-amazon**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-live-firefox-amazon**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-webextensions-firefox-amazon**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-bytecode-firefox-amazon**
        - ✅
        - ✅
        - ❌
        - ❌
      * - **browsertime-tp6-essential-chrome-amazon**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-essential-custom-car-amazon**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-essential-firefox-amazon**
        - ✅
        - ✅
        - ❌
        - ❌
      * - **browsertime-tp6-live-chrome-amazon**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-live-firefox-amazon**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-webextensions-firefox-amazon**
        - ✅
        - ✅
        - ❌
        - ❌



.. dropdown:: bing-search
   :class-container: anchor-id-bing-search-d

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t bing-search

   **Owner**: PerfTest Team

   * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__, `largestContentfulPaint <raptor-metrics.html#largest-contentful-paint>`__
   * **alert threshold**: 2.0
   * **apps**: firefox, chrome, safari, custom-car
   * **benchmark page**: true
   * **browser cycles**: 25
   * **expected**: pass
   * **gecko profile interval**: 1
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#28>`__
   * **lower is better**: true
   * **page cycles**: 25
   * **page timeout**: 60000
   * **playback**: mitmproxy
   * **playback pageset manifest**: mitm8-darwin-firefox-bing-search.manifest
   * **playback version**: 11.0.0
   * **support class**: browsertime_pageload.py
   * **test url**: `<https://www.bing.com/search?q=barack+obama>`__
   * **type**: pageload
   * **unit**: ms
   * **use live sites**: false
   * **Test Task**:

   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-bytecode-firefox-bing-search**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-essential-firefox-bing-search**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-live-firefox-bing-search**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-bytecode-firefox-bing-search**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-essential-firefox-bing-search**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-live-firefox-bing-search**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-bytecode-firefox-bing-search**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-essential-firefox-bing-search**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-live-firefox-bing-search**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-bytecode-firefox-bing-search**
        - ✅
        - ✅
        - ❌
        - ❌
      * - **browsertime-tp6-essential-chrome-bing-search**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-essential-custom-car-bing-search**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-essential-firefox-bing-search**
        - ✅
        - ✅
        - ❌
        - ❌
      * - **browsertime-tp6-live-chrome-bing-search**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-live-firefox-bing-search**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-bytecode-firefox-bing-search**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-essential-firefox-bing-search**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-live-firefox-bing-search**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-bytecode-firefox-bing-search**
        - ✅
        - ✅
        - ❌
        - ❌
      * - **browsertime-tp6-essential-firefox-bing-search**
        - ✅
        - ✅
        - ❌
        - ❌
      * - **browsertime-tp6-live-firefox-bing-search**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-live-safari-bing-search**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-bytecode-firefox-bing-search**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-essential-firefox-bing-search**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-live-firefox-bing-search**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-bytecode-firefox-bing-search**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-essential-firefox-bing-search**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-live-firefox-bing-search**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-bytecode-firefox-bing-search**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-essential-firefox-bing-search**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-live-firefox-bing-search**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-bytecode-firefox-bing-search**
        - ✅
        - ✅
        - ❌
        - ❌
      * - **browsertime-tp6-essential-chrome-bing-search**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-essential-custom-car-bing-search**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-essential-firefox-bing-search**
        - ✅
        - ✅
        - ❌
        - ❌
      * - **browsertime-tp6-live-chrome-bing-search**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-live-firefox-bing-search**
        - ❌
        - ❌
        - ❌
        - ❌



.. dropdown:: buzzfeed
   :class-container: anchor-id-buzzfeed-d

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t buzzfeed

   **Owner**: PerfTest Team

   * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__, `largestContentfulPaint <raptor-metrics.html#largest-contentful-paint>`__
   * **alert threshold**: 2.0
   * **apps**: firefox, chrome, safari, custom-car
   * **benchmark page**: false
   * **browser cycles**: 25
   * **expected**: pass
   * **gecko profile interval**: 1
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#32>`__
   * **lower is better**: true
   * **page cycles**: 25
   * **page timeout**: 60000
   * **playback**: mitmproxy
   * **playback pageset manifest**: mitm7-linux-firefox-buzzfeed.manifest
   * **playback version**: 11.0.0
   * **secondary url**: `<https://www.buzzfeed.com/quizzes>`__
   * **support class**: browsertime_pageload.py
   * **test url**: `<https://www.buzzfeed.com/>`__
   * **type**: pageload
   * **unit**: ms
   * **use live sites**: false
   * **Test Task**:

   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-firefox-buzzfeed**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-firefox-buzzfeed**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-firefox-buzzfeed**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-chrome-buzzfeed**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-custom-car-buzzfeed**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-firefox-buzzfeed**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-firefox-buzzfeed**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-firefox-buzzfeed**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-firefox-buzzfeed**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-firefox-buzzfeed**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-firefox-buzzfeed**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-chrome-buzzfeed**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-custom-car-buzzfeed**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-firefox-buzzfeed**
        - ✅
        - ✅
        - ❌
        - ❌



.. dropdown:: cnn
   :class-container: anchor-id-cnn-d

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t cnn

   **Owner**: PerfTest Team

   * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__, `largestContentfulPaint <raptor-metrics.html#largest-contentful-paint>`__
   * **alert threshold**: 2.0
   * **apps**: firefox, chrome, safari, custom-car
   * **benchmark page**: true
   * **browser cycles**: 25
   * **expected**: pass
   * **gecko profile interval**: 1
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#37>`__
   * **lower is better**: true
   * **page cycles**: 25
   * **page timeout**: 60000
   * **playback**: mitmproxy
   * **playback pageset manifest**: mitm8-linux-firefox-cnn.manifest
   * **playback version**: 11.0.0
   * **secondary url**: `<https://www.cnn.com/weather>`__
   * **support class**: browsertime_pageload.py
   * **test url**: `<https://www.cnn.com/2021/03/22/weather/climate-change-warm-waters-lake-michigan/index.html>`__
   * **type**: pageload
   * **unit**: ms
   * **use live sites**: false
   * **Test Task**:

   .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6m-chrome-m-cnn**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6m-chrome-m-cnn-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6m-cstm-car-m-cnn**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6m-cstm-car-m-cnn-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6m-fenix-cnn**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6m-fenix-cnn-nofis**
        - ✅
        - ✅
        - ❌
        - ❌
      * - **browsertime-tp6m-geckoview-cnn**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6m-geckoview-cnn-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6m-live-chrome-m-cnn**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6m-live-chrome-m-cnn-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6m-live-fenix-cnn**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6m-live-fenix-cnn-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6m-live-geckoview-cnn**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6m-live-geckoview-cnn-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6m-refbrow-cnn**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-android-hw-a55-14-0-aarch64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6m-fenix-cnn**
        - ✅
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6m-fenix-cnn-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6m-geckoview-cnn**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6m-geckoview-cnn-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6m-live-fenix-cnn**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6m-live-fenix-cnn-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6m-live-geckoview-cnn**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6m-live-geckoview-cnn-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6m-refbrow-cnn**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-bytecode-firefox-cnn**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-essential-firefox-cnn**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-live-sheriffed-firefox-cnn**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-bytecode-firefox-cnn**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-essential-firefox-cnn**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-live-sheriffed-firefox-cnn**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-bytecode-firefox-cnn**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-essential-firefox-cnn**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-live-sheriffed-firefox-cnn**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-bytecode-firefox-cnn**
        - ✅
        - ✅
        - ❌
        - ❌
      * - **browsertime-tp6-essential-chrome-cnn**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-essential-custom-car-cnn**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-essential-firefox-cnn**
        - ✅
        - ✅
        - ❌
        - ❌
      * - **browsertime-tp6-live-sheriffed-firefox-cnn**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-bytecode-firefox-cnn**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-essential-firefox-cnn**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-live-sheriffed-firefox-cnn**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-bytecode-firefox-cnn**
        - ✅
        - ✅
        - ❌
        - ❌
      * - **browsertime-tp6-essential-firefox-cnn**
        - ✅
        - ✅
        - ❌
        - ❌
      * - **browsertime-tp6-live-sheriffed-firefox-cnn**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-bytecode-firefox-cnn**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-essential-firefox-cnn**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-live-sheriffed-firefox-cnn**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-bytecode-firefox-cnn**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-essential-firefox-cnn**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-live-sheriffed-firefox-cnn**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-bytecode-firefox-cnn**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-essential-firefox-cnn**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-live-sheriffed-firefox-cnn**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-bytecode-firefox-cnn**
        - ✅
        - ✅
        - ❌
        - ❌
      * - **browsertime-tp6-essential-chrome-cnn**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-essential-custom-car-cnn**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-essential-firefox-cnn**
        - ✅
        - ✅
        - ❌
        - ❌
      * - **browsertime-tp6-live-sheriffed-firefox-cnn**
        - ❌
        - ❌
        - ❌
        - ❌



.. dropdown:: docomo
   :class-container: anchor-id-docomo-d

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t docomo

   **Owner**: PerfTest Team

   * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__, `largestContentfulPaint <raptor-metrics.html#largest-contentful-paint>`__
   * **alert threshold**: 2.0
   * **apps**: firefox, chrome
   * **benchmark page**: false
   * **browser cycles**: 25
   * **expected**: pass
   * **gecko profile interval**: 1
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp7/desktop/browsertime-tp7.toml#23>`__
   * **lower is better**: true
   * **page cycles**: 25
   * **page timeout**: 60000
   * **playback**: mitmproxy
   * **playback pageset manifest**: mitm8-linux-firefox-docomo.manifest
   * **playback version**: 11.0.0
   * **secondary url**: `<https://www.docomo.ne.jp/iphone/?icid=CRP_menu_to_CRP_IPH>`__
   * **support class**: browsertime_pageload.py
   * **test url**: `<https://www.docomo.ne.jp/>`__
   * **type**: pageload
   * **unit**: ms
   * **use live sites**: false
   * **Test Task**:

   .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp7-firefox-docomo**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp7-firefox-docomo**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp7-chrome-docomo**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp7-firefox-docomo**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp7-firefox-docomo**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp7-firefox-docomo**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp7-firefox-docomo**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp7-firefox-docomo**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp7-firefox-docomo**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp7-chrome-docomo**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp7-firefox-docomo**
        - ❌
        - ❌
        - ❌
        - ❌



.. dropdown:: ebay
   :class-container: anchor-id-ebay-d

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t ebay

   **Owner**: PerfTest Team

   * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__, `largestContentfulPaint <raptor-metrics.html#largest-contentful-paint>`__
   * **alert threshold**: 2.0
   * **apps**: firefox, chrome, safari, custom-car
   * **benchmark page**: true
   * **browser cycles**: 25
   * **expected**: pass
   * **gecko profile interval**: 1
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#42>`__
   * **lower is better**: true
   * **page cycles**: 25
   * **page timeout**: 60000
   * **playback**: mitmproxy
   * **playback pageset manifest**: mitm8-linux-firefox-ebay.manifest
   * **playback version**: 11.0.0
   * **secondary url**: `<https://www.ebay.com/deals>`__
   * **support class**: browsertime_pageload.py
   * **test url**: `<https://www.ebay.com/>`__
   * **type**: pageload
   * **unit**: ms
   * **use live sites**: false
   * **Test Task**:

   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-firefox-ebay**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-live-firefox-ebay**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-firefox-ebay**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-live-firefox-ebay**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-firefox-ebay**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-live-firefox-ebay**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-chrome-ebay**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-custom-car-ebay**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-firefox-ebay**
        - ✅
        - ✅
        - ❌
        - ❌
      * - **browsertime-tp6-live-chrome-ebay**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-live-firefox-ebay**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-firefox-ebay**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-live-firefox-ebay**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-firefox-ebay**
        - ✅
        - ✅
        - ❌
        - ❌
      * - **browsertime-tp6-live-firefox-ebay**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-live-safari-ebay**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-firefox-ebay**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-live-firefox-ebay**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-firefox-ebay**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-live-firefox-ebay**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-firefox-ebay**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-live-firefox-ebay**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-chrome-ebay**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-custom-car-ebay**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-firefox-ebay**
        - ✅
        - ✅
        - ❌
        - ❌
      * - **browsertime-tp6-live-chrome-ebay**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-live-firefox-ebay**
        - ❌
        - ❌
        - ❌
        - ❌



.. dropdown:: espn
   :class-container: anchor-id-espn-d

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t espn

   **Owner**: PerfTest Team

   * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__, `largestContentfulPaint <raptor-metrics.html#largest-contentful-paint>`__
   * **alert threshold**: 2.0
   * **apps**: firefox, chrome, safari, custom-car
   * **benchmark page**: false
   * **browser cycles**: 25
   * **expected**: pass
   * **gecko profile interval**: 1
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#47>`__
   * **lower is better**: true
   * **page cycles**: 25
   * **page timeout**: 60000
   * **playback**: mitmproxy
   * **playback pageset manifest**: mitm7-linux-firefox-espn.manifest
   * **playback version**: 11.0.0
   * **secondary url**: `<https://www.espn.com/nba/draft/news>`__
   * **support class**: browsertime_pageload.py
   * **test url**: `<http://www.espn.com/nba/story/_/page/allstarweekend25788027/the-comparison-lebron-james-michael-jordan-their-own-words>`__
   * **type**: pageload
   * **unit**: ms
   * **use live sites**: false
   * **Test Task**:

   .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6m-essential-chrome-m-espn**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6m-essential-chrome-m-espn-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6m-essential-cstm-car-m-espn**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6m-essential-cstm-car-m-espn-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6m-essential-fenix-espn**
        - ✅
        - ✅
        - ❌
        - ❌
      * - **browsertime-tp6m-essential-fenix-espn-nofis**
        - ✅
        - ✅
        - ❌
        - ❌
      * - **browsertime-tp6m-essential-geckoview-espn**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6m-essential-geckoview-espn-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6m-essential-refbrow-espn**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6m-live-chrome-m-espn**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6m-live-chrome-m-espn-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6m-live-fenix-espn**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6m-live-fenix-espn-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6m-live-geckoview-espn**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6m-live-geckoview-espn-nofis**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-android-hw-a55-14-0-aarch64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6m-essential-fenix-espn**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6m-essential-fenix-espn-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6m-essential-geckoview-espn**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6m-essential-geckoview-espn-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6m-essential-refbrow-espn**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6m-live-fenix-espn**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6m-live-fenix-espn-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6m-live-geckoview-espn**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6m-live-geckoview-espn-nofis**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-firefox-espn**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-firefox-espn**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-firefox-espn**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-chrome-espn**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-custom-car-espn**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-firefox-espn**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-firefox-espn**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-firefox-espn**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-firefox-espn**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-firefox-espn**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-firefox-espn**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-chrome-espn**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-custom-car-espn**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-firefox-espn**
        - ✅
        - ✅
        - ❌
        - ❌



.. dropdown:: expedia
   :class-container: anchor-id-expedia-d

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t expedia

   **Owner**: PerfTest Team

   * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__, `largestContentfulPaint <raptor-metrics.html#largest-contentful-paint>`__
   * **alert threshold**: 2.0
   * **apps**: firefox, chrome, safari, custom-car
   * **benchmark page**: true
   * **browser cycles**: 25
   * **expected**: pass
   * **gecko profile interval**: 1
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#52>`__
   * **lower is better**: true
   * **page cycles**: 25
   * **page timeout**: 60000
   * **playback**: mitmproxy
   * **playback pageset manifest**: mitm8-darwin-firefox-expedia.manifest
   * **playback version**: 11.0.0
   * **secondary url**: `<https://groups.expedia.com/Group-Rate/?locale=en_US&ol=1>`__
   * **support class**: browsertime_pageload.py
   * **test url**: `<https://expedia.com/Hotel-Search?destination=New+York%2C+New+York&latLong=40.756680%2C-73.986470&regionId=178293&startDate=&endDate=&rooms=1&_xpid=11905%7C1&adults=2>`__
   * **type**: pageload
   * **unit**: ms
   * **use live sites**: false
   * **Test Task**:

   .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6m-live-chrome-m-expedia**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6m-live-chrome-m-expedia-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6m-live-fenix-expedia**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6m-live-fenix-expedia-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6m-live-geckoview-expedia**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6m-live-geckoview-expedia-nofis**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-android-hw-a55-14-0-aarch64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6m-live-fenix-expedia**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6m-live-fenix-expedia-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6m-live-geckoview-expedia**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6m-live-geckoview-expedia-nofis**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-firefox-expedia**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-firefox-expedia**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-firefox-expedia**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-chrome-expedia**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-custom-car-expedia**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-firefox-expedia**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-firefox-expedia**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-firefox-expedia**
        - ✅
        - ✅
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-firefox-expedia**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-firefox-expedia**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-firefox-expedia**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-chrome-expedia**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-custom-car-expedia**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-firefox-expedia**
        - ✅
        - ✅
        - ❌
        - ❌



.. dropdown:: facebook
   :class-container: anchor-id-facebook-d

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t facebook

   **Owner**: PerfTest Team

   * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__, `largestContentfulPaint <raptor-metrics.html#largest-contentful-paint>`__
   * **alert threshold**: 2.0
   * **apps**: firefox, chrome, safari, custom-car
   * **benchmark page**: true
   * **browser cycles**: 25
   * **expected**: pass
   * **gecko profile interval**: 1
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#57>`__
   * **lower is better**: true
   * **page cycles**: 25
   * **page timeout**: 60000
   * **playback**: mitmproxy
   * **playback pageset manifest**: mitm6-linux-firefox-facebook.manifest
   * **playback version**: 8.1.1
   * **secondary url**: `<https://www.facebook.com/marketplace/?ref=bookmark>`__
   * **support class**: browsertime_pageload.py
   * **test url**: `<https://www.facebook.com>`__
   * **type**: pageload
   * **unit**: ms
   * **use live sites**: false
   * **Test Task**:

   .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6m-live-chrome-m-facebook**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6m-live-chrome-m-facebook-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6m-live-fenix-facebook**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6m-live-fenix-facebook-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6m-live-geckoview-facebook**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6m-live-geckoview-facebook-nofis**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-android-hw-a55-14-0-aarch64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6m-live-fenix-facebook**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6m-live-fenix-facebook-nofis**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6m-live-geckoview-facebook**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6m-live-geckoview-facebook-nofis**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-firefox-facebook**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-live-firefox-facebook**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-firefox-facebook**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-live-firefox-facebook**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-firefox-facebook**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-live-firefox-facebook**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-chrome-facebook**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-custom-car-facebook**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-firefox-facebook**
        - ✅
        - ✅
        - ❌
        - ❌
      * - **browsertime-tp6-live-chrome-facebook**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-live-firefox-facebook**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-firefox-facebook**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-live-firefox-facebook**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64-shippable/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-firefox-facebook**
        - ✅
        - ✅
        - ❌
        - ❌
      * - **browsertime-tp6-live-firefox-facebook**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-macosx1470-64/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-firefox-facebook**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-live-firefox-facebook**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-firefox-facebook**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-live-firefox-facebook**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-firefox-facebook**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-live-firefox-facebook**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-windows11-64-shippable-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-chrome-facebook**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-custom-car-facebook**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-firefox-facebook**
        - ✅
        - ✅
        - ❌
        - ❌
      * - **browsertime-tp6-live-chrome-facebook**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-live-firefox-facebook**
        - ❌
        - ❌
        - ❌
        - ❌



.. dropdown:: fandom
   :class-container: anchor-id-fandom-d

   * Command to Run Locally

   .. code-block::

      ./mach raptor -t fandom

   **Owner**: PerfTest Team

   * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__, `largestContentfulPaint <raptor-metrics.html#largest-contentful-paint>`__
   * **alert threshold**: 2.0
   * **apps**: firefox, chrome, safari, custom-car
   * **benchmark page**: false
   * **browser cycles**: 25
   * **expected**: pass
   * **gecko profile interval**: 1
   * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#63>`__
   * **lower is better**: true
   * **page cycles**: 25
   * **page timeout**: 60000
   * **playback**: mitmproxy
   * **playback pageset manifest**: mitm5-linux-firefox-fandom.manifest
   * **playback version**: 11.0.0
   * **support class**: browsertime_pageload.py
   * **test url**: `<https://www.fandom.com/articles/fallout-76-will-live-and-die-on-the-creativity-of-its-playerbase>`__
   * **type**: pageload
   * **unit**: ms
   * **use live sites**: false
   * **Test Task**:

   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-bytecode-firefox-fandom**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-essential-firefox-fandom**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-live-firefox-fandom**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-bytecode-firefox-fandom**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-essential-firefox-fandom**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-live-firefox-fandom**
        - ❌
        - ❌
        - ❌
        - ❌


   .. list-table:: **test-linux1804-64-qr/opt**
      :widths: 30 15 15 15 15
      :header-rows: 1

      * - **Test Name**
        - mozilla-central
        - autoland
        - mozilla-release
        - mozilla-beta
      * - **browsertime-tp6-bytecode-firefox-fandom**
        - ❌
        - ❌
        - ❌
        - ❌
      * - **browsertime-tp6-essential-firefox-fandom**
        - ❌
        - ❌
        - ❌
        - ❌
--> --------------------

--> maximum size reached

--> --------------------