Project

General

Profile

Actions
Copy link

Task #18

open

Test existing Automotive benchmarks

Added by Anandhu Sooraj about 2 months ago. Updated about 2 months ago.

Status:
New
Priority:
High
Assignee:
Anandhu Sooraj
Start date:
03/08/2026
Due date:
03/21/2026 (40 days late)
% Done:

0%

Estimated time:
(Total: 0:00 h)

Description

There might be some broken things in the pre existing automotive reference benchmarks and mostly the compliance tests being missing. We need to test the implementation along with the submission checker.

Subtasks 11 (11 open — 0 closed)

Task #19: Verify the benchmark run state of BevfromerNewAnandhu Sooraj03/08/202603/18/2026

Actions
Task #20: Verify the benchmark run state of SSD resnet50New03/08/202603/18/2026

Actions
Task #21: Verify the benchmark run state of deeplabv3+NewAnandhu Sooraj03/08/202603/18/2026

Actions
Task #22: Add compliance test for BevformerNewAnandhu Sooraj03/08/202603/18/2026

Actions
Task #23: Add compliance test for Deeblabv3+NewAnandhu Sooraj03/08/202603/18/2026

Actions
Task #24: Add compliance test for SSD Resnet50NewAnandhu Sooraj03/08/202603/18/2026

Actions
Task #25: Get valid results for all the pre existing benchmarksNewAnandhu Sooraj03/08/202603/18/2026

Actions
Task #26: Verify the submission checker for pre existing benchmarksNewAnandhu Sooraj03/08/202603/18/2026

Actions
Task #27: Upload the valid results as test conditions to seperate branch in automotive repoNewAnandhu Sooraj03/08/202603/21/2026

Actions
Task #28: Modify the submission checker GitHub action to take the newly uploaded resultsNewAnandhu Sooraj03/08/202603/21/2026

Actions
Task #29: Update the documentation for automotiveNewAnandhu Sooraj03/08/202603/21/2026

Actions
Actions
Copy link

Also available in: Atom PDF