Skip to content

Conversation

@baominghelly
Copy link
Collaborator

Description

fix: output result file to folder && add error info in log

Test evidence

Code check

pre-commit run --all-files
[INFO] Initializing environment for https://github.com/psf/black.
[INFO] Initializing environment for https://github.com/pycqa/flake8.
[INFO] Installing environment for https://github.com/psf/black.
[INFO] Once installed this environment will be reused.
[INFO] This may take a few minutes...
[INFO] Installing environment for https://github.com/pycqa/flake8.
[INFO] Once installed this environment will be reused.
[INFO] This may take a few minutes...
black....................................................................Passed
flake8...................................................................Passed

Run test

./scripts/run_tests.sh format_input_*
==========================================
InfiniMetrics Test Runner
==========================================

Environment: INFINI_ROOT=/home/baoming/.infini


==========================================
Running: InfiniMetrics
Time: 20260211_105842
==========================================
Running 2 input path(s):
  - format_input_comprehensive.json
  - format_input_matmul.json

2026-02-11 10:58:42,419 - infinimetrics.utils.input_loader - INFO - Loaded 1 input(s) from format_input_comprehensive.json
2026-02-11 10:58:42,420 - infinimetrics.utils.input_loader - INFO - Loaded 1 input(s) from format_input_matmul.json
2026-02-11 10:58:42,420 - infinimetrics.dispatcher - INFO - Processing 2 valid inputs (skipped 0 invalid)
2026-02-11 10:58:43,985 - infinimetrics.dispatcher - INFO - Validation complete: 2 valid, 0 skipped
2026-02-11 10:58:43,985 - infinimetrics.dispatcher - INFO - [1/2] Executing hardware.cudaUnified.Comprehensive
2026-02-11 10:58:43,985 - infinimetrics.executor - INFO - Executor: Running hardware.cudaUnified.Comprehensive
2026-02-11 10:58:43,985 - infinimetrics.hardware.hardware_adapter - INFO - HardwareTestAdapter: Processing hardware.cudaUnified.Comprehensive
2026-02-11 10:58:43,985 - infinimetrics.hardware.hardware_adapter - INFO - GPU mode (device=nvidia): Executing CUDA tests
2026-02-11 10:58:43,985 - infinimetrics.hardware.hardware_adapter - INFO - Executing: /home/baoming/workplace/InfiniMetrics/infinimetrics/hardware/cuda-memory-benchmark/build/cuda_perf_suite --all --array-size 67108864
2026-02-11 11:04:38,120 - infinimetrics.common.csv_utils - INFO - CSV saved: output/mem_sweep_h2d_hardware.cudaUnified.Comprehensive.fadfsdf_20260211_110438.csv
2026-02-11 11:04:38,121 - infinimetrics.common.csv_utils - INFO - CSV saved: output/mem_sweep_d2h_hardware.cudaUnified.Comprehensive.fadfsdf_20260211_110438.csv
2026-02-11 11:04:38,122 - infinimetrics.common.csv_utils - INFO - CSV saved: output/mem_sweep_d2d_hardware.cudaUnified.Comprehensive.fadfsdf_20260211_110438.csv
2026-02-11 11:04:38,122 - infinimetrics.common.csv_utils - INFO - CSV saved: output/mem_sweep_bidirectional_hardware.cudaUnified.Comprehensive.fadfsdf_20260211_110438.csv
2026-02-11 11:04:38,123 - infinimetrics.common.csv_utils - INFO - CSV saved: output/cache_l1_bandwidth_hardware.cudaUnified.Comprehensive.fadfsdf_20260211_110438.csv
2026-02-11 11:04:38,124 - infinimetrics.common.csv_utils - INFO - CSV saved: output/cache_l2_bandwidth_hardware.cudaUnified.Comprehensive.fadfsdf_20260211_110438.csv
2026-02-11 11:04:38,342 - infinimetrics.executor - INFO - Executor: hardware.cudaUnified.Comprehensive completed with code=0
2026-02-11 11:04:38,342 - infinimetrics.dispatcher - INFO - [2/2] Executing operator.InfiniCore.Matmul.Performance
2026-02-11 11:04:38,343 - infinimetrics.executor - INFO - Executor: Running operator.InfiniCore.Matmul.Performance
2026-02-11 11:04:38,343 - infinimetrics.operators.infinicore_adapter - INFO - InfiniCoreAdapter: Processing operator.InfiniCore.Matmul.Performance
🚀 Mode: Dynamic Execution
InfiniCore Operator Test Runner
Directory: Dynamic (1 cases)
Tests found: 1

✅  test_Matmul_0: PASSED (code: 0)

============================================================
Testing Matmul on NVIDIA
============================================================
TestCase(Auto-Gen: Matmul - inputs=[in_0: tensor(2048, 2048), float16; in_1: tensor(2048, 2048), float16], kwargs={out=output: tensor(2048, 2048), float16})
    PyTorch    time - Host: 0.288413 ms, Device: 0.368208 ms
    InfiniCore time - Host: 0.288560 ms, Device: 0.286652 ms
✓ Passed

============================================================
TEST SUMMARY
Total tests: 1
Passed: 1
Success rate: 100.0%

All tests passed!
------------------------------------------------------------
BENCHMARK SUMMARY
PyTorch Host Total Time: 28.841 ms
PyTorch Device Total Time: 36.821 ms
InfiniCore Host Total Time: 28.856 ms
InfiniCore Device Total Time: 28.665 ms
Host Speedup (PyTorch/InfiniCore): 1.00x
Device Speedup (PyTorch/InfiniCore): 1.28x
============================================================
💾 Saving to: test_report_20260211_110438_942.json
   ✅ Saved.
----------------------------------------

================================================================================
CUMULATIVE TEST SUMMARY
================================================================================
Total tests run: 1
Passed: 1
Failed: 0
----------------------------------------
BENCHMARK SUMMARY (1 cases):
----------------------------------------

✅ PASSED OPERATORS (1):
  test_Matmul_0

Success rate: 100.0%

🎉 All tests passed!
2026-02-11 11:04:39,347 - infinimetrics.executor - INFO - Executor: operator.InfiniCore.Matmul.Performance completed with code=0
2026-02-11 11:04:39,347 - infinimetrics.dispatcher - INFO - Summary saved to summary_output/dispatcher_summary_20260211_110439.json

============================================================
Test Summary
============================================================
Total tests:   2
Successful:    2
Failed:        0
Success rate:  100.0%
============================================================


==========================================
[OK] Test completed: InfiniMetrics
Time: 20260211_110440
==========================================

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant