Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Preprocess for rnnt doesn't work (NVIDIA) #10

Open
mahmoodn opened this issue Jun 26, 2024 · 0 comments
Open

Preprocess for rnnt doesn't work (NVIDIA) #10

mahmoodn opened this issue Jun 26, 2024 · 0 comments

Comments

@mahmoodn
Copy link

Similar to this issue, the preprocess for rnnt doesn't work due to an error with make clone_loadgen.

(mlperf) mahmood@mlperf-inference-mahmood-x86-64-29597:/work$ make preprocess_data BENCHMARKS="rnnt"
/usr/local/lib/python3.8/dist-packages/torchvision/io/image.py:13: UserWarning: Failed to load image Python extension: ''If you don't plan on using image functionality from `torchvision.io`, you can ignore this warning. Otherwise, there might be something wrong with your environment. Did you have `libjpeg` or `libpng` installed before building `torchvision` from source?
  warn(
[2024-06-26 08:24:19,927 preprocess_data.py:49 INFO] Updating reference repo for convert_librispeech.py script...
[2024-06-26 08:24:19,927 __init__.py:46 INFO] Running command: make clone_loadgen
make[1]: Entering directory '/work'
Cloning Official MLPerf Inference (For Loadgen Files)
fatal: destination path '/work/build/inference' already exists and is not an empty directory.
make[1]: *** [/work/Makefile.build:194: clone_loadgen] Error 128
make[1]: Leaving directory '/work'
Traceback (most recent call last):
  File "/usr/lib/python3.8/runpy.py", line 194, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "/usr/lib/python3.8/runpy.py", line 87, in _run_code
    exec(code, run_globals)
  File "/work/code/rnnt/tensorrt/preprocess_data.py", line 189, in <module>
    main()
  File "/work/code/rnnt/tensorrt/preprocess_data.py", line 183, in main
    preprocess_rnnt(data_dir, preprocessed_data_dir)
  File "/work/code/rnnt/tensorrt/preprocess_data.py", line 50, in preprocess_rnnt
    run_command("make clone_loadgen")
  File "/work/code/common/__init__.py", line 48, in run_command
    return subprocess.check_call(cmd, shell=True)
  File "/usr/lib/python3.8/subprocess.py", line 364, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command 'make clone_loadgen' returned non-zero exit status 2.
make: *** [/work/Makefile.data:36: preprocess_data] Error 1

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant