-
Notifications
You must be signed in to change notification settings - Fork 3.5k
Description
Describe the issue
Hi! CoreML execution provider fails during inference with the Parakeet CTC ASR model. Model loads successfully but fails when running inference.
Non-zero status code returned while running 12615810092392341640_CoreML_12615810092392341640_3 node. Name:'CoreMLExecutionProvider_12615810092392341640_CoreML_12615810092392341640_3_3' Status Message: Error executing model:Unable to compute the prediction using a neural network model. It can be an invalid input data or broken/unsupported model (error code: -1).
env
- OS: macOS (Apple Silicon M3)
- ort: 2.0.0-rc.10 (rust binding: https://github.com/pykeio/ort)
- Model: https://huggingface.co/onnx-community/parakeet-ctc-0.6b-ONNX
- ep code: https://github.com/altunenes/parakeet-rs/blob/master/src/execution.rs
Is this a known limitation with CoreML? Are there specific ONNX operations in this model that CoreML doesn't support?
To reproduce
- Download model files from HuggingFace: https://huggingface.co/onnx-community/parakeet-ctc-0.6b-ONNX/tree/main/onnx
- model.onnx
- model.onnx_data
- tokenizer.json - Clone repo:
git clone https://github.com/altunenes/parakeet-rs.git
cd parakeet-rs - Download test audio:
wget https://github.com/thewh1teagle/pyannote-rs/releases/download/v0.1.0/6_speakers.wav - Run a simple example via CoreML:
cargo run --example transcribe 6_speakers.wav --features coreml
Urgency
No response
Platform
Mac
OS Version
15.6.1
ONNX Runtime Installation
Built from Source
ONNX Runtime Version or Commit ID
https://github.com/pykeio/ort/releases/tag/v2.0.0-rc.10
ONNX Runtime API
Other / Unknown
Architecture
ARM64
Execution Provider
CoreML
Execution Provider Library Version
No response
note: CoreML loads fine - it just can't execute the specific operations in this model. :(