LLaVA example fails with error

[hannakoepcke]

🐛 Describe the bug

Following https://github.com/pytorch/executorch/blob/main/examples/models/llava/README.md I execute
python -m executorch.examples.models.llava.export_llava --pte-name llava.pte --with-artifacts --no-use-sdpa-with-kv-cache
and get the following error

Traceback (most recent call last): File "/home/ec2-user/anaconda3/envs/executorch/lib/python3.10/runpy.py", line 196, in _run_module_as_main return _run_code(code, main_globals, None, File "/home/ec2-user/anaconda3/envs/executorch/lib/python3.10/runpy.py", line 86, in _run_code exec(code, run_globals) File "/home/ec2-user/executorch/examples/models/llava/export_llava.py", line 327, in <module> main() File "/home/ec2-user/executorch/examples/models/llava/export_llava.py", line 305, in main executorch_program = export_all(llava_model) File "/home/ec2-user/executorch/examples/models/llava/export_llava.py", line 230, in export_all executorch_program = lowered_and_edge.to_executorch( File "/home/ec2-user/executorch/exir/program/_program.py", line 1357, in to_executorch return ExecutorchProgramManager( File "/home/ec2-user/executorch/exir/program/_program.py", line 1411, in __init__ self._pte_data: Cord = _serialize_pte_binary( File "/home/ec2-user/executorch/exir/_serialize/_program.py", line 445, in serialize_pte_binary result: _FlatbufferResult = _program_json_to_flatbuffer( File "/home/ec2-user/executorch/exir/_serialize/_flatbuffer.py", line 277, in _program_json_to_flatbuffer schema_info = _prepare_schema( File "/home/ec2-user/executorch/exir/_serialize/_flatbuffer.py", line 148, in _prepare_schema schemas = _ResourceFiles([program_schema] + deps) File "/home/ec2-user/executorch/exir/_serialize/_flatbuffer.py", line 105, in __init__ self._files[name] = importlib.resources.read_binary(__package__, name) File "/home/ec2-user/anaconda3/envs/executorch/lib/python3.10/importlib/resources.py", line 88, in read_binary with open_binary(package, resource) as fp: File "/home/ec2-user/anaconda3/envs/executorch/lib/python3.10/importlib/resources.py", line 46, in open_binary return reader.open_resource(resource) File "/home/ec2-user/anaconda3/envs/executorch/lib/python3.10/importlib/abc.py", line 433, in open_resource return self.files().joinpath(resource).open('rb') File "/home/ec2-user/anaconda3/envs/executorch/lib/python3.10/pathlib.py", line 1117, in open return self._accessor.open(self, mode, buffering, encoding, errors, FileNotFoundError: [Errno 2] No such file or directory: '/home/ec2-user/executorch/exir/_serialize/program.fbs'

Versions

PyTorch version: 2.5.0+cpu
Is debug build: False
CUDA used to build PyTorch: None
ROCM used to build PyTorch: N/A

OS: Amazon Linux 2023.6.20241010 (x86_64)
GCC version: (GCC) 11.4.1 20230605 (Red Hat 11.4.1-2)
Clang version: Could not collect
CMake version: version 3.30.5
Libc version: glibc-2.34

Python version: 3.10.0 (default, Mar 3 2022, 09:58:08) [GCC 7.5.0] (64-bit runtime)
Python platform: Linux-6.1.112-122.189.amzn2023.x86_64-x86_64-with-glibc2.34
Is CUDA available: False
CUDA runtime version: No CUDA
CUDA_MODULE_LOADING set to: N/A
GPU models and configuration: No CUDA
Nvidia driver version: No CUDA
cuDNN version: No CUDA
HIP runtime version: N/A
MIOpen runtime version: N/A
Is XNNPACK available: True

CPU:
Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Address sizes: 46 bits physical, 48 bits virtual
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: GenuineIntel
Model name: Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
CPU family: 6
Model: 62
Thread(s) per core: 2
Core(s) per socket: 8
Socket(s): 1
Stepping: 4
BogoMIPS: 4985.99
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx rdtscp lm constant_tsc rep_good nopl xtopology cpuid tsc_known_freq pni pclmulqdq ssse3 cx16 pcid sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm pti fsgsbase smep erms xsaveopt
Hypervisor vendor: Xen
Virtualization type: full
L1d cache: 256 KiB (8 instances)
L1i cache: 256 KiB (8 instances)
L2 cache: 2 MiB (8 instances)
L3 cache: 25 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Itlb multihit: KVM: Mitigation: VMX unsupported
Vulnerability L1tf: Mitigation; PTE Inversion
Vulnerability Mds: Vulnerable: Clear CPU buffers attempted, no microcode; SMT Host state unknown
Vulnerability Meltdown: Mitigation; PTI
Vulnerability Mmio stale data: Unknown: No mitigations
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Vulnerable
Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2: Mitigation; Retpolines; STIBP disabled; RSB filling; PBRSB-eIBRS Not affected; BHI Retpoline
Vulnerability Srbds: Not affected
Vulnerability Tsx async abort: Not affected

Versions of relevant libraries:
[pip3] executorch==0.4.0a0+6a085ff
[pip3] numpy==1.21.3
[pip3] torch==2.5.0+cpu
[pip3] torchao==0.6.1
[pip3] torchaudio==2.5.0+cpu
[pip3] torchsr==1.0.4
[pip3] torchvision==0.20.0+cpu
[conda] executorch 0.4.0a0+6a085ff pypi_0 pypi
[conda] numpy 1.21.3 pypi_0 pypi
[conda] torch 2.5.0+cpu pypi_0 pypi
[conda] torchao 0.6.1 pypi_0 pypi
[conda] torchaudio 2.5.0+cpu pypi_0 pypi
[conda] torchsr 1.0.4 pypi_0 pypi
[conda] torchvision 0.20.0+cpu pypi_0 pypi

[JacobSzwejbka]

@larryliu0820 @dbort Can you take a look? Seems like a flatbuffer issue