[llama-mm] Onboard Llama3.2 mm vision encoder

[larryliu0820]

Stack from ghstack (oldest at bottom):

• -> [llama-mm] Onboard Llama3.2 mm vision encoder #6653
• [llama-mm] Add export-friendly tile position embedding #6650

Summary: Add llama3.2 mm vision encoder to examples/models.

We need to do a module swapping for TilePositionEmbedding to make sure
vision encoder is exportable.

Test Plan: Unit tests.

Reviewers:

Subscribers:

Tasks:

Tags:

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/6653

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❗ 1 Active SEVs

There are 1 currently active SEVs. If your PR is affected, please view them below:

• GLIBC not found in Nova workflows

❌ 7 New Failures

As of commit c533944 with merge base 3a1f8d2 ():

NEW FAILURES - The following jobs have failed:

• Propose to merge ghstack orig PRs to main / Try to create a PR with ghstack /orig branch (gh)
  github.GithubException.GithubException: 404 {"message": "Branch not found", "documentation_url": "https://docs.github.com/rest/branches/branches#get-a-branch", "status": "404"}
• pull / test-binary-size-linux-gcc / linux-job (gh)
  RuntimeError: Command docker exec -t a6219dc9053c9f0abd401b8bfd484a66a0a8fd3062b2d5aa616ba8a6c95923d5 /exec failed with exit code 1
• pull / unittest / linux / linux-job (gh)
  RuntimeError: Command docker exec -t 8512ac2daf656325bdc8ff8fd51057bb2b185c80cbde6b64c58d631edca46896 /exec failed with exit code 5
• pull / unittest / macos / macos-job (gh)
  RuntimeError: Command bash /Users/ec2-user/runner/_work/_temp/exec_script failed with exit code 5
• pull / unittest-arm / linux-job (gh)
  RuntimeError: Command docker exec -t 7456a16a3f586a2e5c6126ef3f1043326a9f3632602ba9649373186d642b06b4 /exec failed with exit code 1
• trunk / test-arm-backend-delegation / linux-job (gh)
  RuntimeError: Command docker exec -t a7f687f0147dafeda34c2fe85fce86920e7a37ce6aef637278d7178b4eb5f160 /exec failed with exit code 1
• trunk / test-arm-reference-delegation / linux-job (gh)
  RuntimeError: Command docker exec -t 5d4b07b5049f2ee56e3c97a1ccf18af827393e6bbeba82003d63d955361e52db /exec failed with exit code 1

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[tarun292]

Need to change to:

from torchtune.models.llama3_2_vision._component_builders import llama3_2_vision_encoder

[larryliu0820]

Close in favor of #6831