Remove overridden prefill API declaration in llava_runner.h

[kirklandsign]

Already in extension/llm/runner/multimodal_runner.h

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/5149

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❗ 1 Active SEVs

There are 1 currently active SEVs. If your PR is affected, please view them below:

• [DomainsOnly] Jobs fail with GLIBC version not found

✅ No Failures

As of commit b45df8a with merge base 96a9d35 ():
💚 Looks good so far! There are no failures yet. 💚

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[larryliu0820]

You can delete these apis since they are in the base class

[kirklandsign]

Probably everything

executorch/examples/models/llava/runner/llava_runner.h

Lines 31 to 52 in f9764dc

	bool is_loaded();
	Error load();
	Error generate(
	std::vector<Image> images,
	const std::string& prompt,
	int32_t seq_len = 1024,
	std::function<void(const std::string&)> token_callback = {},
	std::function<void(const ::executorch::extension::llm::Stats&)>
	stats_callback = {});
	Error prefill_images(std::vector<Image>& images, int64_t& start_pos);
	Result<uint64_t> prefill_prompt(
	const std::string& prompt,
	int64_t& start_pos,
	int8_t bos = 0,
	int8_t eos = 0);
	Error generate_from_pos(
	const std::string& prompt,
	int32_t seq_len = 1024,
	int64_t start_pos = 0,
	std::function<void(const std::string&)> token_callback = {},
	std::function<void(const ::executorch::extension::llm::Stats&)>
	stats_callback = {});

[facebook-github-bot]

@kirklandsign has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

[facebook-github-bot]

@kirklandsign has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

[facebook-github-bot]

@kirklandsign has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

[facebook-github-bot]

@kirklandsign has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.