Skip to content

Commit

Permalink
update
Browse files Browse the repository at this point in the history
  • Loading branch information
MaybeShewill-CV committed Dec 17, 2024
1 parent 37e0ad7 commit 86a7420
Showing 1 changed file with 2 additions and 1 deletion.
3 changes: 2 additions & 1 deletion src/models/llm/llama/llama3.inl
Original file line number Diff line number Diff line change
Expand Up @@ -406,6 +406,7 @@ StatusCode Llama3<INPUT, OUTPUT>::Impl::embed_prompt(

// check if need pool embeddings
std::string trans_pool_type;
trans_pool_type.resize(pool_type.size());
std::transform(pool_type.begin(), pool_type.end(), trans_pool_type.begin(), [](unsigned char c) { return std::tolower(c);});
if (trans_pool_type == "mean") {
std::vector<float> pooled_embeds(embed_dims, 0.0f);
Expand Down Expand Up @@ -556,7 +557,7 @@ Llama3<INPUT, OUTPUT>::Llama3() {
* @tparam OUTPUT
*/
template <typename INPUT, typename OUTPUT>
Llama3<INPUT, OUTPUT>::~Llama3() {};
Llama3<INPUT, OUTPUT>::~Llama3() = default;

/***
*
Expand Down

0 comments on commit 86a7420

Please sign in to comment.