Skip to content

Commit

Permalink
[GPU] Not to apply swiglu fusion for onednn (#28011)
Browse files Browse the repository at this point in the history
### Details:
- Disable swiglu fusion which was removed from the previous PR
#27831 by accident..
### Tickets:
 - *ticket-id*
  • Loading branch information
yeonbok authored Dec 11, 2024
1 parent f7a6933 commit 8659cd2
Showing 1 changed file with 4 additions and 0 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -171,6 +171,10 @@ void prepare_primitive_fusing::fuse_swiglu(program &p) {
// Apply only for high performant GPU
if (disable_fc_swiglu_fusion || p.get_engine().get_device_info().execution_units_count < 128)
return;

if (p.get_engine().get_device_info().supports_immad)
return;

// TODO: to support other glu types && other weight data types
auto itr = p.get_processing_order().begin();
std::map<primitive_id, std::vector<std::pair<primitive_id, size_t>>> fusing_history;
Expand Down

0 comments on commit 8659cd2

Please sign in to comment.